Nov 29 20:12:45 user nova-compute[75356]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75356) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 20:12:45 user nova-compute[75356]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75356) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 20:12:45 user nova-compute[75356]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75356) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 20:12:45 user nova-compute[75356]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:12:46 user nova-compute[75356]: INFO nova.virt.driver [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 29 20:12:46 user nova-compute[75356]: INFO nova.compute.provider_config [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] Acquiring lock "singleton_lock" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] Acquired lock "singleton_lock" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] Releasing lock "singleton_lock" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] Full set of CONF: {{(pid=75356) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ******************************************************************************** {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] Configuration options gathered from: {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ================================================================================ {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] allow_resize_to_same_host      = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] arq_binding_timeout            = 300 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] backdoor_port                  = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] backdoor_socket                = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] block_device_allocate_retries  = 300 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] block_device_allocate_retries_interval = 5 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cert                           = self.pem {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] compute_monitors               = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] config_dir                     = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] config_drive_format            = iso9660 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] config_source                  = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] console_host                   = user {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] control_exchange               = nova {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cpu_allocation_ratio           = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] daemon                         = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] debug                          = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] default_access_ip_network_name = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] default_availability_zone      = nova {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] default_ephemeral_format       = ext4 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] default_green_pool_size        = 1000 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] default_schedule_zone          = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] disk_allocation_ratio          = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] enable_new_services            = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] enabled_ssl_apis               = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] flat_injected                  = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] force_config_drive             = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] force_raw_images               = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] graceful_shutdown_timeout      = 5 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] heal_instance_info_cache_interval = 60 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] host                           = user {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] instance_build_timeout         = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] instance_delete_interval       = 300 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] instance_name_template         = instance-%08x {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] instance_usage_audit           = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] instance_usage_audit_period    = month {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] internal_service_availability_zone = internal {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] key                            = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] live_migration_retry_count     = 30 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] log_config_append              = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] log_dir                        = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] log_file                       = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] log_options                    = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] log_rotate_interval            = 1 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] log_rotate_interval_type       = days {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] log_rotation_type              = none {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] long_rpc_timeout               = 1800 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] max_concurrent_builds          = 10 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] max_concurrent_live_migrations = 1 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] max_concurrent_snapshots       = 5 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] max_local_block_devices        = 3 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] max_logfile_count              = 30 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] max_logfile_size_mb            = 200 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] maximum_instance_delete_attempts = 5 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] metadata_listen                = 0.0.0.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] metadata_listen_port           = 8775 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] metadata_workers               = 3 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] migrate_max_retries            = -1 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] mkisofs_cmd                    = genisoimage {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] my_ip                          = 10.0.0.210 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] network_allocate_retries       = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] osapi_compute_listen_port      = 8774 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] osapi_compute_unique_server_name_scope =  {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] osapi_compute_workers          = 3 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] password_length                = 12 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] periodic_enable                = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] periodic_fuzzy_delay           = 60 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] pointer_model                  = ps2mouse {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] preallocate_images             = none {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] publish_errors                 = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] pybasedir                      = /opt/stack/nova {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ram_allocation_ratio           = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] rate_limit_burst               = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] rate_limit_except_level        = CRITICAL {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] rate_limit_interval            = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] reboot_timeout                 = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] reclaim_instance_interval      = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] record                         = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] reimage_timeout_per_gb         = 60 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] report_interval                = 120 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] rescue_timeout                 = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] reserved_host_cpus             = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] reserved_host_disk_mb          = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] reserved_host_memory_mb        = 512 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] reserved_huge_pages            = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] resize_confirm_window          = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] resize_fs_using_block_device   = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] resume_guests_state_on_host_boot = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] rpc_response_timeout           = 60 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] run_external_periodic_tasks    = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] running_deleted_instance_action = reap {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] running_deleted_instance_timeout = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] scheduler_instance_sync_interval = 120 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] service_down_time              = 720 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] servicegroup_driver            = db {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] shelved_offload_time           = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] shelved_poll_interval          = 3600 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] shutdown_timeout               = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] source_is_ipv6                 = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ssl_only                       = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] state_path                     = /opt/stack/data/nova {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] sync_power_state_interval      = 600 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] sync_power_state_pool_size     = 1000 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] syslog_log_facility            = LOG_USER {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] tempdir                        = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] timeout_nbd                    = 10 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] transport_url                  = **** {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] update_resources_interval      = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] use_cow_images                 = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] use_eventlog                   = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] use_journal                    = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] use_json                       = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] use_rootwrap_daemon            = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] use_stderr                     = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] use_syslog                     = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vcpu_pin_set                   = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vif_plugging_is_fatal          = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vif_plugging_timeout           = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] virt_mkfs                      = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] volume_usage_poll_interval     = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] watch_log_file                 = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] web                            = /usr/share/spice-html5 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_concurrency.disable_process_locking = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api.auth_strategy              = keystone {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api.compute_link_prefix        = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api.dhcp_domain                = novalocal {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api.enable_instance_password   = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api.glance_link_prefix         = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api.instance_list_per_project_cells = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api.list_records_by_skipping_down_cells = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api.local_metadata_per_cell    = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api.max_limit                  = 1000 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api.metadata_cache_expiration  = 15 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api.neutron_default_tenant_id  = default {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api.use_forwarded_for          = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api.use_neutron_default_nets   = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api.vendordata_dynamic_targets = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api.vendordata_jsonfile_path   = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.backend_argument         = **** {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.config_prefix            = cache.oslo {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.dead_timeout             = 60.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.debug_cache_backend      = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.enable_retry_client      = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.enable_socket_keepalive  = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.enabled                  = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.expiration_time          = 600 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.hashclient_retry_attempts = 2 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.memcache_dead_retry      = 300 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.memcache_password        =  {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.memcache_sasl_enabled    = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.memcache_username        =  {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.proxies                  = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.retry_attempts           = 2 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.retry_delay              = 0.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.socket_keepalive_count   = 1 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.socket_keepalive_idle    = 1 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.socket_keepalive_interval = 1 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.tls_allowed_ciphers      = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.tls_cafile               = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.tls_certfile             = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.tls_enabled              = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cache.tls_keyfile              = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cinder.auth_section            = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cinder.auth_type               = password {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cinder.cafile                  = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cinder.certfile                = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cinder.collect_timing          = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cinder.cross_az_attach         = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cinder.debug                   = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cinder.endpoint_template       = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cinder.http_retries            = 3 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cinder.insecure                = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cinder.keyfile                 = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cinder.os_region_name          = RegionOne {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cinder.split_loggers           = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cinder.timeout                 = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] compute.cpu_dedicated_set      = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] compute.cpu_shared_set         = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] compute.image_type_exclude_list = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] compute.resource_provider_association_refresh = 300 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] compute.shutdown_retry_interval = 10 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] conductor.workers              = 3 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] console.allowed_origins        = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] console.ssl_ciphers            = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] console.ssl_minimum_version    = default {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] consoleauth.token_ttl          = 600 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cyborg.cafile                  = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cyborg.certfile                = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cyborg.collect_timing          = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cyborg.connect_retries         = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cyborg.connect_retry_delay     = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cyborg.endpoint_override       = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cyborg.insecure                = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cyborg.keyfile                 = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cyborg.max_version             = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cyborg.min_version             = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cyborg.region_name             = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cyborg.service_name            = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cyborg.service_type            = accelerator {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cyborg.split_loggers           = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cyborg.status_code_retries     = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cyborg.status_code_retry_delay = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cyborg.timeout                 = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] cyborg.version                 = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] database.backend               = sqlalchemy {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] database.connection            = **** {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] database.connection_debug      = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] database.connection_parameters =  {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] database.connection_recycle_time = 3600 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] database.connection_trace      = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] database.db_inc_retry_interval = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] database.db_max_retries        = 20 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] database.db_max_retry_interval = 10 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] database.db_retry_interval     = 1 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] database.max_overflow          = 50 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] database.max_pool_size         = 5 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] database.max_retries           = 10 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] database.mysql_wsrep_sync_wait = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] database.pool_timeout          = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] database.retry_interval        = 10 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] database.slave_connection      = **** {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] database.sqlite_synchronous    = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api_database.backend           = sqlalchemy {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api_database.connection        = **** {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api_database.connection_debug  = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api_database.connection_parameters =  {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api_database.connection_recycle_time = 3600 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api_database.connection_trace  = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api_database.db_inc_retry_interval = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api_database.db_max_retries    = 20 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api_database.db_max_retry_interval = 10 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api_database.db_retry_interval = 1 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api_database.max_overflow      = 50 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api_database.max_pool_size     = 5 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api_database.max_retries       = 10 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api_database.pool_timeout      = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api_database.retry_interval    = 10 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api_database.slave_connection  = **** {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] api_database.sqlite_synchronous = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] devices.enabled_mdev_types     = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ephemeral_storage_encryption.enabled = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.api_servers             = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.cafile                  = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.certfile                = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.collect_timing          = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.connect_retries         = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.connect_retry_delay     = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.debug                   = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.default_trusted_certificate_ids = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.enable_certificate_validation = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.enable_rbd_download     = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.endpoint_override       = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.insecure                = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.keyfile                 = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.max_version             = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.min_version             = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.num_retries             = 3 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.rbd_ceph_conf           =  {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.rbd_connect_timeout     = 5 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.rbd_pool                =  {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.rbd_user                =  {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.region_name             = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.service_name            = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.service_type            = image {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.split_loggers           = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.status_code_retries     = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.status_code_retry_delay = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.timeout                 = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.verify_glance_signatures = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] glance.version                 = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] guestfs.debug                  = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] hyperv.config_drive_cdrom      = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] hyperv.config_drive_inject_password = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] hyperv.enable_remotefx         = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] hyperv.instances_path_share    =  {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] hyperv.limit_cpu_features      = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] hyperv.use_multipath_io        = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] hyperv.vswitch_name            = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] mks.enabled                    = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] image_cache.manager_interval   = 2400 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] image_cache.precache_concurrency = 1 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] image_cache.remove_unused_base_images = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] image_cache.subdirectory_name  = _base {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.api_max_retries         = 60 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.api_retry_interval      = 2 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.auth_section            = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.auth_type               = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.cafile                  = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.certfile                = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.collect_timing          = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.conductor_group         = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.connect_retries         = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.connect_retry_delay     = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.endpoint_override       = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.insecure                = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.keyfile                 = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.max_version             = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.min_version             = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.peer_list               = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.region_name             = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.serial_console_state_timeout = 10 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.service_name            = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.service_type            = baremetal {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.split_loggers           = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.status_code_retries     = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.status_code_retry_delay = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.timeout                 = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ironic.version                 = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] key_manager.fixed_key          = **** {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican.barbican_api_version  = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican.barbican_endpoint     = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican.barbican_endpoint_type = public {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican.barbican_region_name  = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican.cafile                = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican.certfile              = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican.collect_timing        = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican.insecure              = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican.keyfile               = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican.number_of_retries     = 60 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican.retry_delay           = 1 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican.send_service_user_token = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican.split_loggers         = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican.timeout               = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican.verify_ssl            = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican.verify_ssl_path       = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican_service_user.auth_section = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican_service_user.auth_type = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican_service_user.cafile   = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican_service_user.certfile = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican_service_user.collect_timing = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican_service_user.insecure = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican_service_user.keyfile  = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican_service_user.split_loggers = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] barbican_service_user.timeout  = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vault.approle_role_id          = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vault.approle_secret_id        = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vault.cafile                   = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vault.certfile                 = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vault.collect_timing           = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vault.insecure                 = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vault.keyfile                  = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vault.kv_mountpoint            = secret {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vault.kv_path                  = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vault.kv_version               = 2 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vault.namespace                = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vault.root_token_id            = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vault.split_loggers            = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vault.ssl_ca_crt_file          = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vault.timeout                  = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vault.use_ssl                  = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] keystone.auth_section          = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] keystone.auth_type             = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] keystone.cafile                = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] keystone.certfile              = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] keystone.collect_timing        = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] keystone.connect_retries       = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] keystone.connect_retry_delay   = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] keystone.endpoint_override     = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] keystone.insecure              = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] keystone.keyfile               = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] keystone.max_version           = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] keystone.min_version           = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] keystone.region_name           = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] keystone.service_name          = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] keystone.service_type          = identity {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] keystone.split_loggers         = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] keystone.status_code_retries   = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] keystone.status_code_retry_delay = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] keystone.timeout               = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] keystone.version               = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.connection_uri         =  {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.cpu_mode               = custom {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: WARNING oslo_config.cfg [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.cpu_power_governor_high = performance {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.cpu_power_management   = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.device_detach_attempts = 8 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.device_detach_timeout  = 20 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.disk_cachemodes        = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.disk_prefix            = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.enabled_perf_events    = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.file_backed_memory     = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.gid_maps               = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.hw_disk_discard        = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.hw_machine_type        = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.images_rbd_pool        = rbd {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.images_type            = default {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.images_volume_group    = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.inject_key             = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.inject_partition       = -2 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.inject_password        = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.iscsi_iface            = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.iser_use_multipath     = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.live_migration_downtime = 500 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.live_migration_inbound_addr = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.live_migration_scheme  = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.live_migration_timeout_action = abort {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.live_migration_tunnelled = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: WARNING oslo_config.cfg [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 29 20:12:46 user nova-compute[75356]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 29 20:12:46 user nova-compute[75356]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 29 20:12:46 user nova-compute[75356]: and ``live_migration_inbound_addr`` respectively.
Nov 29 20:12:46 user nova-compute[75356]: ).  Its value may be silently ignored in the future.
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.live_migration_with_native_tls = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.max_queues             = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.nfs_mount_options      = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.num_pcie_ports         = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.pmem_namespaces        = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.quobyte_client_cfg     = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.rbd_secret_uuid        = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.rbd_user               = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.rescue_image_id        = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.rescue_kernel_id       = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.rx_queue_size          = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.smbfs_mount_options    =  {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.snapshot_compression   = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.snapshot_image_format  = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.sparse_logical_volumes = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.swtpm_enabled          = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.swtpm_group            = tss {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.swtpm_user             = tss {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.sysinfo_serial         = unique {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.tb_cache_size          = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.tx_queue_size          = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.uid_maps               = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.use_virtio_for_bridges = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.virt_type              = kvm {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.volume_clear           = zero {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.volume_clear_size      = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.volume_use_multipath   = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.vzstorage_cache_path   = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.auth_section           = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.auth_type              = password {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.cafile                 = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.certfile               = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.collect_timing         = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.connect_retries        = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.connect_retry_delay    = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.default_floating_pool  = public {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.endpoint_override      = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.extension_sync_interval = 600 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.http_retries           = 3 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.insecure               = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.keyfile                = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.max_version            = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.min_version            = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.ovs_bridge             = br-int {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.physnets               = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.region_name            = RegionOne {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.service_metadata_proxy = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.service_name           = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.service_type           = network {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.split_loggers          = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.status_code_retries    = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.status_code_retry_delay = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.timeout                = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] neutron.version                = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] notifications.bdms_in_notifications = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] notifications.default_level    = INFO {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] notifications.notification_format = unversioned {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] notifications.notify_on_state_change = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] pci.alias                      = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] pci.device_spec                = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] pci.report_in_placement        = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.auth_section         = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.auth_type            = password {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.cafile               = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.certfile             = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.collect_timing       = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.connect_retries      = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.connect_retry_delay  = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.default_domain_id    = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.default_domain_name  = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.domain_id            = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.domain_name          = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.endpoint_override    = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.insecure             = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.keyfile              = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.max_version          = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.min_version          = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.password             = **** {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.project_domain_id    = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.project_domain_name  = Default {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.project_id           = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.project_name         = service {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.region_name          = RegionOne {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.service_name         = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.service_type         = placement {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.split_loggers        = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.status_code_retries  = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.status_code_retry_delay = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.system_scope         = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.timeout              = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.trust_id             = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.user_domain_id       = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.user_domain_name     = Default {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.user_id              = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.username             = placement {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] placement.version              = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] quota.cores                    = 20 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] quota.count_usage_from_placement = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] quota.injected_file_content_bytes = 10240 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] quota.injected_file_path_length = 255 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] quota.injected_files           = 5 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] quota.instances                = 10 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] quota.key_pairs                = 100 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] quota.metadata_items           = 128 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] quota.ram                      = 51200 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] quota.recheck_quota            = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] quota.server_group_members     = 10 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] quota.server_groups            = 10 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] rdp.enabled                    = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] scheduler.image_metadata_prefilter = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] scheduler.max_attempts         = 3 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] scheduler.max_placement_results = 1000 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] scheduler.workers              = 3 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.host_subset_size = 1 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.isolated_hosts = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.isolated_images = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.pci_in_placement = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.track_instance_changes = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] metrics.required               = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] metrics.weight_multiplier      = 1.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] metrics.weight_setting         = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] serial_console.enabled         = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] serial_console.port_range      = 10000:20000 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] serial_console.serialproxy_port = 6083 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] service_user.auth_section      = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] service_user.auth_type         = password {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] service_user.cafile            = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] service_user.certfile          = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] service_user.collect_timing    = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] service_user.insecure          = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] service_user.keyfile           = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] service_user.send_service_user_token = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] service_user.split_loggers     = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] service_user.timeout           = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] spice.agent_enabled            = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] spice.enabled                  = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] spice.html5proxy_port          = 6082 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] spice.image_compression        = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] spice.jpeg_compression         = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] spice.playback_compression     = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] spice.server_listen            = 127.0.0.1 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] spice.streaming_mode           = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] spice.zlib_compression         = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] upgrade_levels.baseapi         = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] upgrade_levels.compute         = auto {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] upgrade_levels.conductor       = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] upgrade_levels.scheduler       = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vendordata_dynamic_auth.cafile = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vendordata_dynamic_auth.certfile = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vendordata_dynamic_auth.insecure = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vendordata_dynamic_auth.timeout = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.api_retry_count         = 10 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.ca_file                 = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.cache_prefix            = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.cluster_name            = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.connection_pool_size    = 10 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.console_delay_seconds   = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.datastore_regex         = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.host_ip                 = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.host_password           = **** {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.host_port               = 443 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.host_username           = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.insecure                = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.integration_bridge      = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.maximum_objects         = 100 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.pbm_default_policy      = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.pbm_enabled             = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.pbm_wsdl_location       = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.serial_port_proxy_uri   = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.serial_port_service_uri = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.task_poll_interval      = 0.5 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.use_linked_clone        = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.vnc_keymap              = en-us {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.vnc_port                = 5900 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vmware.vnc_port_total          = 10000 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vnc.auth_schemes               = ['none'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vnc.enabled                    = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vnc.novncproxy_port            = 6080 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vnc.vencrypt_ca_certs          = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vnc.vencrypt_client_cert       = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vnc.vencrypt_client_key        = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] workarounds.disable_rootwrap   = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] workarounds.enable_numa_live_migration = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] workarounds.libvirt_disable_apic = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] wsgi.client_socket_timeout     = 900 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] wsgi.default_pool_size         = 1000 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] wsgi.keep_alive                = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] wsgi.max_header_line           = 16384 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] wsgi.ssl_ca_file               = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] wsgi.ssl_cert_file             = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] wsgi.ssl_key_file              = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] wsgi.tcp_keepidle              = 600 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] zvm.ca_file                    = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] zvm.cloud_connector_url        = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] zvm.reachable_timeout          = 300 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_policy.enforce_new_defaults = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_policy.enforce_scope      = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_policy.policy_default_rule = default {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] profiler.connection_string     = messaging:// {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] profiler.enabled               = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] profiler.es_doc_type           = notification {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] profiler.es_scroll_size        = 10000 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] profiler.es_scroll_time        = 2m {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] profiler.filter_error_trace    = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] profiler.hmac_keys             = **** {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] profiler.sentinel_service_name = mymaster {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] profiler.socket_timeout        = 0.1 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] profiler.trace_requests        = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] profiler.trace_sqlalchemy      = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] profiler_jaeger.process_tags   = {} {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] profiler_jaeger.service_name_prefix = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] profiler_otlp.service_name_prefix = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] remote_debug.host              = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] remote_debug.port              = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_notifications.retry = -1 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_limit.auth_section        = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_limit.auth_type           = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_limit.cafile              = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_limit.certfile            = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_limit.collect_timing      = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_limit.connect_retries     = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_limit.connect_retry_delay = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_limit.endpoint_id         = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_limit.endpoint_override   = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_limit.insecure            = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_limit.keyfile             = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_limit.max_version         = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_limit.min_version         = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_limit.region_name         = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_limit.service_name        = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_limit.service_type        = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_limit.split_loggers       = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_limit.status_code_retries = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_limit.status_code_retry_delay = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_limit.timeout             = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_limit.valid_interfaces    = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_limit.version             = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_reports.file_event_handler = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] oslo_reports.log_dir           = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vif_plug_ovs_privileged.group  = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] vif_plug_ovs_privileged.user   = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] os_vif_ovs.isolate_vif         = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] os_brick.lock_path             = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] privsep_osbrick.capabilities   = [21] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] privsep_osbrick.group          = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] privsep_osbrick.helper_command = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] privsep_osbrick.user           = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] nova_sys_admin.group           = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] nova_sys_admin.helper_command  = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] nova_sys_admin.user            = None {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG oslo_service.service [None req-2903877b-4763-44d4-90df-1e72f417c014 None None] ******************************************************************************** {{(pid=75356) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 29 20:12:46 user nova-compute[75356]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 29 20:12:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Connecting to libvirt: qemu:///system {{(pid=75356) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f83111ce2f0> {{(pid=75356) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 29 20:12:46 user nova-compute[75356]: libvirt:  error : internal error: could not initialize domain event timer
Nov 29 20:12:46 user nova-compute[75356]: WARNING nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 29 20:12:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f83111ce2f0> {{(pid=75356) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Starting native event thread {{(pid=75356) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Starting green dispatch thread {{(pid=75356) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 29 20:12:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Starting connection event dispatch thread {{(pid=75356) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 29 20:12:46 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Connection event '1' reason 'None'
Nov 29 20:12:46 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 29 20:12:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.mount [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Initialising _HostMountState generation 0 {{(pid=75356) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 29 20:12:54 user nova-compute[75356]: INFO nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Libvirt host capabilities <capabilities>
Nov 29 20:12:54 user nova-compute[75356]:   <host>
Nov 29 20:12:54 user nova-compute[75356]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 29 20:12:54 user nova-compute[75356]:     <cpu>
Nov 29 20:12:54 user nova-compute[75356]:       <arch>x86_64</arch>
Nov 29 20:12:54 user nova-compute[75356]:       <model>IvyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <vendor>Intel</vendor>
Nov 29 20:12:54 user nova-compute[75356]:       <microcode version='1070'/>
Nov 29 20:12:54 user nova-compute[75356]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 29 20:12:54 user nova-compute[75356]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature name='ss'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature name='vmx'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature name='pcid'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature name='osxsave'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature name='hypervisor'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature name='arat'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature name='tsc_adjust'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature name='md-clear'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature name='stibp'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature name='arch-capabilities'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature name='ssbd'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature name='invtsc'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature name='rsba'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature name='skip-l1dfl-vmentry'/>
Nov 29 20:12:54 user nova-compute[75356]:       <pages unit='KiB' size='4'/>
Nov 29 20:12:54 user nova-compute[75356]:       <pages unit='KiB' size='2048'/>
Nov 29 20:12:54 user nova-compute[75356]:     </cpu>
Nov 29 20:12:54 user nova-compute[75356]:     <power_management>
Nov 29 20:12:54 user nova-compute[75356]:       <suspend_mem/>
Nov 29 20:12:54 user nova-compute[75356]:       <suspend_disk/>
Nov 29 20:12:54 user nova-compute[75356]:       <suspend_hybrid/>
Nov 29 20:12:54 user nova-compute[75356]:     </power_management>
Nov 29 20:12:54 user nova-compute[75356]:     <iommu support='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     <migration_features>
Nov 29 20:12:54 user nova-compute[75356]:       <live/>
Nov 29 20:12:54 user nova-compute[75356]:       <uri_transports>
Nov 29 20:12:54 user nova-compute[75356]:         <uri_transport>tcp</uri_transport>
Nov 29 20:12:54 user nova-compute[75356]:         <uri_transport>rdma</uri_transport>
Nov 29 20:12:54 user nova-compute[75356]:       </uri_transports>
Nov 29 20:12:54 user nova-compute[75356]:     </migration_features>
Nov 29 20:12:54 user nova-compute[75356]:     <topology>
Nov 29 20:12:54 user nova-compute[75356]:       <cells num='2'>
Nov 29 20:12:54 user nova-compute[75356]:         <cell id='0'>
Nov 29 20:12:54 user nova-compute[75356]:           <memory unit='KiB'>8140616</memory>
Nov 29 20:12:54 user nova-compute[75356]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 29 20:12:54 user nova-compute[75356]:           <pages unit='KiB' size='2048'>0</pages>
Nov 29 20:12:54 user nova-compute[75356]:           <distances>
Nov 29 20:12:54 user nova-compute[75356]:             <sibling id='0' value='10'/>
Nov 29 20:12:54 user nova-compute[75356]:             <sibling id='1' value='20'/>
Nov 29 20:12:54 user nova-compute[75356]:           </distances>
Nov 29 20:12:54 user nova-compute[75356]:           <cpus num='6'>
Nov 29 20:12:54 user nova-compute[75356]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 29 20:12:54 user nova-compute[75356]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 29 20:12:54 user nova-compute[75356]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 29 20:12:54 user nova-compute[75356]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 29 20:12:54 user nova-compute[75356]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 29 20:12:54 user nova-compute[75356]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 29 20:12:54 user nova-compute[75356]:           </cpus>
Nov 29 20:12:54 user nova-compute[75356]:         </cell>
Nov 29 20:12:54 user nova-compute[75356]:         <cell id='1'>
Nov 29 20:12:54 user nova-compute[75356]:           <memory unit='KiB'>8255068</memory>
Nov 29 20:12:54 user nova-compute[75356]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 29 20:12:54 user nova-compute[75356]:           <pages unit='KiB' size='2048'>0</pages>
Nov 29 20:12:54 user nova-compute[75356]:           <distances>
Nov 29 20:12:54 user nova-compute[75356]:             <sibling id='0' value='20'/>
Nov 29 20:12:54 user nova-compute[75356]:             <sibling id='1' value='10'/>
Nov 29 20:12:54 user nova-compute[75356]:           </distances>
Nov 29 20:12:54 user nova-compute[75356]:           <cpus num='6'>
Nov 29 20:12:54 user nova-compute[75356]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 29 20:12:54 user nova-compute[75356]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 29 20:12:54 user nova-compute[75356]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 29 20:12:54 user nova-compute[75356]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 29 20:12:54 user nova-compute[75356]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 29 20:12:54 user nova-compute[75356]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 29 20:12:54 user nova-compute[75356]:           </cpus>
Nov 29 20:12:54 user nova-compute[75356]:         </cell>
Nov 29 20:12:54 user nova-compute[75356]:       </cells>
Nov 29 20:12:54 user nova-compute[75356]:     </topology>
Nov 29 20:12:54 user nova-compute[75356]:     <cache>
Nov 29 20:12:54 user nova-compute[75356]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 29 20:12:54 user nova-compute[75356]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 29 20:12:54 user nova-compute[75356]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 29 20:12:54 user nova-compute[75356]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 29 20:12:54 user nova-compute[75356]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 29 20:12:54 user nova-compute[75356]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 29 20:12:54 user nova-compute[75356]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 29 20:12:54 user nova-compute[75356]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 29 20:12:54 user nova-compute[75356]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 29 20:12:54 user nova-compute[75356]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 29 20:12:54 user nova-compute[75356]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 29 20:12:54 user nova-compute[75356]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 29 20:12:54 user nova-compute[75356]:     </cache>
Nov 29 20:12:54 user nova-compute[75356]:     <secmodel>
Nov 29 20:12:54 user nova-compute[75356]:       <model>apparmor</model>
Nov 29 20:12:54 user nova-compute[75356]:       <doi>0</doi>
Nov 29 20:12:54 user nova-compute[75356]:     </secmodel>
Nov 29 20:12:54 user nova-compute[75356]:     <secmodel>
Nov 29 20:12:54 user nova-compute[75356]:       <model>dac</model>
Nov 29 20:12:54 user nova-compute[75356]:       <doi>0</doi>
Nov 29 20:12:54 user nova-compute[75356]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 29 20:12:54 user nova-compute[75356]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 29 20:12:54 user nova-compute[75356]:     </secmodel>
Nov 29 20:12:54 user nova-compute[75356]:   </host>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='alpha'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>64</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>clipper</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='armv6l'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>32</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>spitz</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>nuri</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>kzm</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>sx1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>z2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>tosa</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>n810</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>n800</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>terrier</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>midway</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>microbit</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>verdex</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>highbank</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>akita</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>connex</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>collie</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='armv7l'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>32</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>spitz</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>nuri</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>kzm</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>sx1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>z2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>tosa</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>n810</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>n800</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>terrier</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>midway</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>microbit</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>verdex</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>highbank</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>akita</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>connex</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>collie</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='aarch64'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>64</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>spitz</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>nuri</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>kzm</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>sx1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>z2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>tosa</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>n810</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>n800</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>terrier</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>midway</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>microbit</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>verdex</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>raspi3b</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>highbank</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>akita</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>connex</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>collie</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <acpi default='on' toggle='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='cris'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>32</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='i686'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>32</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>x-remote</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>isapc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>microvm</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='kvm'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <pae/>
Nov 29 20:12:54 user nova-compute[75356]:       <nonpae/>
Nov 29 20:12:54 user nova-compute[75356]:       <acpi default='on' toggle='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:       <apic default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='m68k'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>32</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>an5206</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>q800</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>next-cube</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='microblaze'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>32</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='microblazeel'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>32</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='mips'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>32</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='16'>malta</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='mipsel'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>32</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='16'>malta</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='mips64'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>64</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='16'>malta</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>pica61</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>magnum</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='mips64el'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>64</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='16'>malta</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>pica61</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>magnum</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='16'>boston</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='ppc'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>32</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mac99</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>40p</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>taihu</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='ppc64'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>64</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2048'>powernv9</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>taihu</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2048'>powernv10</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>40p</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mac99</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2048'>powernv8</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='ppc64le'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>64</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2048'>powernv9</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>taihu</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2048'>powernv10</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>40p</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>mac99</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2048'>powernv8</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='riscv32'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>32</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='8'>spike</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>opentitan</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='5'>sifive_u</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>sifive_e</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='8'>virt</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='riscv64'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>64</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='8'>spike</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='5'>sifive_u</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>shakti_c</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>sifive_e</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='8'>virt</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='s390x'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>64</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='sh4'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>32</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>shix</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>r2d</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='sh4eb'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>64</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>shix</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>r2d</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='sparc'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>32</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>SS-5</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>SS-20</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>LX</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>SS-4</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>SS-10</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>Voyager</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='sparc64'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>64</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>sun4u</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>niagara</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>sun4v</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='x86_64'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>64</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>x-remote</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='1'>isapc</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>microvm</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='kvm'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <acpi default='on' toggle='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:       <apic default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='xtensa'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>32</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>sim</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='32'>kc705</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='32'>ml605</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='32'>virt</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='32'>lx200</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='32'>lx60</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]:   <guest>
Nov 29 20:12:54 user nova-compute[75356]:     <os_type>hvm</os_type>
Nov 29 20:12:54 user nova-compute[75356]:     <arch name='xtensaeb'>
Nov 29 20:12:54 user nova-compute[75356]:       <wordsize>32</wordsize>
Nov 29 20:12:54 user nova-compute[75356]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='4'>sim</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='32'>kc705</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='32'>ml605</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='32'>virt</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='32'>lx200</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='32'>lx60</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 29 20:12:54 user nova-compute[75356]:       <domain type='qemu'/>
Nov 29 20:12:54 user nova-compute[75356]:     </arch>
Nov 29 20:12:54 user nova-compute[75356]:     <features>
Nov 29 20:12:54 user nova-compute[75356]:       <cpuselection/>
Nov 29 20:12:54 user nova-compute[75356]:       <deviceboot/>
Nov 29 20:12:54 user nova-compute[75356]:       <disksnapshot default='on' toggle='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     </features>
Nov 29 20:12:54 user nova-compute[75356]:   </guest>
Nov 29 20:12:54 user nova-compute[75356]: </capabilities>
Nov 29 20:12:54 user nova-compute[75356]: 
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 29 20:12:54 user nova-compute[75356]: <domainCapabilities>
Nov 29 20:12:54 user nova-compute[75356]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 20:12:54 user nova-compute[75356]:   <domain>kvm</domain>
Nov 29 20:12:54 user nova-compute[75356]:   <machine>pc-q35-6.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:   <arch>i686</arch>
Nov 29 20:12:54 user nova-compute[75356]:   <vcpu max='288'/>
Nov 29 20:12:54 user nova-compute[75356]:   <iothreads supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:   <os supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:     <enum name='firmware'/>
Nov 29 20:12:54 user nova-compute[75356]:     <loader supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='type'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>rom</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>pflash</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='readonly'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>yes</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>no</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='secure'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>no</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </loader>
Nov 29 20:12:54 user nova-compute[75356]:   </os>
Nov 29 20:12:54 user nova-compute[75356]:   <cpu>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='host-passthrough' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='hostPassthroughMigratable'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>off</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='maximum' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='maximumMigratable'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>on</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>off</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='host-model' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <vendor>Intel</vendor>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ss'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='vmx'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='pcid'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='hypervisor'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='arat'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='umip'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='md-clear'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='stibp'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ssbd'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ibpb'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ibrs'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='amd-stibp'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='disable' name='erms'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='disable' name='lm'/>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='custom' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>qemu64</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>qemu32</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>phenom</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium3</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium2</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>n270</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>kvm64</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>kvm32</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>coreduo</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>core2duo</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>athlon</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Westmere</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Snowridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>SandyBridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Penryn</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G5</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G4</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G3</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G2</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G1</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Nehalem</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>IvyBridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Icelake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-Rome</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-Milan</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Dhyana</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cooperlake</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Conroe</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>486</model>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:   </cpu>
Nov 29 20:12:54 user nova-compute[75356]:   <memoryBacking supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:     <enum name='sourceType'>
Nov 29 20:12:54 user nova-compute[75356]:       <value>file</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>anonymous</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>memfd</value>
Nov 29 20:12:54 user nova-compute[75356]:     </enum>
Nov 29 20:12:54 user nova-compute[75356]:   </memoryBacking>
Nov 29 20:12:54 user nova-compute[75356]:   <devices>
Nov 29 20:12:54 user nova-compute[75356]:     <disk supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='diskDevice'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>disk</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>cdrom</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>floppy</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>lun</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='bus'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>fdc</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>scsi</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>usb</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>sata</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-non-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </disk>
Nov 29 20:12:54 user nova-compute[75356]:     <graphics supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='type'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>sdl</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vnc</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>spice</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>egl-headless</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </graphics>
Nov 29 20:12:54 user nova-compute[75356]:     <video supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='modelType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vga</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>cirrus</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vmvga</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>qxl</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>none</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>bochs</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>ramfb</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </video>
Nov 29 20:12:54 user nova-compute[75356]:     <hostdev supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='mode'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>subsystem</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='startupPolicy'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>default</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>mandatory</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>requisite</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>optional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='subsysType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>usb</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>pci</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>scsi</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='capsType'/>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='pciBackend'/>
Nov 29 20:12:54 user nova-compute[75356]:     </hostdev>
Nov 29 20:12:54 user nova-compute[75356]:     <rng supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-non-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='backendModel'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>random</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>egd</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>builtin</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </rng>
Nov 29 20:12:54 user nova-compute[75356]:     <filesystem supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='driverType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>path</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>handle</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtiofs</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </filesystem>
Nov 29 20:12:54 user nova-compute[75356]:     <tpm supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>tpm-tis</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>tpm-crb</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='backendModel'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>passthrough</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>emulator</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </tpm>
Nov 29 20:12:54 user nova-compute[75356]:   </devices>
Nov 29 20:12:54 user nova-compute[75356]:   <features>
Nov 29 20:12:54 user nova-compute[75356]:     <gic supported='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     <vmcoreinfo supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <genid supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <backingStoreInput supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <backup supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <sev supported='no'/>
Nov 29 20:12:54 user nova-compute[75356]:   </features>
Nov 29 20:12:54 user nova-compute[75356]: </domainCapabilities>
Nov 29 20:12:54 user nova-compute[75356]:  {{(pid=75356) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 29 20:12:54 user nova-compute[75356]: <domainCapabilities>
Nov 29 20:12:54 user nova-compute[75356]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 20:12:54 user nova-compute[75356]:   <domain>kvm</domain>
Nov 29 20:12:54 user nova-compute[75356]:   <machine>pc-i440fx-jammy</machine>
Nov 29 20:12:54 user nova-compute[75356]:   <arch>i686</arch>
Nov 29 20:12:54 user nova-compute[75356]:   <vcpu max='255'/>
Nov 29 20:12:54 user nova-compute[75356]:   <iothreads supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:   <os supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:     <enum name='firmware'/>
Nov 29 20:12:54 user nova-compute[75356]:     <loader supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='type'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>rom</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>pflash</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='readonly'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>yes</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>no</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='secure'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>no</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </loader>
Nov 29 20:12:54 user nova-compute[75356]:   </os>
Nov 29 20:12:54 user nova-compute[75356]:   <cpu>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='host-passthrough' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='hostPassthroughMigratable'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>off</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='maximum' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='maximumMigratable'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>on</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>off</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='host-model' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <vendor>Intel</vendor>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ss'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='vmx'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='pcid'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='hypervisor'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='arat'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='umip'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='md-clear'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='stibp'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ssbd'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ibpb'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ibrs'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='amd-stibp'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='disable' name='erms'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='disable' name='lm'/>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='custom' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>qemu64</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>qemu32</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>phenom</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium3</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium2</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>n270</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>kvm64</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>kvm32</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>coreduo</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>core2duo</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>athlon</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Westmere</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Snowridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>SandyBridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Penryn</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G5</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G4</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G3</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G2</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G1</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Nehalem</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>IvyBridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Icelake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-Rome</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-Milan</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Dhyana</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cooperlake</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Conroe</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>486</model>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:   </cpu>
Nov 29 20:12:54 user nova-compute[75356]:   <memoryBacking supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:     <enum name='sourceType'>
Nov 29 20:12:54 user nova-compute[75356]:       <value>file</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>anonymous</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>memfd</value>
Nov 29 20:12:54 user nova-compute[75356]:     </enum>
Nov 29 20:12:54 user nova-compute[75356]:   </memoryBacking>
Nov 29 20:12:54 user nova-compute[75356]:   <devices>
Nov 29 20:12:54 user nova-compute[75356]:     <disk supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='diskDevice'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>disk</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>cdrom</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>floppy</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>lun</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='bus'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>ide</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>fdc</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>scsi</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>usb</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>sata</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-non-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </disk>
Nov 29 20:12:54 user nova-compute[75356]:     <graphics supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='type'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>sdl</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vnc</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>spice</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>egl-headless</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </graphics>
Nov 29 20:12:54 user nova-compute[75356]:     <video supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='modelType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vga</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>cirrus</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vmvga</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>qxl</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>none</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>bochs</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>ramfb</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </video>
Nov 29 20:12:54 user nova-compute[75356]:     <hostdev supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='mode'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>subsystem</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='startupPolicy'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>default</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>mandatory</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>requisite</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>optional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='subsysType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>usb</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>pci</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>scsi</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='capsType'/>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='pciBackend'/>
Nov 29 20:12:54 user nova-compute[75356]:     </hostdev>
Nov 29 20:12:54 user nova-compute[75356]:     <rng supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-non-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='backendModel'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>random</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>egd</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>builtin</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </rng>
Nov 29 20:12:54 user nova-compute[75356]:     <filesystem supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='driverType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>path</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>handle</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtiofs</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </filesystem>
Nov 29 20:12:54 user nova-compute[75356]:     <tpm supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>tpm-tis</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>tpm-crb</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='backendModel'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>passthrough</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>emulator</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </tpm>
Nov 29 20:12:54 user nova-compute[75356]:   </devices>
Nov 29 20:12:54 user nova-compute[75356]:   <features>
Nov 29 20:12:54 user nova-compute[75356]:     <gic supported='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     <vmcoreinfo supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <genid supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <backingStoreInput supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <backup supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <sev supported='no'/>
Nov 29 20:12:54 user nova-compute[75356]:   </features>
Nov 29 20:12:54 user nova-compute[75356]: </domainCapabilities>
Nov 29 20:12:54 user nova-compute[75356]:  {{(pid=75356) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 29 20:12:54 user nova-compute[75356]: <domainCapabilities>
Nov 29 20:12:54 user nova-compute[75356]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 20:12:54 user nova-compute[75356]:   <domain>kvm</domain>
Nov 29 20:12:54 user nova-compute[75356]:   <machine>pc-q35-jammy</machine>
Nov 29 20:12:54 user nova-compute[75356]:   <arch>i686</arch>
Nov 29 20:12:54 user nova-compute[75356]:   <vcpu max='288'/>
Nov 29 20:12:54 user nova-compute[75356]:   <iothreads supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:   <os supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:     <enum name='firmware'/>
Nov 29 20:12:54 user nova-compute[75356]:     <loader supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='type'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>rom</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>pflash</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='readonly'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>yes</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>no</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='secure'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>no</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </loader>
Nov 29 20:12:54 user nova-compute[75356]:   </os>
Nov 29 20:12:54 user nova-compute[75356]:   <cpu>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='host-passthrough' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='hostPassthroughMigratable'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>off</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='maximum' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='maximumMigratable'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>on</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>off</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='host-model' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <vendor>Intel</vendor>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ss'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='vmx'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='pcid'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='hypervisor'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='arat'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='umip'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='md-clear'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='stibp'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ssbd'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ibpb'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ibrs'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='amd-stibp'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='disable' name='erms'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='disable' name='lm'/>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='custom' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>qemu64</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>qemu32</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>phenom</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium3</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium2</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>n270</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>kvm64</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>kvm32</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>coreduo</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>core2duo</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>athlon</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Westmere</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Snowridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>SandyBridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Penryn</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G5</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G4</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G3</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G2</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G1</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Nehalem</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>IvyBridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Icelake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-Rome</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-Milan</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Dhyana</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cooperlake</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Conroe</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>486</model>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:   </cpu>
Nov 29 20:12:54 user nova-compute[75356]:   <memoryBacking supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:     <enum name='sourceType'>
Nov 29 20:12:54 user nova-compute[75356]:       <value>file</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>anonymous</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>memfd</value>
Nov 29 20:12:54 user nova-compute[75356]:     </enum>
Nov 29 20:12:54 user nova-compute[75356]:   </memoryBacking>
Nov 29 20:12:54 user nova-compute[75356]:   <devices>
Nov 29 20:12:54 user nova-compute[75356]:     <disk supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='diskDevice'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>disk</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>cdrom</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>floppy</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>lun</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='bus'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>fdc</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>scsi</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>usb</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>sata</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-non-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </disk>
Nov 29 20:12:54 user nova-compute[75356]:     <graphics supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='type'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>sdl</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vnc</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>spice</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>egl-headless</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </graphics>
Nov 29 20:12:54 user nova-compute[75356]:     <video supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='modelType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vga</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>cirrus</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vmvga</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>qxl</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>none</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>bochs</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>ramfb</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </video>
Nov 29 20:12:54 user nova-compute[75356]:     <hostdev supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='mode'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>subsystem</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='startupPolicy'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>default</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>mandatory</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>requisite</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>optional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='subsysType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>usb</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>pci</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>scsi</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='capsType'/>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='pciBackend'/>
Nov 29 20:12:54 user nova-compute[75356]:     </hostdev>
Nov 29 20:12:54 user nova-compute[75356]:     <rng supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-non-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='backendModel'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>random</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>egd</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>builtin</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </rng>
Nov 29 20:12:54 user nova-compute[75356]:     <filesystem supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='driverType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>path</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>handle</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtiofs</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </filesystem>
Nov 29 20:12:54 user nova-compute[75356]:     <tpm supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>tpm-tis</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>tpm-crb</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='backendModel'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>passthrough</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>emulator</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </tpm>
Nov 29 20:12:54 user nova-compute[75356]:   </devices>
Nov 29 20:12:54 user nova-compute[75356]:   <features>
Nov 29 20:12:54 user nova-compute[75356]:     <gic supported='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     <vmcoreinfo supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <genid supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <backingStoreInput supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <backup supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <sev supported='no'/>
Nov 29 20:12:54 user nova-compute[75356]:   </features>
Nov 29 20:12:54 user nova-compute[75356]: </domainCapabilities>
Nov 29 20:12:54 user nova-compute[75356]:  {{(pid=75356) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 29 20:12:54 user nova-compute[75356]: <domainCapabilities>
Nov 29 20:12:54 user nova-compute[75356]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 20:12:54 user nova-compute[75356]:   <domain>kvm</domain>
Nov 29 20:12:54 user nova-compute[75356]:   <machine>pc-i440fx-6.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:   <arch>i686</arch>
Nov 29 20:12:54 user nova-compute[75356]:   <vcpu max='255'/>
Nov 29 20:12:54 user nova-compute[75356]:   <iothreads supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:   <os supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:     <enum name='firmware'/>
Nov 29 20:12:54 user nova-compute[75356]:     <loader supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='type'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>rom</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>pflash</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='readonly'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>yes</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>no</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='secure'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>no</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </loader>
Nov 29 20:12:54 user nova-compute[75356]:   </os>
Nov 29 20:12:54 user nova-compute[75356]:   <cpu>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='host-passthrough' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='hostPassthroughMigratable'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>off</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='maximum' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='maximumMigratable'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>on</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>off</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='host-model' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <vendor>Intel</vendor>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ss'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='vmx'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='pcid'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='hypervisor'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='arat'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='umip'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='md-clear'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='stibp'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ssbd'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ibpb'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ibrs'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='amd-stibp'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='disable' name='erms'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='disable' name='lm'/>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='custom' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>qemu64</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>qemu32</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>phenom</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium3</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium2</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>n270</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>kvm64</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>kvm32</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>coreduo</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>core2duo</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>athlon</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Westmere</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Snowridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>SandyBridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Penryn</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G5</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G4</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G3</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G2</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G1</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Nehalem</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>IvyBridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Icelake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-Rome</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-Milan</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Dhyana</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cooperlake</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Conroe</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>486</model>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:   </cpu>
Nov 29 20:12:54 user nova-compute[75356]:   <memoryBacking supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:     <enum name='sourceType'>
Nov 29 20:12:54 user nova-compute[75356]:       <value>file</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>anonymous</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>memfd</value>
Nov 29 20:12:54 user nova-compute[75356]:     </enum>
Nov 29 20:12:54 user nova-compute[75356]:   </memoryBacking>
Nov 29 20:12:54 user nova-compute[75356]:   <devices>
Nov 29 20:12:54 user nova-compute[75356]:     <disk supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='diskDevice'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>disk</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>cdrom</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>floppy</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>lun</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='bus'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>ide</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>fdc</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>scsi</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>usb</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>sata</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-non-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </disk>
Nov 29 20:12:54 user nova-compute[75356]:     <graphics supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='type'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>sdl</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vnc</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>spice</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>egl-headless</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </graphics>
Nov 29 20:12:54 user nova-compute[75356]:     <video supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='modelType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vga</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>cirrus</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vmvga</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>qxl</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>none</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>bochs</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>ramfb</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </video>
Nov 29 20:12:54 user nova-compute[75356]:     <hostdev supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='mode'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>subsystem</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='startupPolicy'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>default</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>mandatory</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>requisite</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>optional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='subsysType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>usb</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>pci</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>scsi</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='capsType'/>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='pciBackend'/>
Nov 29 20:12:54 user nova-compute[75356]:     </hostdev>
Nov 29 20:12:54 user nova-compute[75356]:     <rng supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-non-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='backendModel'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>random</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>egd</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>builtin</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </rng>
Nov 29 20:12:54 user nova-compute[75356]:     <filesystem supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='driverType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>path</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>handle</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtiofs</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </filesystem>
Nov 29 20:12:54 user nova-compute[75356]:     <tpm supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>tpm-tis</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>tpm-crb</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='backendModel'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>passthrough</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>emulator</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </tpm>
Nov 29 20:12:54 user nova-compute[75356]:   </devices>
Nov 29 20:12:54 user nova-compute[75356]:   <features>
Nov 29 20:12:54 user nova-compute[75356]:     <gic supported='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     <vmcoreinfo supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <genid supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <backingStoreInput supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <backup supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <sev supported='no'/>
Nov 29 20:12:54 user nova-compute[75356]:   </features>
Nov 29 20:12:54 user nova-compute[75356]: </domainCapabilities>
Nov 29 20:12:54 user nova-compute[75356]:  {{(pid=75356) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 29 20:12:54 user nova-compute[75356]: <domainCapabilities>
Nov 29 20:12:54 user nova-compute[75356]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 20:12:54 user nova-compute[75356]:   <domain>kvm</domain>
Nov 29 20:12:54 user nova-compute[75356]:   <machine>pc-q35-6.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:   <arch>x86_64</arch>
Nov 29 20:12:54 user nova-compute[75356]:   <vcpu max='288'/>
Nov 29 20:12:54 user nova-compute[75356]:   <iothreads supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:   <os supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:     <enum name='firmware'>
Nov 29 20:12:54 user nova-compute[75356]:       <value>efi</value>
Nov 29 20:12:54 user nova-compute[75356]:     </enum>
Nov 29 20:12:54 user nova-compute[75356]:     <loader supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='type'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>rom</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>pflash</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='readonly'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>yes</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>no</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='secure'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>yes</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>no</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </loader>
Nov 29 20:12:54 user nova-compute[75356]:   </os>
Nov 29 20:12:54 user nova-compute[75356]:   <cpu>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='host-passthrough' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='hostPassthroughMigratable'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>on</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>off</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='maximum' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='maximumMigratable'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>on</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>off</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='host-model' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <vendor>Intel</vendor>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ss'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='vmx'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='pcid'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='hypervisor'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='arat'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='umip'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='md-clear'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='stibp'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ssbd'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='invtsc'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ibpb'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ibrs'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='amd-stibp'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='rsba'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='disable' name='erms'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='custom' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>qemu64</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>qemu32</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>phenom</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium3</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium2</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>n270</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>kvm64</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>kvm32</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>coreduo</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>core2duo</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>athlon</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Westmere</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Snowridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>SandyBridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Penryn</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G5</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G4</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G3</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G2</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Opteron_G1</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Nehalem</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>IvyBridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Icelake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-Rome</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-Milan</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Dhyana</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cooperlake</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Conroe</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>486</model>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:   </cpu>
Nov 29 20:12:54 user nova-compute[75356]:   <memoryBacking supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:     <enum name='sourceType'>
Nov 29 20:12:54 user nova-compute[75356]:       <value>file</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>anonymous</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>memfd</value>
Nov 29 20:12:54 user nova-compute[75356]:     </enum>
Nov 29 20:12:54 user nova-compute[75356]:   </memoryBacking>
Nov 29 20:12:54 user nova-compute[75356]:   <devices>
Nov 29 20:12:54 user nova-compute[75356]:     <disk supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='diskDevice'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>disk</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>cdrom</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>floppy</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>lun</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='bus'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>fdc</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>scsi</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>usb</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>sata</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-non-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </disk>
Nov 29 20:12:54 user nova-compute[75356]:     <graphics supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='type'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>sdl</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vnc</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>spice</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>egl-headless</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </graphics>
Nov 29 20:12:54 user nova-compute[75356]:     <video supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='modelType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vga</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>cirrus</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vmvga</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>qxl</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>none</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>bochs</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>ramfb</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </video>
Nov 29 20:12:54 user nova-compute[75356]:     <hostdev supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='mode'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>subsystem</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='startupPolicy'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>default</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>mandatory</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>requisite</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>optional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='subsysType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>usb</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>pci</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>scsi</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='capsType'/>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='pciBackend'/>
Nov 29 20:12:54 user nova-compute[75356]:     </hostdev>
Nov 29 20:12:54 user nova-compute[75356]:     <rng supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-non-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='backendModel'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>random</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>egd</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>builtin</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </rng>
Nov 29 20:12:54 user nova-compute[75356]:     <filesystem supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='driverType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>path</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>handle</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtiofs</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </filesystem>
Nov 29 20:12:54 user nova-compute[75356]:     <tpm supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>tpm-tis</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>tpm-crb</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='backendModel'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>passthrough</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>emulator</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </tpm>
Nov 29 20:12:54 user nova-compute[75356]:   </devices>
Nov 29 20:12:54 user nova-compute[75356]:   <features>
Nov 29 20:12:54 user nova-compute[75356]:     <gic supported='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     <vmcoreinfo supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <genid supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <backingStoreInput supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <backup supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <sev supported='no'/>
Nov 29 20:12:54 user nova-compute[75356]:   </features>
Nov 29 20:12:54 user nova-compute[75356]: </domainCapabilities>
Nov 29 20:12:54 user nova-compute[75356]:  {{(pid=75356) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 29 20:12:54 user nova-compute[75356]: <domainCapabilities>
Nov 29 20:12:54 user nova-compute[75356]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 20:12:54 user nova-compute[75356]:   <domain>kvm</domain>
Nov 29 20:12:54 user nova-compute[75356]:   <machine>pc-i440fx-jammy</machine>
Nov 29 20:12:54 user nova-compute[75356]:   <arch>x86_64</arch>
Nov 29 20:12:54 user nova-compute[75356]:   <vcpu max='255'/>
Nov 29 20:12:54 user nova-compute[75356]:   <iothreads supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:   <os supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:     <enum name='firmware'>
Nov 29 20:12:54 user nova-compute[75356]:       <value>efi</value>
Nov 29 20:12:54 user nova-compute[75356]:     </enum>
Nov 29 20:12:54 user nova-compute[75356]:     <loader supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='type'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>rom</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>pflash</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='readonly'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>yes</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>no</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='secure'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>no</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </loader>
Nov 29 20:12:54 user nova-compute[75356]:   </os>
Nov 29 20:12:54 user nova-compute[75356]:   <cpu>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='host-passthrough' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='hostPassthroughMigratable'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>on</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>off</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='maximum' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='maximumMigratable'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>on</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>off</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='host-model' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <vendor>Intel</vendor>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ss'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='vmx'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='pcid'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='hypervisor'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='arat'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='umip'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='md-clear'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='stibp'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ssbd'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='invtsc'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ibpb'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ibrs'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='amd-stibp'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='rsba'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='disable' name='erms'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='custom' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>qemu64</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>qemu32</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>phenom</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium3</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium2</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>n270</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>kvm64</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>kvm32</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>coreduo</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>core2duo</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>athlon</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Westmere</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Snowridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>SandyBridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Penryn</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G5</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G4</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G3</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G2</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Opteron_G1</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Nehalem</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>IvyBridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Icelake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-Rome</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-Milan</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Dhyana</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cooperlake</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Conroe</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>486</model>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:   </cpu>
Nov 29 20:12:54 user nova-compute[75356]:   <memoryBacking supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:     <enum name='sourceType'>
Nov 29 20:12:54 user nova-compute[75356]:       <value>file</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>anonymous</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>memfd</value>
Nov 29 20:12:54 user nova-compute[75356]:     </enum>
Nov 29 20:12:54 user nova-compute[75356]:   </memoryBacking>
Nov 29 20:12:54 user nova-compute[75356]:   <devices>
Nov 29 20:12:54 user nova-compute[75356]:     <disk supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='diskDevice'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>disk</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>cdrom</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>floppy</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>lun</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='bus'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>ide</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>fdc</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>scsi</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>usb</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>sata</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-non-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </disk>
Nov 29 20:12:54 user nova-compute[75356]:     <graphics supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='type'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>sdl</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vnc</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>spice</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>egl-headless</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </graphics>
Nov 29 20:12:54 user nova-compute[75356]:     <video supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='modelType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vga</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>cirrus</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vmvga</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>qxl</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>none</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>bochs</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>ramfb</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </video>
Nov 29 20:12:54 user nova-compute[75356]:     <hostdev supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='mode'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>subsystem</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='startupPolicy'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>default</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>mandatory</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>requisite</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>optional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='subsysType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>usb</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>pci</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>scsi</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='capsType'/>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='pciBackend'/>
Nov 29 20:12:54 user nova-compute[75356]:     </hostdev>
Nov 29 20:12:54 user nova-compute[75356]:     <rng supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-non-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='backendModel'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>random</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>egd</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>builtin</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </rng>
Nov 29 20:12:54 user nova-compute[75356]:     <filesystem supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='driverType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>path</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>handle</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtiofs</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </filesystem>
Nov 29 20:12:54 user nova-compute[75356]:     <tpm supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>tpm-tis</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>tpm-crb</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='backendModel'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>passthrough</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>emulator</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </tpm>
Nov 29 20:12:54 user nova-compute[75356]:   </devices>
Nov 29 20:12:54 user nova-compute[75356]:   <features>
Nov 29 20:12:54 user nova-compute[75356]:     <gic supported='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     <vmcoreinfo supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <genid supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <backingStoreInput supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <backup supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <sev supported='no'/>
Nov 29 20:12:54 user nova-compute[75356]:   </features>
Nov 29 20:12:54 user nova-compute[75356]: </domainCapabilities>
Nov 29 20:12:54 user nova-compute[75356]:  {{(pid=75356) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 29 20:12:54 user nova-compute[75356]: <domainCapabilities>
Nov 29 20:12:54 user nova-compute[75356]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 20:12:54 user nova-compute[75356]:   <domain>kvm</domain>
Nov 29 20:12:54 user nova-compute[75356]:   <machine>pc-q35-jammy</machine>
Nov 29 20:12:54 user nova-compute[75356]:   <arch>x86_64</arch>
Nov 29 20:12:54 user nova-compute[75356]:   <vcpu max='288'/>
Nov 29 20:12:54 user nova-compute[75356]:   <iothreads supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:   <os supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:     <enum name='firmware'>
Nov 29 20:12:54 user nova-compute[75356]:       <value>efi</value>
Nov 29 20:12:54 user nova-compute[75356]:     </enum>
Nov 29 20:12:54 user nova-compute[75356]:     <loader supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='type'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>rom</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>pflash</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='readonly'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>yes</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>no</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='secure'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>yes</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>no</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </loader>
Nov 29 20:12:54 user nova-compute[75356]:   </os>
Nov 29 20:12:54 user nova-compute[75356]:   <cpu>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='host-passthrough' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='hostPassthroughMigratable'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>on</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>off</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='maximum' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='maximumMigratable'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>on</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>off</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='host-model' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <vendor>Intel</vendor>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ss'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='vmx'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='pcid'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='hypervisor'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='arat'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='umip'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='md-clear'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='stibp'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ssbd'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='invtsc'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ibpb'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ibrs'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='amd-stibp'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='rsba'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='disable' name='erms'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='custom' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>qemu64</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>qemu32</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>phenom</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium3</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium2</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>n270</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>kvm64</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>kvm32</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>coreduo</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>core2duo</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>athlon</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Westmere</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Snowridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>SandyBridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Penryn</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G5</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G4</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G3</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G2</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Opteron_G1</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Nehalem</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>IvyBridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Icelake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-Rome</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-Milan</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Dhyana</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cooperlake</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Conroe</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>486</model>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:   </cpu>
Nov 29 20:12:54 user nova-compute[75356]:   <memoryBacking supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:     <enum name='sourceType'>
Nov 29 20:12:54 user nova-compute[75356]:       <value>file</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>anonymous</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>memfd</value>
Nov 29 20:12:54 user nova-compute[75356]:     </enum>
Nov 29 20:12:54 user nova-compute[75356]:   </memoryBacking>
Nov 29 20:12:54 user nova-compute[75356]:   <devices>
Nov 29 20:12:54 user nova-compute[75356]:     <disk supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='diskDevice'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>disk</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>cdrom</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>floppy</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>lun</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='bus'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>fdc</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>scsi</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>usb</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>sata</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-non-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </disk>
Nov 29 20:12:54 user nova-compute[75356]:     <graphics supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='type'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>sdl</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vnc</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>spice</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>egl-headless</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </graphics>
Nov 29 20:12:54 user nova-compute[75356]:     <video supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='modelType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vga</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>cirrus</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vmvga</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>qxl</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>none</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>bochs</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>ramfb</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </video>
Nov 29 20:12:54 user nova-compute[75356]:     <hostdev supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='mode'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>subsystem</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='startupPolicy'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>default</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>mandatory</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>requisite</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>optional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='subsysType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>usb</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>pci</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>scsi</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='capsType'/>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='pciBackend'/>
Nov 29 20:12:54 user nova-compute[75356]:     </hostdev>
Nov 29 20:12:54 user nova-compute[75356]:     <rng supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-non-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='backendModel'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>random</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>egd</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>builtin</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </rng>
Nov 29 20:12:54 user nova-compute[75356]:     <filesystem supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='driverType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>path</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>handle</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtiofs</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </filesystem>
Nov 29 20:12:54 user nova-compute[75356]:     <tpm supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>tpm-tis</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>tpm-crb</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='backendModel'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>passthrough</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>emulator</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </tpm>
Nov 29 20:12:54 user nova-compute[75356]:   </devices>
Nov 29 20:12:54 user nova-compute[75356]:   <features>
Nov 29 20:12:54 user nova-compute[75356]:     <gic supported='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     <vmcoreinfo supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <genid supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <backingStoreInput supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <backup supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <sev supported='no'/>
Nov 29 20:12:54 user nova-compute[75356]:   </features>
Nov 29 20:12:54 user nova-compute[75356]: </domainCapabilities>
Nov 29 20:12:54 user nova-compute[75356]:  {{(pid=75356) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 29 20:12:54 user nova-compute[75356]: <domainCapabilities>
Nov 29 20:12:54 user nova-compute[75356]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 20:12:54 user nova-compute[75356]:   <domain>kvm</domain>
Nov 29 20:12:54 user nova-compute[75356]:   <machine>pc-i440fx-6.2</machine>
Nov 29 20:12:54 user nova-compute[75356]:   <arch>x86_64</arch>
Nov 29 20:12:54 user nova-compute[75356]:   <vcpu max='255'/>
Nov 29 20:12:54 user nova-compute[75356]:   <iothreads supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:   <os supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:     <enum name='firmware'>
Nov 29 20:12:54 user nova-compute[75356]:       <value>efi</value>
Nov 29 20:12:54 user nova-compute[75356]:     </enum>
Nov 29 20:12:54 user nova-compute[75356]:     <loader supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='type'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>rom</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>pflash</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='readonly'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>yes</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>no</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='secure'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>no</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </loader>
Nov 29 20:12:54 user nova-compute[75356]:   </os>
Nov 29 20:12:54 user nova-compute[75356]:   <cpu>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='host-passthrough' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='hostPassthroughMigratable'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>on</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>off</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='maximum' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='maximumMigratable'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>on</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>off</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='host-model' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <vendor>Intel</vendor>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ss'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='vmx'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='pcid'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='hypervisor'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='arat'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='umip'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='md-clear'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='stibp'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ssbd'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='invtsc'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ibpb'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='ibrs'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='amd-stibp'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='rsba'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='disable' name='erms'/>
Nov 29 20:12:54 user nova-compute[75356]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:     <mode name='custom' supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>qemu64</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>qemu32</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>phenom</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium3</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium2</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>pentium</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>n270</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>kvm64</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>kvm32</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>coreduo</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>core2duo</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>athlon</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Westmere</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Snowridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Skylake-Client</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>SandyBridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Penryn</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G5</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G4</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G3</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Opteron_G2</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Opteron_G1</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Nehalem</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>IvyBridge</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Icelake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Haswell</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-Rome</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-Milan</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>EPYC</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Dhyana</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cooperlake</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>Conroe</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='no'>Broadwell</model>
Nov 29 20:12:54 user nova-compute[75356]:       <model usable='yes'>486</model>
Nov 29 20:12:54 user nova-compute[75356]:     </mode>
Nov 29 20:12:54 user nova-compute[75356]:   </cpu>
Nov 29 20:12:54 user nova-compute[75356]:   <memoryBacking supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:     <enum name='sourceType'>
Nov 29 20:12:54 user nova-compute[75356]:       <value>file</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>anonymous</value>
Nov 29 20:12:54 user nova-compute[75356]:       <value>memfd</value>
Nov 29 20:12:54 user nova-compute[75356]:     </enum>
Nov 29 20:12:54 user nova-compute[75356]:   </memoryBacking>
Nov 29 20:12:54 user nova-compute[75356]:   <devices>
Nov 29 20:12:54 user nova-compute[75356]:     <disk supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='diskDevice'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>disk</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>cdrom</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>floppy</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>lun</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='bus'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>ide</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>fdc</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>scsi</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>usb</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>sata</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-non-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </disk>
Nov 29 20:12:54 user nova-compute[75356]:     <graphics supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='type'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>sdl</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vnc</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>spice</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>egl-headless</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </graphics>
Nov 29 20:12:54 user nova-compute[75356]:     <video supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='modelType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vga</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>cirrus</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>vmvga</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>qxl</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>none</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>bochs</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>ramfb</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </video>
Nov 29 20:12:54 user nova-compute[75356]:     <hostdev supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='mode'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>subsystem</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='startupPolicy'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>default</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>mandatory</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>requisite</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>optional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='subsysType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>usb</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>pci</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>scsi</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='capsType'/>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='pciBackend'/>
Nov 29 20:12:54 user nova-compute[75356]:     </hostdev>
Nov 29 20:12:54 user nova-compute[75356]:     <rng supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtio-non-transitional</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='backendModel'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>random</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>egd</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>builtin</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </rng>
Nov 29 20:12:54 user nova-compute[75356]:     <filesystem supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='driverType'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>path</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>handle</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>virtiofs</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </filesystem>
Nov 29 20:12:54 user nova-compute[75356]:     <tpm supported='yes'>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='model'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>tpm-tis</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>tpm-crb</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:       <enum name='backendModel'>
Nov 29 20:12:54 user nova-compute[75356]:         <value>passthrough</value>
Nov 29 20:12:54 user nova-compute[75356]:         <value>emulator</value>
Nov 29 20:12:54 user nova-compute[75356]:       </enum>
Nov 29 20:12:54 user nova-compute[75356]:     </tpm>
Nov 29 20:12:54 user nova-compute[75356]:   </devices>
Nov 29 20:12:54 user nova-compute[75356]:   <features>
Nov 29 20:12:54 user nova-compute[75356]:     <gic supported='no'/>
Nov 29 20:12:54 user nova-compute[75356]:     <vmcoreinfo supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <genid supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <backingStoreInput supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <backup supported='yes'/>
Nov 29 20:12:54 user nova-compute[75356]:     <sev supported='no'/>
Nov 29 20:12:54 user nova-compute[75356]:   </features>
Nov 29 20:12:54 user nova-compute[75356]: </domainCapabilities>
Nov 29 20:12:54 user nova-compute[75356]:  {{(pid=75356) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75356) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75356) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Checking secure boot support for host arch (x86_64) {{(pid=75356) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 20:12:54 user nova-compute[75356]: INFO nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Secure Boot support detected
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] cpu compare xml: <cpu match="exact">
Nov 29 20:12:54 user nova-compute[75356]:   <model>Nehalem</model>
Nov 29 20:12:54 user nova-compute[75356]: </cpu>
Nov 29 20:12:54 user nova-compute[75356]:  {{(pid=75356) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 29 20:12:54 user nova-compute[75356]: INFO nova.virt.node [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Generated node identity 5a24b660-3bbe-4ca7-ac25-69a2aeed184a
Nov 29 20:12:54 user nova-compute[75356]: INFO nova.virt.node [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Wrote node identity 5a24b660-3bbe-4ca7-ac25-69a2aeed184a to /opt/stack/data/nova/compute_id
Nov 29 20:12:54 user nova-compute[75356]: WARNING nova.compute.manager [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Compute nodes ['5a24b660-3bbe-4ca7-ac25-69a2aeed184a'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 29 20:12:54 user nova-compute[75356]: INFO nova.compute.manager [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 29 20:12:54 user nova-compute[75356]: WARNING nova.compute.manager [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 29 20:12:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:12:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:12:55 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:12:55 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:12:55 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Hypervisor/Node resource view: name=user free_ram=10983MB free_disk=26.106971740722656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:12:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:12:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:12:55 user nova-compute[75356]: WARNING nova.compute.resource_tracker [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] No compute node record for user:5a24b660-3bbe-4ca7-ac25-69a2aeed184a: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 5a24b660-3bbe-4ca7-ac25-69a2aeed184a could not be found.
Nov 29 20:12:55 user nova-compute[75356]: INFO nova.compute.resource_tracker [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Compute node record created for user:user with uuid: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a
Nov 29 20:12:55 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:12:55 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:12:55 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] [req-d87ed137-c82c-472c-8be0-e293b4c28d4c] Created resource provider record via placement API for resource provider with UUID 5a24b660-3bbe-4ca7-ac25-69a2aeed184a and name user.
Nov 29 20:12:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75356) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 29 20:12:55 user nova-compute[75356]: INFO nova.virt.libvirt.host [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] kernel doesn't support AMD SEV
Nov 29 20:12:55 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Updating inventory in ProviderTree for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 20:12:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:12:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Libvirt baseline CPU <cpu>
Nov 29 20:12:55 user nova-compute[75356]:   <arch>x86_64</arch>
Nov 29 20:12:55 user nova-compute[75356]:   <model>Nehalem</model>
Nov 29 20:12:55 user nova-compute[75356]:   <vendor>Intel</vendor>
Nov 29 20:12:55 user nova-compute[75356]:   <topology sockets="6" cores="1" threads="1"/>
Nov 29 20:12:55 user nova-compute[75356]: </cpu>
Nov 29 20:12:55 user nova-compute[75356]:  {{(pid=75356) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 29 20:12:55 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Updated inventory for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 29 20:12:55 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Updating resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a generation from 0 to 1 during operation: update_inventory {{(pid=75356) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 29 20:12:55 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Updating inventory in ProviderTree for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 20:12:55 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Updating resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a generation from 1 to 2 during operation: update_traits {{(pid=75356) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 29 20:12:55 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:12:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.649s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:12:55 user nova-compute[75356]: DEBUG nova.service [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Creating RPC server for service compute {{(pid=75356) start /opt/stack/nova/nova/service.py:182}}
Nov 29 20:12:55 user nova-compute[75356]: DEBUG nova.service [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] Join ServiceGroup membership for this service compute {{(pid=75356) start /opt/stack/nova/nova/service.py:199}}
Nov 29 20:12:55 user nova-compute[75356]: DEBUG nova.servicegroup.drivers.db [None req-0e9dc253-a5ec-43c2-8f36-eb5e850629c4 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75356) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 29 20:13:53 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:13:53 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:13:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:13:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 20:13:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Didn't find any instances for network info cache update. {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 20:13:53 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:13:53 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:13:53 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:13:53 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:13:53 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:13:53 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:13:53 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:13:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:13:53 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:13:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:13:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:13:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:13:53 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:13:54 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:13:54 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:13:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=10349MB free_disk=26.010604858398438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:13:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:13:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:13:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:13:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:13:54 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:13:54 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:13:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:13:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:13:54 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:14:46 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:14:46 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:14:46 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:14:46 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 20:14:46 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Didn't find any instances for network info cache update. {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 20:14:46 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:14:46 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:14:46 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:14:47 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:14:47 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:14:47 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:14:48 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:14:48 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:14:48 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:14:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:14:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:14:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:14:48 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:14:48 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:14:48 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:14:48 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=10379MB free_disk=26.075206756591797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:14:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:14:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:14:48 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:14:48 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:14:48 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:14:48 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:14:48 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:14:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:15:46 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:15:46 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:15:46 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:15:47 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:15:47 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:15:48 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:15:48 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:15:48 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:15:48 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 20:15:48 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Didn't find any instances for network info cache update. {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 20:15:48 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:15:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:15:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:15:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:15:48 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:15:48 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:15:48 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:15:48 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=10370MB free_disk=25.827415466308594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:15:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:15:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:15:48 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:15:48 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:15:48 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:15:48 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:15:48 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:15:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:15:49 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:15:49 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:16:47 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:16:47 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:16:47 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:16:48 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:16:48 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:16:48 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:16:49 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:16:49 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:16:49 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:16:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:16:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:16:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:16:49 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:16:49 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:16:49 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:16:49 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=9700MB free_disk=25.84832763671875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:16:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:16:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:16:49 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:16:49 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:16:49 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:16:49 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:16:49 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:16:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:16:50 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:16:50 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:16:50 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 20:16:50 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Didn't find any instances for network info cache update. {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 20:16:51 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:16:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Acquiring lock "8db40390-15ae-458b-92c9-7b3bb623ca50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:16:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "8db40390-15ae-458b-92c9-7b3bb623ca50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:16:57 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:16:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:16:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:16:57 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:16:57 user nova-compute[75356]: INFO nova.compute.claims [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Claim successful on node user
Nov 29 20:16:58 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:16:58 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:16:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:16:58 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:16:58 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:16:58 user nova-compute[75356]: DEBUG nova.network.neutron [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:16:58 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:16:58 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:16:58 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:16:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:16:58 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Creating image(s)
Nov 29 20:16:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Acquiring lock "/opt/stack/data/nova/instances/8db40390-15ae-458b-92c9-7b3bb623ca50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:16:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "/opt/stack/data/nova/instances/8db40390-15ae-458b-92c9-7b3bb623ca50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:16:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "/opt/stack/data/nova/instances/8db40390-15ae-458b-92c9-7b3bb623ca50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:16:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:16:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:16:58 user nova-compute[75356]: DEBUG nova.policy [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56b1575653a64d519496e59953e2abc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459348467eb445f2966cd9c21f69fc73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:16:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9.part --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:16:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:16:59 user nova-compute[75356]: DEBUG nova.virt.images [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] 6ec9e8df-1fe5-47a2-a649-880c9c3e5f36 was qcow2, converting to raw {{(pid=75356) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 20:16:59 user nova-compute[75356]: DEBUG nova.privsep.utils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75356) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 20:16:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9.part /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9.converted {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:16:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9.part /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9.converted" returned: 0 in 0.405s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:16:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9.converted --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.569s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:00 user nova-compute[75356]: INFO oslo.privsep.daemon [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpig85civf/privsep.sock']
Nov 29 20:17:00 user sudo[84602]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpig85civf/privsep.sock
Nov 29 20:17:00 user sudo[84602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 20:17:00 user nova-compute[75356]: DEBUG nova.network.neutron [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Successfully created port: 624866cb-b225-4a69-a62b-56d89ce17653 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:17:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Acquiring lock "9751c435-4d10-46dc-86e7-39d40e8209d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "9751c435-4d10-46dc-86e7-39d40e8209d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:01 user nova-compute[75356]: DEBUG nova.compute.manager [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:17:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:01 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:17:01 user nova-compute[75356]: INFO nova.compute.claims [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Claim successful on node user
Nov 29 20:17:01 user sudo[84602]: pam_unix(sudo:session): session closed for user root
Nov 29 20:17:01 user nova-compute[75356]: INFO oslo.privsep.daemon [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Spawned new privsep daemon via rootwrap
Nov 29 20:17:01 user nova-compute[75356]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 20:17:01 user nova-compute[75356]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 20:17:01 user nova-compute[75356]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 29 20:17:01 user nova-compute[75356]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84615
Nov 29 20:17:01 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:17:01 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:17:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:01 user nova-compute[75356]: DEBUG nova.compute.manager [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:17:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:01 user nova-compute[75356]: DEBUG nova.compute.manager [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:17:01 user nova-compute[75356]: DEBUG nova.network.neutron [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:17:01 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:17:01 user nova-compute[75356]: DEBUG nova.compute.manager [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.191s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG nova.compute.manager [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:17:02 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Creating image(s)
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Acquiring lock "/opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "/opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "/opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.178s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/8db40390-15ae-458b-92c9-7b3bb623ca50/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.155s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/8db40390-15ae-458b-92c9-7b3bb623ca50/disk 1073741824" returned: 0 in 0.047s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG nova.policy [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e7fb9cda998444b912de256b9efa7e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f191c68eb9041d289e04d64dc71ddb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.052s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.155s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8db40390-15ae-458b-92c9-7b3bb623ca50/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db40390-15ae-458b-92c9-7b3bb623ca50/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.229s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk 1073741824" returned: 0 in 0.043s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db40390-15ae-458b-92c9-7b3bb623ca50/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Cannot resize image /opt/stack/data/nova/instances/8db40390-15ae-458b-92c9-7b3bb623ca50/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Ensure instance console log exists: /opt/stack/data/nova/instances/8db40390-15ae-458b-92c9-7b3bb623ca50/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.151s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Cannot resize image /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Ensure instance console log exists: /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:03 user nova-compute[75356]: DEBUG nova.network.neutron [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Successfully updated port: 624866cb-b225-4a69-a62b-56d89ce17653 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:17:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Acquiring lock "refresh_cache-8db40390-15ae-458b-92c9-7b3bb623ca50" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:17:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Acquired lock "refresh_cache-8db40390-15ae-458b-92c9-7b3bb623ca50" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:17:03 user nova-compute[75356]: DEBUG nova.network.neutron [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:17:03 user nova-compute[75356]: DEBUG nova.network.neutron [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:17:03 user nova-compute[75356]: DEBUG nova.compute.manager [req-6fdff08e-281e-427d-90c4-ffd149c0d743 req-3a22347e-1599-4e0c-a44f-9e1d705e8753 service nova] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Received event network-changed-624866cb-b225-4a69-a62b-56d89ce17653 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:03 user nova-compute[75356]: DEBUG nova.compute.manager [req-6fdff08e-281e-427d-90c4-ffd149c0d743 req-3a22347e-1599-4e0c-a44f-9e1d705e8753 service nova] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Refreshing instance network info cache due to event network-changed-624866cb-b225-4a69-a62b-56d89ce17653. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:17:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6fdff08e-281e-427d-90c4-ffd149c0d743 req-3a22347e-1599-4e0c-a44f-9e1d705e8753 service nova] Acquiring lock "refresh_cache-8db40390-15ae-458b-92c9-7b3bb623ca50" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.network.neutron [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Updating instance_info_cache with network_info: [{"id": "624866cb-b225-4a69-a62b-56d89ce17653", "address": "fa:16:3e:4f:06:83", "network": {"id": "7965cbec-9ba2-4bf6-b812-d82f8ebcd64a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-125869777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459348467eb445f2966cd9c21f69fc73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624866cb-b2", "ovs_interfaceid": "624866cb-b225-4a69-a62b-56d89ce17653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "0b59517a-c467-432a-a73a-d1460c1574e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "0b59517a-c467-432a-a73a-d1460c1574e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Releasing lock "refresh_cache-8db40390-15ae-458b-92c9-7b3bb623ca50" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Instance network_info: |[{"id": "624866cb-b225-4a69-a62b-56d89ce17653", "address": "fa:16:3e:4f:06:83", "network": {"id": "7965cbec-9ba2-4bf6-b812-d82f8ebcd64a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-125869777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459348467eb445f2966cd9c21f69fc73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624866cb-b2", "ovs_interfaceid": "624866cb-b225-4a69-a62b-56d89ce17653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.compute.manager [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6fdff08e-281e-427d-90c4-ffd149c0d743 req-3a22347e-1599-4e0c-a44f-9e1d705e8753 service nova] Acquired lock "refresh_cache-8db40390-15ae-458b-92c9-7b3bb623ca50" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.network.neutron [req-6fdff08e-281e-427d-90c4-ffd149c0d743 req-3a22347e-1599-4e0c-a44f-9e1d705e8753 service nova] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Refreshing network info cache for port 624866cb-b225-4a69-a62b-56d89ce17653 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Start _get_guest_xml network_info=[{"id": "624866cb-b225-4a69-a62b-56d89ce17653", "address": "fa:16:3e:4f:06:83", "network": {"id": "7965cbec-9ba2-4bf6-b812-d82f8ebcd64a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-125869777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459348467eb445f2966cd9c21f69fc73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624866cb-b2", "ovs_interfaceid": "624866cb-b225-4a69-a62b-56d89ce17653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:17:04 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:04 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.privsep.utils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75356) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:16:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2092928798',display_name='tempest-DeleteServersTestJSON-server-2092928798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2092928798',id=1,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='459348467eb445f2966cd9c21f69fc73',ramdisk_id='',reservation_id='r-bdc9006k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-32256473',owner_user_name='tempest-DeleteServersTestJSON-32256473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:16:59Z,user_data=None,user_id='56b1575653a64d519496e59953e2abc4',uuid=8db40390-15ae-458b-92c9-7b3bb623ca50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "624866cb-b225-4a69-a62b-56d89ce17653", "address": "fa:16:3e:4f:06:83", "network": {"id": "7965cbec-9ba2-4bf6-b812-d82f8ebcd64a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-125869777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459348467eb445f2966cd9c21f69fc73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624866cb-b2", "ovs_interfaceid": "624866cb-b225-4a69-a62b-56d89ce17653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Converting VIF {"id": "624866cb-b225-4a69-a62b-56d89ce17653", "address": "fa:16:3e:4f:06:83", "network": {"id": "7965cbec-9ba2-4bf6-b812-d82f8ebcd64a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-125869777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459348467eb445f2966cd9c21f69fc73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624866cb-b2", "ovs_interfaceid": "624866cb-b225-4a69-a62b-56d89ce17653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:06:83,bridge_name='br-int',has_traffic_filtering=True,id=624866cb-b225-4a69-a62b-56d89ce17653,network=Network(7965cbec-9ba2-4bf6-b812-d82f8ebcd64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624866cb-b2') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.objects.instance [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lazy-loading 'pci_devices' on Instance uuid 8db40390-15ae-458b-92c9-7b3bb623ca50 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:17:04 user nova-compute[75356]:   <uuid>8db40390-15ae-458b-92c9-7b3bb623ca50</uuid>
Nov 29 20:17:04 user nova-compute[75356]:   <name>instance-00000001</name>
Nov 29 20:17:04 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:17:04 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:17:04 user nova-compute[75356]:   <metadata>
Nov 29 20:17:04 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:17:04 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:17:04 user nova-compute[75356]:       <nova:name>tempest-DeleteServersTestJSON-server-2092928798</nova:name>
Nov 29 20:17:04 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:17:04</nova:creationTime>
Nov 29 20:17:04 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:17:04 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:17:04 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:17:04 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:17:04 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:17:04 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:17:04 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:17:04 user nova-compute[75356]:       <nova:owner>
Nov 29 20:17:04 user nova-compute[75356]:         <nova:user uuid="56b1575653a64d519496e59953e2abc4">tempest-DeleteServersTestJSON-32256473-project-member</nova:user>
Nov 29 20:17:04 user nova-compute[75356]:         <nova:project uuid="459348467eb445f2966cd9c21f69fc73">tempest-DeleteServersTestJSON-32256473</nova:project>
Nov 29 20:17:04 user nova-compute[75356]:       </nova:owner>
Nov 29 20:17:04 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:17:04 user nova-compute[75356]:       <nova:ports>
Nov 29 20:17:04 user nova-compute[75356]:         <nova:port uuid="624866cb-b225-4a69-a62b-56d89ce17653">
Nov 29 20:17:04 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 20:17:04 user nova-compute[75356]:         </nova:port>
Nov 29 20:17:04 user nova-compute[75356]:       </nova:ports>
Nov 29 20:17:04 user nova-compute[75356]:     </nova:instance>
Nov 29 20:17:04 user nova-compute[75356]:   </metadata>
Nov 29 20:17:04 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:17:04 user nova-compute[75356]:     <system>
Nov 29 20:17:04 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:17:04 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:17:04 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:17:04 user nova-compute[75356]:       <entry name="serial">8db40390-15ae-458b-92c9-7b3bb623ca50</entry>
Nov 29 20:17:04 user nova-compute[75356]:       <entry name="uuid">8db40390-15ae-458b-92c9-7b3bb623ca50</entry>
Nov 29 20:17:04 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:17:04 user nova-compute[75356]:     </system>
Nov 29 20:17:04 user nova-compute[75356]:   </sysinfo>
Nov 29 20:17:04 user nova-compute[75356]:   <os>
Nov 29 20:17:04 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:17:04 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:17:04 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:17:04 user nova-compute[75356]:   </os>
Nov 29 20:17:04 user nova-compute[75356]:   <features>
Nov 29 20:17:04 user nova-compute[75356]:     <acpi/>
Nov 29 20:17:04 user nova-compute[75356]:     <apic/>
Nov 29 20:17:04 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:17:04 user nova-compute[75356]:   </features>
Nov 29 20:17:04 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:17:04 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:17:04 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:17:04 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:17:04 user nova-compute[75356]:   </clock>
Nov 29 20:17:04 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:17:04 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:17:04 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:17:04 user nova-compute[75356]:   </cpu>
Nov 29 20:17:04 user nova-compute[75356]:   <devices>
Nov 29 20:17:04 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:17:04 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:17:04 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/8db40390-15ae-458b-92c9-7b3bb623ca50/disk"/>
Nov 29 20:17:04 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:17:04 user nova-compute[75356]:     </disk>
Nov 29 20:17:04 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:17:04 user nova-compute[75356]:       <mac address="fa:16:3e:4f:06:83"/>
Nov 29 20:17:04 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:17:04 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:17:04 user nova-compute[75356]:       <target dev="tap624866cb-b2"/>
Nov 29 20:17:04 user nova-compute[75356]:     </interface>
Nov 29 20:17:04 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:17:04 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/8db40390-15ae-458b-92c9-7b3bb623ca50/console.log" append="off"/>
Nov 29 20:17:04 user nova-compute[75356]:     </serial>
Nov 29 20:17:04 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:17:04 user nova-compute[75356]:     <video>
Nov 29 20:17:04 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:17:04 user nova-compute[75356]:     </video>
Nov 29 20:17:04 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:17:04 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:17:04 user nova-compute[75356]:     </rng>
Nov 29 20:17:04 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:17:04 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:17:04 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:17:04 user nova-compute[75356]:     </memballoon>
Nov 29 20:17:04 user nova-compute[75356]:   </devices>
Nov 29 20:17:04 user nova-compute[75356]: </domain>
Nov 29 20:17:04 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:16:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2092928798',display_name='tempest-DeleteServersTestJSON-server-2092928798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2092928798',id=1,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='459348467eb445f2966cd9c21f69fc73',ramdisk_id='',reservation_id='r-bdc9006k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-32256473',owner_user_name='tempest-DeleteServersTestJSON-32256473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:16:59Z,user_data=None,user_id='56b1575653a64d519496e59953e2abc4',uuid=8db40390-15ae-458b-92c9-7b3bb623ca50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "624866cb-b225-4a69-a62b-56d89ce17653", "address": "fa:16:3e:4f:06:83", "network": {"id": "7965cbec-9ba2-4bf6-b812-d82f8ebcd64a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-125869777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459348467eb445f2966cd9c21f69fc73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624866cb-b2", "ovs_interfaceid": "624866cb-b225-4a69-a62b-56d89ce17653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Converting VIF {"id": "624866cb-b225-4a69-a62b-56d89ce17653", "address": "fa:16:3e:4f:06:83", "network": {"id": "7965cbec-9ba2-4bf6-b812-d82f8ebcd64a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-125869777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459348467eb445f2966cd9c21f69fc73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624866cb-b2", "ovs_interfaceid": "624866cb-b225-4a69-a62b-56d89ce17653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:06:83,bridge_name='br-int',has_traffic_filtering=True,id=624866cb-b225-4a69-a62b-56d89ce17653,network=Network(7965cbec-9ba2-4bf6-b812-d82f8ebcd64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624866cb-b2') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG os_vif [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:06:83,bridge_name='br-int',has_traffic_filtering=True,id=624866cb-b225-4a69-a62b-56d89ce17653,network=Network(7965cbec-9ba2-4bf6-b812-d82f8ebcd64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624866cb-b2') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Created schema index Interface.name {{(pid=75356) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Created schema index Port.name {{(pid=75356) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Created schema index Bridge.name {{(pid=75356) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [POLLOUT] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cfb2be15-be44-5ad5-b283-be934a33b257', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:17:04 user nova-compute[75356]: INFO nova.compute.claims [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Claim successful on node user
Nov 29 20:17:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:17:04 user nova-compute[75356]: INFO oslo.privsep.daemon [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp3v0kpikf/privsep.sock']
Nov 29 20:17:04 user sudo[84659]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp3v0kpikf/privsep.sock
Nov 29 20:17:04 user sudo[84659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 20:17:05 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:17:05 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:17:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:05 user nova-compute[75356]: DEBUG nova.compute.manager [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:17:05 user nova-compute[75356]: DEBUG nova.compute.manager [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:17:05 user nova-compute[75356]: DEBUG nova.network.neutron [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:17:05 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:17:05 user nova-compute[75356]: DEBUG nova.compute.manager [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:17:05 user nova-compute[75356]: DEBUG nova.policy [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abc7cfc71d0c448cbbe8d42f8b617d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b14efb1a4d34a3db7a51bd79234b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:17:05 user nova-compute[75356]: DEBUG nova.compute.manager [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:17:05 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:17:05 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Creating image(s)
Nov 29 20:17:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "/opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "/opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.199s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:05 user nova-compute[75356]: DEBUG nova.network.neutron [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Successfully created port: 21221e61-952e-4f3b-a212-dbb9cafe061d {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:17:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.183s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk 1073741824" returned: 0 in 0.045s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.168s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Cannot resize image /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Ensure instance console log exists: /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG nova.network.neutron [req-6fdff08e-281e-427d-90c4-ffd149c0d743 req-3a22347e-1599-4e0c-a44f-9e1d705e8753 service nova] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Updated VIF entry in instance network info cache for port 624866cb-b225-4a69-a62b-56d89ce17653. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG nova.network.neutron [req-6fdff08e-281e-427d-90c4-ffd149c0d743 req-3a22347e-1599-4e0c-a44f-9e1d705e8753 service nova] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Updating instance_info_cache with network_info: [{"id": "624866cb-b225-4a69-a62b-56d89ce17653", "address": "fa:16:3e:4f:06:83", "network": {"id": "7965cbec-9ba2-4bf6-b812-d82f8ebcd64a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-125869777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459348467eb445f2966cd9c21f69fc73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624866cb-b2", "ovs_interfaceid": "624866cb-b225-4a69-a62b-56d89ce17653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6fdff08e-281e-427d-90c4-ffd149c0d743 req-3a22347e-1599-4e0c-a44f-9e1d705e8753 service nova] Releasing lock "refresh_cache-8db40390-15ae-458b-92c9-7b3bb623ca50" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:17:06 user sudo[84659]: pam_unix(sudo:session): session closed for user root
Nov 29 20:17:06 user nova-compute[75356]: INFO oslo.privsep.daemon [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Spawned new privsep daemon via rootwrap
Nov 29 20:17:06 user nova-compute[75356]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 20:17:06 user nova-compute[75356]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 20:17:06 user nova-compute[75356]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 29 20:17:06 user nova-compute[75356]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84676
Nov 29 20:17:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquiring lock "28f5dcc3-db77-4c65-87af-e300f99d2be5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG nova.compute.manager [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:17:06 user nova-compute[75356]: INFO nova.compute.claims [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Claim successful on node user
Nov 29 20:17:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap624866cb-b2, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap624866cb-b2, col_values=(('qos', UUID('865f7a78-d458-4f31-b650-c93e6cdf4c1e')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap624866cb-b2, col_values=(('external_ids', {'iface-id': '624866cb-b225-4a69-a62b-56d89ce17653', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:06:83', 'vm-uuid': '8db40390-15ae-458b-92c9-7b3bb623ca50'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:06 user nova-compute[75356]: INFO os_vif [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:06:83,bridge_name='br-int',has_traffic_filtering=True,id=624866cb-b225-4a69-a62b-56d89ce17653,network=Network(7965cbec-9ba2-4bf6-b812-d82f8ebcd64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624866cb-b2')
Nov 29 20:17:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] No VIF found with MAC fa:16:3e:4f:06:83, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.588s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG nova.compute.manager [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.369s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:17:07 user nova-compute[75356]: INFO nova.compute.claims [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Claim successful on node user
Nov 29 20:17:07 user nova-compute[75356]: DEBUG nova.compute.manager [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG nova.network.neutron [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:17:07 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:17:07 user nova-compute[75356]: DEBUG nova.compute.manager [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG nova.compute.manager [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:17:07 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Creating image(s)
Nov 29 20:17:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquiring lock "/opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "/opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "/opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG nova.policy [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd40c898d11b440ca45ab29e8e6c7721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45448e5cb4e84c14b1114846a6ccbdce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.214s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:17:07 user nova-compute[75356]: DEBUG nova.network.neutron [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:17:07 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:17:07 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.201s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:17:08 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Creating image(s)
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "/opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "/opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "/opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG nova.policy [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e5a895cde3741d0a48cb06922ad80f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19fa4a7548454fc4a29a625b0c819c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk 1073741824" returned: 0 in 0.089s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.172s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.214s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.207s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk 1073741824" returned: 0 in 0.046s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Cannot resize image /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Ensure instance console log exists: /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.173s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG nova.network.neutron [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Successfully created port: 56a80963-a1f2-429e-8474-1795928fd05c {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Cannot resize image /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Ensure instance console log exists: /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:09 user nova-compute[75356]: DEBUG nova.network.neutron [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Successfully updated port: 21221e61-952e-4f3b-a212-dbb9cafe061d {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:17:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Acquiring lock "refresh_cache-9751c435-4d10-46dc-86e7-39d40e8209d3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:17:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Acquired lock "refresh_cache-9751c435-4d10-46dc-86e7-39d40e8209d3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:17:09 user nova-compute[75356]: DEBUG nova.network.neutron [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:17:09 user nova-compute[75356]: DEBUG nova.network.neutron [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:17:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:09 user nova-compute[75356]: DEBUG nova.compute.manager [req-6d0e2d05-d055-4b2d-8c44-e818f62f1ada req-fb2df573-e095-4bc5-ad28-b1f03d3a656f service nova] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Received event network-changed-21221e61-952e-4f3b-a212-dbb9cafe061d {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:09 user nova-compute[75356]: DEBUG nova.compute.manager [req-6d0e2d05-d055-4b2d-8c44-e818f62f1ada req-fb2df573-e095-4bc5-ad28-b1f03d3a656f service nova] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Refreshing instance network info cache due to event network-changed-21221e61-952e-4f3b-a212-dbb9cafe061d. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:17:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6d0e2d05-d055-4b2d-8c44-e818f62f1ada req-fb2df573-e095-4bc5-ad28-b1f03d3a656f service nova] Acquiring lock "refresh_cache-9751c435-4d10-46dc-86e7-39d40e8209d3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:17:09 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:17:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:17:09 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Instance spawned successfully.
Nov 29 20:17:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:17:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:10 user nova-compute[75356]: INFO nova.compute.manager [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Took 11.38 seconds to spawn the instance on the hypervisor.
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:17:10 user nova-compute[75356]: INFO nova.compute.manager [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Took 12.22 seconds to build instance.
Nov 29 20:17:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8aa2bdba-8d5e-41bd-9c77-aa28bcbaf56d tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "8db40390-15ae-458b-92c9-7b3bb623ca50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.432s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.network.neutron [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Successfully created port: d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.network.neutron [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Updating instance_info_cache with network_info: [{"id": "21221e61-952e-4f3b-a212-dbb9cafe061d", "address": "fa:16:3e:c1:72:a4", "network": {"id": "ee89a769-4a94-475b-b835-e49cabad1f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407371162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f191c68eb9041d289e04d64dc71ddb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21221e61-95", "ovs_interfaceid": "21221e61-952e-4f3b-a212-dbb9cafe061d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Releasing lock "refresh_cache-9751c435-4d10-46dc-86e7-39d40e8209d3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.compute.manager [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Instance network_info: |[{"id": "21221e61-952e-4f3b-a212-dbb9cafe061d", "address": "fa:16:3e:c1:72:a4", "network": {"id": "ee89a769-4a94-475b-b835-e49cabad1f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407371162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f191c68eb9041d289e04d64dc71ddb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21221e61-95", "ovs_interfaceid": "21221e61-952e-4f3b-a212-dbb9cafe061d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6d0e2d05-d055-4b2d-8c44-e818f62f1ada req-fb2df573-e095-4bc5-ad28-b1f03d3a656f service nova] Acquired lock "refresh_cache-9751c435-4d10-46dc-86e7-39d40e8209d3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.network.neutron [req-6d0e2d05-d055-4b2d-8c44-e818f62f1ada req-fb2df573-e095-4bc5-ad28-b1f03d3a656f service nova] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Refreshing network info cache for port 21221e61-952e-4f3b-a212-dbb9cafe061d {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Start _get_guest_xml network_info=[{"id": "21221e61-952e-4f3b-a212-dbb9cafe061d", "address": "fa:16:3e:c1:72:a4", "network": {"id": "ee89a769-4a94-475b-b835-e49cabad1f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407371162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f191c68eb9041d289e04d64dc71ddb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21221e61-95", "ovs_interfaceid": "21221e61-952e-4f3b-a212-dbb9cafe061d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:17:10 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:10 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-554016873',display_name='tempest-ServersNegativeTestJSON-server-554016873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-554016873',id=2,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f191c68eb9041d289e04d64dc71ddb8',ramdisk_id='',reservation_id='r-shjuj9zn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-851047228',owner_user_name='tempest-ServersNegativeTestJSON-851047228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:17:02Z,user_data=None,user_id='9e7fb9cda998444b912de256b9efa7e8',uuid=9751c435-4d10-46dc-86e7-39d40e8209d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21221e61-952e-4f3b-a212-dbb9cafe061d", "address": "fa:16:3e:c1:72:a4", "network": {"id": "ee89a769-4a94-475b-b835-e49cabad1f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407371162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f191c68eb9041d289e04d64dc71ddb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21221e61-95", "ovs_interfaceid": "21221e61-952e-4f3b-a212-dbb9cafe061d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Converting VIF {"id": "21221e61-952e-4f3b-a212-dbb9cafe061d", "address": "fa:16:3e:c1:72:a4", "network": {"id": "ee89a769-4a94-475b-b835-e49cabad1f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407371162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f191c68eb9041d289e04d64dc71ddb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21221e61-95", "ovs_interfaceid": "21221e61-952e-4f3b-a212-dbb9cafe061d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:72:a4,bridge_name='br-int',has_traffic_filtering=True,id=21221e61-952e-4f3b-a212-dbb9cafe061d,network=Network(ee89a769-4a94-475b-b835-e49cabad1f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21221e61-95') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.objects.instance [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lazy-loading 'pci_devices' on Instance uuid 9751c435-4d10-46dc-86e7-39d40e8209d3 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:17:10 user nova-compute[75356]:   <uuid>9751c435-4d10-46dc-86e7-39d40e8209d3</uuid>
Nov 29 20:17:10 user nova-compute[75356]:   <name>instance-00000002</name>
Nov 29 20:17:10 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:17:10 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:17:10 user nova-compute[75356]:   <metadata>
Nov 29 20:17:10 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:17:10 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:17:10 user nova-compute[75356]:       <nova:name>tempest-ServersNegativeTestJSON-server-554016873</nova:name>
Nov 29 20:17:10 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:17:10</nova:creationTime>
Nov 29 20:17:10 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:17:10 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:17:10 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:17:10 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:17:10 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:17:10 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:17:10 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:17:10 user nova-compute[75356]:       <nova:owner>
Nov 29 20:17:10 user nova-compute[75356]:         <nova:user uuid="9e7fb9cda998444b912de256b9efa7e8">tempest-ServersNegativeTestJSON-851047228-project-member</nova:user>
Nov 29 20:17:10 user nova-compute[75356]:         <nova:project uuid="5f191c68eb9041d289e04d64dc71ddb8">tempest-ServersNegativeTestJSON-851047228</nova:project>
Nov 29 20:17:10 user nova-compute[75356]:       </nova:owner>
Nov 29 20:17:10 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:17:10 user nova-compute[75356]:       <nova:ports>
Nov 29 20:17:10 user nova-compute[75356]:         <nova:port uuid="21221e61-952e-4f3b-a212-dbb9cafe061d">
Nov 29 20:17:10 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 20:17:10 user nova-compute[75356]:         </nova:port>
Nov 29 20:17:10 user nova-compute[75356]:       </nova:ports>
Nov 29 20:17:10 user nova-compute[75356]:     </nova:instance>
Nov 29 20:17:10 user nova-compute[75356]:   </metadata>
Nov 29 20:17:10 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:17:10 user nova-compute[75356]:     <system>
Nov 29 20:17:10 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:17:10 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:17:10 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:17:10 user nova-compute[75356]:       <entry name="serial">9751c435-4d10-46dc-86e7-39d40e8209d3</entry>
Nov 29 20:17:10 user nova-compute[75356]:       <entry name="uuid">9751c435-4d10-46dc-86e7-39d40e8209d3</entry>
Nov 29 20:17:10 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:17:10 user nova-compute[75356]:     </system>
Nov 29 20:17:10 user nova-compute[75356]:   </sysinfo>
Nov 29 20:17:10 user nova-compute[75356]:   <os>
Nov 29 20:17:10 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:17:10 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:17:10 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:17:10 user nova-compute[75356]:   </os>
Nov 29 20:17:10 user nova-compute[75356]:   <features>
Nov 29 20:17:10 user nova-compute[75356]:     <acpi/>
Nov 29 20:17:10 user nova-compute[75356]:     <apic/>
Nov 29 20:17:10 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:17:10 user nova-compute[75356]:   </features>
Nov 29 20:17:10 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:17:10 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:17:10 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:17:10 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:17:10 user nova-compute[75356]:   </clock>
Nov 29 20:17:10 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:17:10 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:17:10 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:17:10 user nova-compute[75356]:   </cpu>
Nov 29 20:17:10 user nova-compute[75356]:   <devices>
Nov 29 20:17:10 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:17:10 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:17:10 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk"/>
Nov 29 20:17:10 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:17:10 user nova-compute[75356]:     </disk>
Nov 29 20:17:10 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:17:10 user nova-compute[75356]:       <mac address="fa:16:3e:c1:72:a4"/>
Nov 29 20:17:10 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:17:10 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:17:10 user nova-compute[75356]:       <target dev="tap21221e61-95"/>
Nov 29 20:17:10 user nova-compute[75356]:     </interface>
Nov 29 20:17:10 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:17:10 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/console.log" append="off"/>
Nov 29 20:17:10 user nova-compute[75356]:     </serial>
Nov 29 20:17:10 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:17:10 user nova-compute[75356]:     <video>
Nov 29 20:17:10 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:17:10 user nova-compute[75356]:     </video>
Nov 29 20:17:10 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:17:10 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:17:10 user nova-compute[75356]:     </rng>
Nov 29 20:17:10 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:17:10 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:17:10 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:17:10 user nova-compute[75356]:     </memballoon>
Nov 29 20:17:10 user nova-compute[75356]:   </devices>
Nov 29 20:17:10 user nova-compute[75356]: </domain>
Nov 29 20:17:10 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-554016873',display_name='tempest-ServersNegativeTestJSON-server-554016873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-554016873',id=2,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f191c68eb9041d289e04d64dc71ddb8',ramdisk_id='',reservation_id='r-shjuj9zn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-851047228',owner_user_name='tempest-ServersNegativeTestJSON-851047228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:17:02Z,user_data=None,user_id='9e7fb9cda998444b912de256b9efa7e8',uuid=9751c435-4d10-46dc-86e7-39d40e8209d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21221e61-952e-4f3b-a212-dbb9cafe061d", "address": "fa:16:3e:c1:72:a4", "network": {"id": "ee89a769-4a94-475b-b835-e49cabad1f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407371162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f191c68eb9041d289e04d64dc71ddb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21221e61-95", "ovs_interfaceid": "21221e61-952e-4f3b-a212-dbb9cafe061d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Converting VIF {"id": "21221e61-952e-4f3b-a212-dbb9cafe061d", "address": "fa:16:3e:c1:72:a4", "network": {"id": "ee89a769-4a94-475b-b835-e49cabad1f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407371162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f191c68eb9041d289e04d64dc71ddb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21221e61-95", "ovs_interfaceid": "21221e61-952e-4f3b-a212-dbb9cafe061d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:72:a4,bridge_name='br-int',has_traffic_filtering=True,id=21221e61-952e-4f3b-a212-dbb9cafe061d,network=Network(ee89a769-4a94-475b-b835-e49cabad1f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21221e61-95') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG os_vif [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:72:a4,bridge_name='br-int',has_traffic_filtering=True,id=21221e61-952e-4f3b-a212-dbb9cafe061d,network=Network(ee89a769-4a94-475b-b835-e49cabad1f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21221e61-95') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e11fbf23-23f5-58b9-b6a9-fed1a05856b5', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21221e61-95, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21221e61-95, col_values=(('qos', UUID('236c2265-4d01-4bdb-b72b-0498251e89e3')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21221e61-95, col_values=(('external_ids', {'iface-id': '21221e61-952e-4f3b-a212-dbb9cafe061d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:72:a4', 'vm-uuid': '9751c435-4d10-46dc-86e7-39d40e8209d3'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:10 user nova-compute[75356]: INFO os_vif [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:72:a4,bridge_name='br-int',has_traffic_filtering=True,id=21221e61-952e-4f3b-a212-dbb9cafe061d,network=Network(ee89a769-4a94-475b-b835-e49cabad1f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21221e61-95')
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:17:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] No VIF found with MAC fa:16:3e:c1:72:a4, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:17:11 user nova-compute[75356]: DEBUG nova.network.neutron [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Successfully created port: bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:17:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:11 user nova-compute[75356]: DEBUG nova.network.neutron [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Successfully updated port: 56a80963-a1f2-429e-8474-1795928fd05c {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:17:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "refresh_cache-0b59517a-c467-432a-a73a-d1460c1574e7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:17:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquired lock "refresh_cache-0b59517a-c467-432a-a73a-d1460c1574e7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:17:11 user nova-compute[75356]: DEBUG nova.network.neutron [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.compute.manager [req-ff9fcb45-3d08-4728-8599-6e7f09996f30 req-ba715573-103f-4443-931b-61e0adc32873 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Received event network-changed-56a80963-a1f2-429e-8474-1795928fd05c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.compute.manager [req-ff9fcb45-3d08-4728-8599-6e7f09996f30 req-ba715573-103f-4443-931b-61e0adc32873 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Refreshing instance network info cache due to event network-changed-56a80963-a1f2-429e-8474-1795928fd05c. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ff9fcb45-3d08-4728-8599-6e7f09996f30 req-ba715573-103f-4443-931b-61e0adc32873 service nova] Acquiring lock "refresh_cache-0b59517a-c467-432a-a73a-d1460c1574e7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.network.neutron [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.network.neutron [req-6d0e2d05-d055-4b2d-8c44-e818f62f1ada req-fb2df573-e095-4bc5-ad28-b1f03d3a656f service nova] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Updated VIF entry in instance network info cache for port 21221e61-952e-4f3b-a212-dbb9cafe061d. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.network.neutron [req-6d0e2d05-d055-4b2d-8c44-e818f62f1ada req-fb2df573-e095-4bc5-ad28-b1f03d3a656f service nova] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Updating instance_info_cache with network_info: [{"id": "21221e61-952e-4f3b-a212-dbb9cafe061d", "address": "fa:16:3e:c1:72:a4", "network": {"id": "ee89a769-4a94-475b-b835-e49cabad1f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407371162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f191c68eb9041d289e04d64dc71ddb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21221e61-95", "ovs_interfaceid": "21221e61-952e-4f3b-a212-dbb9cafe061d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6d0e2d05-d055-4b2d-8c44-e818f62f1ada req-fb2df573-e095-4bc5-ad28-b1f03d3a656f service nova] Releasing lock "refresh_cache-9751c435-4d10-46dc-86e7-39d40e8209d3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.network.neutron [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Updating instance_info_cache with network_info: [{"id": "56a80963-a1f2-429e-8474-1795928fd05c", "address": "fa:16:3e:74:bd:99", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a80963-a1", "ovs_interfaceid": "56a80963-a1f2-429e-8474-1795928fd05c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Releasing lock "refresh_cache-0b59517a-c467-432a-a73a-d1460c1574e7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.compute.manager [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Instance network_info: |[{"id": "56a80963-a1f2-429e-8474-1795928fd05c", "address": "fa:16:3e:74:bd:99", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a80963-a1", "ovs_interfaceid": "56a80963-a1f2-429e-8474-1795928fd05c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ff9fcb45-3d08-4728-8599-6e7f09996f30 req-ba715573-103f-4443-931b-61e0adc32873 service nova] Acquired lock "refresh_cache-0b59517a-c467-432a-a73a-d1460c1574e7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.network.neutron [req-ff9fcb45-3d08-4728-8599-6e7f09996f30 req-ba715573-103f-4443-931b-61e0adc32873 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Refreshing network info cache for port 56a80963-a1f2-429e-8474-1795928fd05c {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Start _get_guest_xml network_info=[{"id": "56a80963-a1f2-429e-8474-1795928fd05c", "address": "fa:16:3e:74:bd:99", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a80963-a1", "ovs_interfaceid": "56a80963-a1f2-429e-8474-1795928fd05c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:17:12 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:12 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1928552552',display_name='tempest-ServerActionsTestOtherA-server-1928552552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1928552552',id=3,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBES/hmUhRPMEp7jxGNAJkTADe+ykaGX7onK5o5CXk4BGHWdyPerc54MOJxjy4wx3hHylMSlWH2Wjk+mHShNqdbk6ZSJg34jMi+lLZfOCW4j+M+c+q1Lzq5VJUbAeMltLBQ==',key_name='tempest-keypair-777625238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b14efb1a4d34a3db7a51bd79234b86b',ramdisk_id='',reservation_id='r-t5ejtk9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1000495362',owner_user_name='tempest-ServerActionsTestOtherA-1000495362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:17:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc7cfc71d0c448cbbe8d42f8b617d8b',uuid=0b59517a-c467-432a-a73a-d1460c1574e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56a80963-a1f2-429e-8474-1795928fd05c", "address": "fa:16:3e:74:bd:99", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a80963-a1", "ovs_interfaceid": "56a80963-a1f2-429e-8474-1795928fd05c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converting VIF {"id": "56a80963-a1f2-429e-8474-1795928fd05c", "address": "fa:16:3e:74:bd:99", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a80963-a1", "ovs_interfaceid": "56a80963-a1f2-429e-8474-1795928fd05c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:bd:99,bridge_name='br-int',has_traffic_filtering=True,id=56a80963-a1f2-429e-8474-1795928fd05c,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56a80963-a1') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.objects.instance [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b59517a-c467-432a-a73a-d1460c1574e7 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:17:12 user nova-compute[75356]:   <uuid>0b59517a-c467-432a-a73a-d1460c1574e7</uuid>
Nov 29 20:17:12 user nova-compute[75356]:   <name>instance-00000003</name>
Nov 29 20:17:12 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:17:12 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:17:12 user nova-compute[75356]:   <metadata>
Nov 29 20:17:12 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:17:12 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:17:12 user nova-compute[75356]:       <nova:name>tempest-ServerActionsTestOtherA-server-1928552552</nova:name>
Nov 29 20:17:12 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:17:12</nova:creationTime>
Nov 29 20:17:12 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:17:12 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:17:12 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:17:12 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:17:12 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:17:12 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:17:12 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:17:12 user nova-compute[75356]:       <nova:owner>
Nov 29 20:17:12 user nova-compute[75356]:         <nova:user uuid="abc7cfc71d0c448cbbe8d42f8b617d8b">tempest-ServerActionsTestOtherA-1000495362-project-member</nova:user>
Nov 29 20:17:12 user nova-compute[75356]:         <nova:project uuid="8b14efb1a4d34a3db7a51bd79234b86b">tempest-ServerActionsTestOtherA-1000495362</nova:project>
Nov 29 20:17:12 user nova-compute[75356]:       </nova:owner>
Nov 29 20:17:12 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:17:12 user nova-compute[75356]:       <nova:ports>
Nov 29 20:17:12 user nova-compute[75356]:         <nova:port uuid="56a80963-a1f2-429e-8474-1795928fd05c">
Nov 29 20:17:12 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 20:17:12 user nova-compute[75356]:         </nova:port>
Nov 29 20:17:12 user nova-compute[75356]:       </nova:ports>
Nov 29 20:17:12 user nova-compute[75356]:     </nova:instance>
Nov 29 20:17:12 user nova-compute[75356]:   </metadata>
Nov 29 20:17:12 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:17:12 user nova-compute[75356]:     <system>
Nov 29 20:17:12 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:17:12 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:17:12 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:17:12 user nova-compute[75356]:       <entry name="serial">0b59517a-c467-432a-a73a-d1460c1574e7</entry>
Nov 29 20:17:12 user nova-compute[75356]:       <entry name="uuid">0b59517a-c467-432a-a73a-d1460c1574e7</entry>
Nov 29 20:17:12 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:17:12 user nova-compute[75356]:     </system>
Nov 29 20:17:12 user nova-compute[75356]:   </sysinfo>
Nov 29 20:17:12 user nova-compute[75356]:   <os>
Nov 29 20:17:12 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:17:12 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:17:12 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:17:12 user nova-compute[75356]:   </os>
Nov 29 20:17:12 user nova-compute[75356]:   <features>
Nov 29 20:17:12 user nova-compute[75356]:     <acpi/>
Nov 29 20:17:12 user nova-compute[75356]:     <apic/>
Nov 29 20:17:12 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:17:12 user nova-compute[75356]:   </features>
Nov 29 20:17:12 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:17:12 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:17:12 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:17:12 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:17:12 user nova-compute[75356]:   </clock>
Nov 29 20:17:12 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:17:12 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:17:12 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:17:12 user nova-compute[75356]:   </cpu>
Nov 29 20:17:12 user nova-compute[75356]:   <devices>
Nov 29 20:17:12 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:17:12 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:17:12 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk"/>
Nov 29 20:17:12 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:17:12 user nova-compute[75356]:     </disk>
Nov 29 20:17:12 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:17:12 user nova-compute[75356]:       <mac address="fa:16:3e:74:bd:99"/>
Nov 29 20:17:12 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:17:12 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:17:12 user nova-compute[75356]:       <target dev="tap56a80963-a1"/>
Nov 29 20:17:12 user nova-compute[75356]:     </interface>
Nov 29 20:17:12 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:17:12 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/console.log" append="off"/>
Nov 29 20:17:12 user nova-compute[75356]:     </serial>
Nov 29 20:17:12 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:17:12 user nova-compute[75356]:     <video>
Nov 29 20:17:12 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:17:12 user nova-compute[75356]:     </video>
Nov 29 20:17:12 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:17:12 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:17:12 user nova-compute[75356]:     </rng>
Nov 29 20:17:12 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:17:12 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:17:12 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:17:12 user nova-compute[75356]:     </memballoon>
Nov 29 20:17:12 user nova-compute[75356]:   </devices>
Nov 29 20:17:12 user nova-compute[75356]: </domain>
Nov 29 20:17:12 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1928552552',display_name='tempest-ServerActionsTestOtherA-server-1928552552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1928552552',id=3,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBES/hmUhRPMEp7jxGNAJkTADe+ykaGX7onK5o5CXk4BGHWdyPerc54MOJxjy4wx3hHylMSlWH2Wjk+mHShNqdbk6ZSJg34jMi+lLZfOCW4j+M+c+q1Lzq5VJUbAeMltLBQ==',key_name='tempest-keypair-777625238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b14efb1a4d34a3db7a51bd79234b86b',ramdisk_id='',reservation_id='r-t5ejtk9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1000495362',owner_user_name='tempest-ServerActionsTestOtherA-1000495362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:17:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc7cfc71d0c448cbbe8d42f8b617d8b',uuid=0b59517a-c467-432a-a73a-d1460c1574e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56a80963-a1f2-429e-8474-1795928fd05c", "address": "fa:16:3e:74:bd:99", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a80963-a1", "ovs_interfaceid": "56a80963-a1f2-429e-8474-1795928fd05c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converting VIF {"id": "56a80963-a1f2-429e-8474-1795928fd05c", "address": "fa:16:3e:74:bd:99", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a80963-a1", "ovs_interfaceid": "56a80963-a1f2-429e-8474-1795928fd05c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:bd:99,bridge_name='br-int',has_traffic_filtering=True,id=56a80963-a1f2-429e-8474-1795928fd05c,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56a80963-a1') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG os_vif [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:bd:99,bridge_name='br-int',has_traffic_filtering=True,id=56a80963-a1f2-429e-8474-1795928fd05c,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56a80963-a1') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9312a0d-74d8-5426-8240-cbed0acca698', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56a80963-a1, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56a80963-a1, col_values=(('qos', UUID('c6b97130-92d7-41a0-80d1-e76187789bdb')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56a80963-a1, col_values=(('external_ids', {'iface-id': '56a80963-a1f2-429e-8474-1795928fd05c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:bd:99', 'vm-uuid': '0b59517a-c467-432a-a73a-d1460c1574e7'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG nova.network.neutron [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Successfully updated port: d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:17:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:12 user nova-compute[75356]: INFO os_vif [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:bd:99,bridge_name='br-int',has_traffic_filtering=True,id=56a80963-a1f2-429e-8474-1795928fd05c,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56a80963-a1')
Nov 29 20:17:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquiring lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:17:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquired lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:17:13 user nova-compute[75356]: DEBUG nova.network.neutron [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:17:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:17:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] No VIF found with MAC fa:16:3e:74:bd:99, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:17:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-1a973f1f-cc14-4d91-937b-ad2dc48c4e91 req-9d396e3c-1481-47c7-a017-6cd1b86b66a9 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received event network-changed-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-1a973f1f-cc14-4d91-937b-ad2dc48c4e91 req-9d396e3c-1481-47c7-a017-6cd1b86b66a9 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Refreshing instance network info cache due to event network-changed-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:17:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1a973f1f-cc14-4d91-937b-ad2dc48c4e91 req-9d396e3c-1481-47c7-a017-6cd1b86b66a9 service nova] Acquiring lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:17:13 user nova-compute[75356]: DEBUG nova.network.neutron [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:17:13 user nova-compute[75356]: DEBUG nova.network.neutron [req-ff9fcb45-3d08-4728-8599-6e7f09996f30 req-ba715573-103f-4443-931b-61e0adc32873 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Updated VIF entry in instance network info cache for port 56a80963-a1f2-429e-8474-1795928fd05c. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:17:13 user nova-compute[75356]: DEBUG nova.network.neutron [req-ff9fcb45-3d08-4728-8599-6e7f09996f30 req-ba715573-103f-4443-931b-61e0adc32873 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Updating instance_info_cache with network_info: [{"id": "56a80963-a1f2-429e-8474-1795928fd05c", "address": "fa:16:3e:74:bd:99", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a80963-a1", "ovs_interfaceid": "56a80963-a1f2-429e-8474-1795928fd05c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:17:13 user nova-compute[75356]: DEBUG nova.network.neutron [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Successfully updated port: bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:17:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ff9fcb45-3d08-4728-8599-6e7f09996f30 req-ba715573-103f-4443-931b-61e0adc32873 service nova] Releasing lock "refresh_cache-0b59517a-c467-432a-a73a-d1460c1574e7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:17:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:17:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquired lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:17:13 user nova-compute[75356]: DEBUG nova.network.neutron [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.network.neutron [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Updating instance_info_cache with network_info: [{"id": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "address": "fa:16:3e:6b:b2:4e", "network": {"id": "27a8d395-36c8-4f27-89cf-f5019ccbf9a2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45448e5cb4e84c14b1114846a6ccbdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ec4756-3f", "ovs_interfaceid": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Releasing lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Instance network_info: |[{"id": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "address": "fa:16:3e:6b:b2:4e", "network": {"id": "27a8d395-36c8-4f27-89cf-f5019ccbf9a2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45448e5cb4e84c14b1114846a6ccbdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ec4756-3f", "ovs_interfaceid": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1a973f1f-cc14-4d91-937b-ad2dc48c4e91 req-9d396e3c-1481-47c7-a017-6cd1b86b66a9 service nova] Acquired lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.network.neutron [req-1a973f1f-cc14-4d91-937b-ad2dc48c4e91 req-9d396e3c-1481-47c7-a017-6cd1b86b66a9 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Refreshing network info cache for port d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Start _get_guest_xml network_info=[{"id": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "address": "fa:16:3e:6b:b2:4e", "network": {"id": "27a8d395-36c8-4f27-89cf-f5019ccbf9a2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45448e5cb4e84c14b1114846a6ccbdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ec4756-3f", "ovs_interfaceid": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:17:14 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:14 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-598510486',display_name='tempest-ServerStableDeviceRescueTest-server-598510486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-598510486',id=4,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxONYR7US0Zqc+k52oEx3HULG21Vb3SacYC5A1QxASviLskRyecdFv7MixuujXnSWxHTX4y8h2pNxHKdXKC80agpyrF7M04aMiRUDOy/8e5yjPGD6zvwZDgFznjov/1Kw==',key_name='tempest-keypair-1732727552',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45448e5cb4e84c14b1114846a6ccbdce',ramdisk_id='',reservation_id='r-9t7k0w0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1008853523',owner_user_name='tempest-ServerStableDeviceRescueTest-1008853523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:17:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd40c898d11b440ca45ab29e8e6c7721',uuid=28f5dcc3-db77-4c65-87af-e300f99d2be5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "address": "fa:16:3e:6b:b2:4e", "network": {"id": "27a8d395-36c8-4f27-89cf-f5019ccbf9a2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45448e5cb4e84c14b1114846a6ccbdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ec4756-3f", "ovs_interfaceid": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Converting VIF {"id": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "address": "fa:16:3e:6b:b2:4e", "network": {"id": "27a8d395-36c8-4f27-89cf-f5019ccbf9a2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45448e5cb4e84c14b1114846a6ccbdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ec4756-3f", "ovs_interfaceid": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:b2:4e,bridge_name='br-int',has_traffic_filtering=True,id=d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e,network=Network(27a8d395-36c8-4f27-89cf-f5019ccbf9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ec4756-3f') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.objects.instance [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lazy-loading 'pci_devices' on Instance uuid 28f5dcc3-db77-4c65-87af-e300f99d2be5 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:17:14 user nova-compute[75356]:   <uuid>28f5dcc3-db77-4c65-87af-e300f99d2be5</uuid>
Nov 29 20:17:14 user nova-compute[75356]:   <name>instance-00000004</name>
Nov 29 20:17:14 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:17:14 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:17:14 user nova-compute[75356]:   <metadata>
Nov 29 20:17:14 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:17:14 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:17:14 user nova-compute[75356]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-598510486</nova:name>
Nov 29 20:17:14 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:17:14</nova:creationTime>
Nov 29 20:17:14 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:17:14 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:17:14 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:17:14 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:17:14 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:17:14 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:17:14 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:17:14 user nova-compute[75356]:       <nova:owner>
Nov 29 20:17:14 user nova-compute[75356]:         <nova:user uuid="bd40c898d11b440ca45ab29e8e6c7721">tempest-ServerStableDeviceRescueTest-1008853523-project-member</nova:user>
Nov 29 20:17:14 user nova-compute[75356]:         <nova:project uuid="45448e5cb4e84c14b1114846a6ccbdce">tempest-ServerStableDeviceRescueTest-1008853523</nova:project>
Nov 29 20:17:14 user nova-compute[75356]:       </nova:owner>
Nov 29 20:17:14 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:17:14 user nova-compute[75356]:       <nova:ports>
Nov 29 20:17:14 user nova-compute[75356]:         <nova:port uuid="d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e">
Nov 29 20:17:14 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 20:17:14 user nova-compute[75356]:         </nova:port>
Nov 29 20:17:14 user nova-compute[75356]:       </nova:ports>
Nov 29 20:17:14 user nova-compute[75356]:     </nova:instance>
Nov 29 20:17:14 user nova-compute[75356]:   </metadata>
Nov 29 20:17:14 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:17:14 user nova-compute[75356]:     <system>
Nov 29 20:17:14 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:17:14 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:17:14 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:17:14 user nova-compute[75356]:       <entry name="serial">28f5dcc3-db77-4c65-87af-e300f99d2be5</entry>
Nov 29 20:17:14 user nova-compute[75356]:       <entry name="uuid">28f5dcc3-db77-4c65-87af-e300f99d2be5</entry>
Nov 29 20:17:14 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:17:14 user nova-compute[75356]:     </system>
Nov 29 20:17:14 user nova-compute[75356]:   </sysinfo>
Nov 29 20:17:14 user nova-compute[75356]:   <os>
Nov 29 20:17:14 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:17:14 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:17:14 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:17:14 user nova-compute[75356]:   </os>
Nov 29 20:17:14 user nova-compute[75356]:   <features>
Nov 29 20:17:14 user nova-compute[75356]:     <acpi/>
Nov 29 20:17:14 user nova-compute[75356]:     <apic/>
Nov 29 20:17:14 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:17:14 user nova-compute[75356]:   </features>
Nov 29 20:17:14 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:17:14 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:17:14 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:17:14 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:17:14 user nova-compute[75356]:   </clock>
Nov 29 20:17:14 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:17:14 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:17:14 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:17:14 user nova-compute[75356]:   </cpu>
Nov 29 20:17:14 user nova-compute[75356]:   <devices>
Nov 29 20:17:14 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:17:14 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:17:14 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk"/>
Nov 29 20:17:14 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:17:14 user nova-compute[75356]:     </disk>
Nov 29 20:17:14 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:17:14 user nova-compute[75356]:       <mac address="fa:16:3e:6b:b2:4e"/>
Nov 29 20:17:14 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:17:14 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:17:14 user nova-compute[75356]:       <target dev="tapd6ec4756-3f"/>
Nov 29 20:17:14 user nova-compute[75356]:     </interface>
Nov 29 20:17:14 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:17:14 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/console.log" append="off"/>
Nov 29 20:17:14 user nova-compute[75356]:     </serial>
Nov 29 20:17:14 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:17:14 user nova-compute[75356]:     <video>
Nov 29 20:17:14 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:17:14 user nova-compute[75356]:     </video>
Nov 29 20:17:14 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:17:14 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:17:14 user nova-compute[75356]:     </rng>
Nov 29 20:17:14 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:17:14 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:17:14 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:17:14 user nova-compute[75356]:     </memballoon>
Nov 29 20:17:14 user nova-compute[75356]:   </devices>
Nov 29 20:17:14 user nova-compute[75356]: </domain>
Nov 29 20:17:14 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-598510486',display_name='tempest-ServerStableDeviceRescueTest-server-598510486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-598510486',id=4,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxONYR7US0Zqc+k52oEx3HULG21Vb3SacYC5A1QxASviLskRyecdFv7MixuujXnSWxHTX4y8h2pNxHKdXKC80agpyrF7M04aMiRUDOy/8e5yjPGD6zvwZDgFznjov/1Kw==',key_name='tempest-keypair-1732727552',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45448e5cb4e84c14b1114846a6ccbdce',ramdisk_id='',reservation_id='r-9t7k0w0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1008853523',owner_user_name='tempest-ServerStableDeviceRescueTest-1008853523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:17:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd40c898d11b440ca45ab29e8e6c7721',uuid=28f5dcc3-db77-4c65-87af-e300f99d2be5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "address": "fa:16:3e:6b:b2:4e", "network": {"id": "27a8d395-36c8-4f27-89cf-f5019ccbf9a2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45448e5cb4e84c14b1114846a6ccbdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ec4756-3f", "ovs_interfaceid": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Converting VIF {"id": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "address": "fa:16:3e:6b:b2:4e", "network": {"id": "27a8d395-36c8-4f27-89cf-f5019ccbf9a2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45448e5cb4e84c14b1114846a6ccbdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ec4756-3f", "ovs_interfaceid": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:b2:4e,bridge_name='br-int',has_traffic_filtering=True,id=d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e,network=Network(27a8d395-36c8-4f27-89cf-f5019ccbf9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ec4756-3f') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG os_vif [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:b2:4e,bridge_name='br-int',has_traffic_filtering=True,id=d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e,network=Network(27a8d395-36c8-4f27-89cf-f5019ccbf9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ec4756-3f') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e04daf4-eed6-5599-beec-24ac246a1df8', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6ec4756-3f, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6ec4756-3f, col_values=(('qos', UUID('e2cb7e4d-4521-45e1-8df9-02185e4e551c')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6ec4756-3f, col_values=(('external_ids', {'iface-id': 'd6ec4756-3f7e-4ae2-b00b-a0141eff9b8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:b2:4e', 'vm-uuid': '28f5dcc3-db77-4c65-87af-e300f99d2be5'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:14 user nova-compute[75356]: INFO os_vif [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:b2:4e,bridge_name='br-int',has_traffic_filtering=True,id=d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e,network=Network(27a8d395-36c8-4f27-89cf-f5019ccbf9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ec4756-3f')
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.network.neutron [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] No VIF found with MAC fa:16:3e:6b:b2:4e, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.compute.manager [req-366f3034-6286-4f9f-a5e6-5f7fbce22f62 req-4349b1f3-06dc-48bf-abb9-2a970a5a279b service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received event network-changed-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.compute.manager [req-366f3034-6286-4f9f-a5e6-5f7fbce22f62 req-4349b1f3-06dc-48bf-abb9-2a970a5a279b service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Refreshing instance network info cache due to event network-changed-bf5b9476-92db-4a94-bcdd-485ba68a4d1e. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-366f3034-6286-4f9f-a5e6-5f7fbce22f62 req-4349b1f3-06dc-48bf-abb9-2a970a5a279b service nova] Acquiring lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:17:14 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Instance spawned successfully.
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:14 user nova-compute[75356]: INFO nova.compute.manager [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Took 12.81 seconds to spawn the instance on the hypervisor.
Nov 29 20:17:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:17:15 user nova-compute[75356]: INFO nova.compute.manager [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Took 13.59 seconds to build instance.
Nov 29 20:17:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2c026c5b-720e-4e6e-a5db-a1ab3f5a8cd1 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "9751c435-4d10-46dc-86e7-39d40e8209d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.747s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.network.neutron [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Updating instance_info_cache with network_info: [{"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Releasing lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Instance network_info: |[{"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-366f3034-6286-4f9f-a5e6-5f7fbce22f62 req-4349b1f3-06dc-48bf-abb9-2a970a5a279b service nova] Acquired lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.network.neutron [req-366f3034-6286-4f9f-a5e6-5f7fbce22f62 req-4349b1f3-06dc-48bf-abb9-2a970a5a279b service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Refreshing network info cache for port bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Start _get_guest_xml network_info=[{"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:17:15 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:15 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2075887638',display_name='tempest-ServerActionsTestOtherB-server-2075887638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2075887638',id=5,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqmwjesnBZKKmMOP1nU5mLLaxgxAYrWKpY6AKu2j/L1exH/XrbvTGFuJ5hCGjIGc6yFau1HY0D/HH/XuWjDf7bDrvpfXRmVeDF3iS6kjnnvyZ4TUUiMwhiV4HxFj8NX1w==',key_name='tempest-keypair-1339068574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19fa4a7548454fc4a29a625b0c819c9c',ramdisk_id='',reservation_id='r-pzj88ta7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-403173210',owner_user_name='tempest-ServerActionsTestOtherB-403173210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:17:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e5a895cde3741d0a48cb06922ad80f8',uuid=96cbbbdb-e1cc-49da-9a9f-5b83031b235b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Converting VIF {"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:e6:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf5b9476-92db-4a94-bcdd-485ba68a4d1e,network=Network(d5185e2d-1e16-408d-91cf-3c494b84cd52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5b9476-92') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.objects.instance [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lazy-loading 'pci_devices' on Instance uuid 96cbbbdb-e1cc-49da-9a9f-5b83031b235b {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:17:15 user nova-compute[75356]:   <uuid>96cbbbdb-e1cc-49da-9a9f-5b83031b235b</uuid>
Nov 29 20:17:15 user nova-compute[75356]:   <name>instance-00000005</name>
Nov 29 20:17:15 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:17:15 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:17:15 user nova-compute[75356]:   <metadata>
Nov 29 20:17:15 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:17:15 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:17:15 user nova-compute[75356]:       <nova:name>tempest-ServerActionsTestOtherB-server-2075887638</nova:name>
Nov 29 20:17:15 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:17:15</nova:creationTime>
Nov 29 20:17:15 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:17:15 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:17:15 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:17:15 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:17:15 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:17:15 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:17:15 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:17:15 user nova-compute[75356]:       <nova:owner>
Nov 29 20:17:15 user nova-compute[75356]:         <nova:user uuid="9e5a895cde3741d0a48cb06922ad80f8">tempest-ServerActionsTestOtherB-403173210-project-member</nova:user>
Nov 29 20:17:15 user nova-compute[75356]:         <nova:project uuid="19fa4a7548454fc4a29a625b0c819c9c">tempest-ServerActionsTestOtherB-403173210</nova:project>
Nov 29 20:17:15 user nova-compute[75356]:       </nova:owner>
Nov 29 20:17:15 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:17:15 user nova-compute[75356]:       <nova:ports>
Nov 29 20:17:15 user nova-compute[75356]:         <nova:port uuid="bf5b9476-92db-4a94-bcdd-485ba68a4d1e">
Nov 29 20:17:15 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 20:17:15 user nova-compute[75356]:         </nova:port>
Nov 29 20:17:15 user nova-compute[75356]:       </nova:ports>
Nov 29 20:17:15 user nova-compute[75356]:     </nova:instance>
Nov 29 20:17:15 user nova-compute[75356]:   </metadata>
Nov 29 20:17:15 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:17:15 user nova-compute[75356]:     <system>
Nov 29 20:17:15 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:17:15 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:17:15 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:17:15 user nova-compute[75356]:       <entry name="serial">96cbbbdb-e1cc-49da-9a9f-5b83031b235b</entry>
Nov 29 20:17:15 user nova-compute[75356]:       <entry name="uuid">96cbbbdb-e1cc-49da-9a9f-5b83031b235b</entry>
Nov 29 20:17:15 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:17:15 user nova-compute[75356]:     </system>
Nov 29 20:17:15 user nova-compute[75356]:   </sysinfo>
Nov 29 20:17:15 user nova-compute[75356]:   <os>
Nov 29 20:17:15 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:17:15 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:17:15 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:17:15 user nova-compute[75356]:   </os>
Nov 29 20:17:15 user nova-compute[75356]:   <features>
Nov 29 20:17:15 user nova-compute[75356]:     <acpi/>
Nov 29 20:17:15 user nova-compute[75356]:     <apic/>
Nov 29 20:17:15 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:17:15 user nova-compute[75356]:   </features>
Nov 29 20:17:15 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:17:15 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:17:15 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:17:15 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:17:15 user nova-compute[75356]:   </clock>
Nov 29 20:17:15 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:17:15 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:17:15 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:17:15 user nova-compute[75356]:   </cpu>
Nov 29 20:17:15 user nova-compute[75356]:   <devices>
Nov 29 20:17:15 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:17:15 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:17:15 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk"/>
Nov 29 20:17:15 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:17:15 user nova-compute[75356]:     </disk>
Nov 29 20:17:15 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:17:15 user nova-compute[75356]:       <mac address="fa:16:3e:b0:e6:d6"/>
Nov 29 20:17:15 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:17:15 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:17:15 user nova-compute[75356]:       <target dev="tapbf5b9476-92"/>
Nov 29 20:17:15 user nova-compute[75356]:     </interface>
Nov 29 20:17:15 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:17:15 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/console.log" append="off"/>
Nov 29 20:17:15 user nova-compute[75356]:     </serial>
Nov 29 20:17:15 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:17:15 user nova-compute[75356]:     <video>
Nov 29 20:17:15 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:17:15 user nova-compute[75356]:     </video>
Nov 29 20:17:15 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:17:15 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:17:15 user nova-compute[75356]:     </rng>
Nov 29 20:17:15 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:17:15 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:17:15 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:17:15 user nova-compute[75356]:     </memballoon>
Nov 29 20:17:15 user nova-compute[75356]:   </devices>
Nov 29 20:17:15 user nova-compute[75356]: </domain>
Nov 29 20:17:15 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2075887638',display_name='tempest-ServerActionsTestOtherB-server-2075887638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2075887638',id=5,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqmwjesnBZKKmMOP1nU5mLLaxgxAYrWKpY6AKu2j/L1exH/XrbvTGFuJ5hCGjIGc6yFau1HY0D/HH/XuWjDf7bDrvpfXRmVeDF3iS6kjnnvyZ4TUUiMwhiV4HxFj8NX1w==',key_name='tempest-keypair-1339068574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19fa4a7548454fc4a29a625b0c819c9c',ramdisk_id='',reservation_id='r-pzj88ta7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-403173210',owner_user_name='tempest-ServerActionsTestOtherB-403173210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:17:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e5a895cde3741d0a48cb06922ad80f8',uuid=96cbbbdb-e1cc-49da-9a9f-5b83031b235b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Converting VIF {"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:e6:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf5b9476-92db-4a94-bcdd-485ba68a4d1e,network=Network(d5185e2d-1e16-408d-91cf-3c494b84cd52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5b9476-92') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG os_vif [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:e6:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf5b9476-92db-4a94-bcdd-485ba68a4d1e,network=Network(d5185e2d-1e16-408d-91cf-3c494b84cd52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5b9476-92') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c105df8-1b1c-5775-a139-20745adc70e0', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf5b9476-92, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf5b9476-92, col_values=(('qos', UUID('dfb0a6bb-e851-4fc8-9338-fd890a0e8255')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf5b9476-92, col_values=(('external_ids', {'iface-id': 'bf5b9476-92db-4a94-bcdd-485ba68a4d1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:e6:d6', 'vm-uuid': '96cbbbdb-e1cc-49da-9a9f-5b83031b235b'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:15 user nova-compute[75356]: INFO os_vif [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:e6:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf5b9476-92db-4a94-bcdd-485ba68a4d1e,network=Network(d5185e2d-1e16-408d-91cf-3c494b84cd52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5b9476-92')
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] No VIF found with MAC fa:16:3e:b0:e6:d6, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.network.neutron [req-1a973f1f-cc14-4d91-937b-ad2dc48c4e91 req-9d396e3c-1481-47c7-a017-6cd1b86b66a9 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Updated VIF entry in instance network info cache for port d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:17:15 user nova-compute[75356]: DEBUG nova.network.neutron [req-1a973f1f-cc14-4d91-937b-ad2dc48c4e91 req-9d396e3c-1481-47c7-a017-6cd1b86b66a9 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Updating instance_info_cache with network_info: [{"id": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "address": "fa:16:3e:6b:b2:4e", "network": {"id": "27a8d395-36c8-4f27-89cf-f5019ccbf9a2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45448e5cb4e84c14b1114846a6ccbdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ec4756-3f", "ovs_interfaceid": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:17:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1a973f1f-cc14-4d91-937b-ad2dc48c4e91 req-9d396e3c-1481-47c7-a017-6cd1b86b66a9 service nova] Releasing lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:17:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:16 user nova-compute[75356]: DEBUG nova.network.neutron [req-366f3034-6286-4f9f-a5e6-5f7fbce22f62 req-4349b1f3-06dc-48bf-abb9-2a970a5a279b service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Updated VIF entry in instance network info cache for port bf5b9476-92db-4a94-bcdd-485ba68a4d1e. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:17:16 user nova-compute[75356]: DEBUG nova.network.neutron [req-366f3034-6286-4f9f-a5e6-5f7fbce22f62 req-4349b1f3-06dc-48bf-abb9-2a970a5a279b service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Updating instance_info_cache with network_info: [{"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:17:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-366f3034-6286-4f9f-a5e6-5f7fbce22f62 req-4349b1f3-06dc-48bf-abb9-2a970a5a279b service nova] Releasing lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:17:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-950f527f-2e2e-4022-a2a1-b9161f6f9365 req-03792c98-4d3b-436a-b6e9-34c7c634decb service nova] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Received event network-vif-plugged-21221e61-952e-4f3b-a212-dbb9cafe061d {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-950f527f-2e2e-4022-a2a1-b9161f6f9365 req-03792c98-4d3b-436a-b6e9-34c7c634decb service nova] Acquiring lock "9751c435-4d10-46dc-86e7-39d40e8209d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-950f527f-2e2e-4022-a2a1-b9161f6f9365 req-03792c98-4d3b-436a-b6e9-34c7c634decb service nova] Lock "9751c435-4d10-46dc-86e7-39d40e8209d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-950f527f-2e2e-4022-a2a1-b9161f6f9365 req-03792c98-4d3b-436a-b6e9-34c7c634decb service nova] Lock "9751c435-4d10-46dc-86e7-39d40e8209d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-950f527f-2e2e-4022-a2a1-b9161f6f9365 req-03792c98-4d3b-436a-b6e9-34c7c634decb service nova] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] No waiting events found dispatching network-vif-plugged-21221e61-952e-4f3b-a212-dbb9cafe061d {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:17:18 user nova-compute[75356]: WARNING nova.compute.manager [req-950f527f-2e2e-4022-a2a1-b9161f6f9365 req-03792c98-4d3b-436a-b6e9-34c7c634decb service nova] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Received unexpected event network-vif-plugged-21221e61-952e-4f3b-a212-dbb9cafe061d for instance with vm_state active and task_state None.
Nov 29 20:17:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:19 user nova-compute[75356]: DEBUG nova.compute.manager [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:17:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:17:19 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Instance spawned successfully.
Nov 29 20:17:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:17:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-505c5a31-6ea3-4151-a130-c70d793195ef req-206c18d4-239c-4d0e-85eb-fc9e7315fdbb service nova] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Received event network-vif-plugged-21221e61-952e-4f3b-a212-dbb9cafe061d {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-505c5a31-6ea3-4151-a130-c70d793195ef req-206c18d4-239c-4d0e-85eb-fc9e7315fdbb service nova] Acquiring lock "9751c435-4d10-46dc-86e7-39d40e8209d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-505c5a31-6ea3-4151-a130-c70d793195ef req-206c18d4-239c-4d0e-85eb-fc9e7315fdbb service nova] Lock "9751c435-4d10-46dc-86e7-39d40e8209d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-505c5a31-6ea3-4151-a130-c70d793195ef req-206c18d4-239c-4d0e-85eb-fc9e7315fdbb service nova] Lock "9751c435-4d10-46dc-86e7-39d40e8209d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-505c5a31-6ea3-4151-a130-c70d793195ef req-206c18d4-239c-4d0e-85eb-fc9e7315fdbb service nova] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] No waiting events found dispatching network-vif-plugged-21221e61-952e-4f3b-a212-dbb9cafe061d {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:17:20 user nova-compute[75356]: WARNING nova.compute.manager [req-505c5a31-6ea3-4151-a130-c70d793195ef req-206c18d4-239c-4d0e-85eb-fc9e7315fdbb service nova] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Received unexpected event network-vif-plugged-21221e61-952e-4f3b-a212-dbb9cafe061d for instance with vm_state active and task_state None.
Nov 29 20:17:20 user nova-compute[75356]: INFO nova.compute.manager [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Took 14.79 seconds to spawn the instance on the hypervisor.
Nov 29 20:17:20 user nova-compute[75356]: DEBUG nova.compute.manager [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:17:20 user nova-compute[75356]: INFO nova.compute.manager [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Took 15.75 seconds to build instance.
Nov 29 20:17:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55648162-2707-420e-a77d-bb2e8d5909ab tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "0b59517a-c467-432a-a73a-d1460c1574e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.027s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:20 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:17:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:17:20 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Instance spawned successfully.
Nov 29 20:17:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:17:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:21 user nova-compute[75356]: INFO nova.compute.manager [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Took 12.90 seconds to spawn the instance on the hypervisor.
Nov 29 20:17:21 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:17:21 user nova-compute[75356]: DEBUG nova.compute.manager [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:17:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:17:21 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Instance spawned successfully.
Nov 29 20:17:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:17:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:21 user nova-compute[75356]: INFO nova.compute.manager [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Took 14.30 seconds to build instance.
Nov 29 20:17:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d1bc05f5-922c-4c89-82f5-02913e6cc822 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.424s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "972e22c1-bd85-4507-9166-ace3fce8e698" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "972e22c1-bd85-4507-9166-ace3fce8e698" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:21 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:17:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:21 user nova-compute[75356]: INFO nova.compute.manager [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Took 13.90 seconds to spawn the instance on the hypervisor.
Nov 29 20:17:21 user nova-compute[75356]: DEBUG nova.compute.manager [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:17:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.008s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:21 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:17:21 user nova-compute[75356]: INFO nova.compute.claims [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Claim successful on node user
Nov 29 20:17:21 user nova-compute[75356]: INFO nova.compute.manager [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Took 15.12 seconds to build instance.
Nov 29 20:17:21 user nova-compute[75356]: DEBUG nova.compute.manager [req-ec502909-5e59-4ed9-8aef-6c6b94efad0d req-5aa3d01f-5f19-429f-be2b-91f25f620105 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Received event network-vif-plugged-56a80963-a1f2-429e-8474-1795928fd05c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ec502909-5e59-4ed9-8aef-6c6b94efad0d req-5aa3d01f-5f19-429f-be2b-91f25f620105 service nova] Acquiring lock "0b59517a-c467-432a-a73a-d1460c1574e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ec502909-5e59-4ed9-8aef-6c6b94efad0d req-5aa3d01f-5f19-429f-be2b-91f25f620105 service nova] Lock "0b59517a-c467-432a-a73a-d1460c1574e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ec502909-5e59-4ed9-8aef-6c6b94efad0d req-5aa3d01f-5f19-429f-be2b-91f25f620105 service nova] Lock "0b59517a-c467-432a-a73a-d1460c1574e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:21 user nova-compute[75356]: DEBUG nova.compute.manager [req-ec502909-5e59-4ed9-8aef-6c6b94efad0d req-5aa3d01f-5f19-429f-be2b-91f25f620105 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] No waiting events found dispatching network-vif-plugged-56a80963-a1f2-429e-8474-1795928fd05c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:17:21 user nova-compute[75356]: WARNING nova.compute.manager [req-ec502909-5e59-4ed9-8aef-6c6b94efad0d req-5aa3d01f-5f19-429f-be2b-91f25f620105 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Received unexpected event network-vif-plugged-56a80963-a1f2-429e-8474-1795928fd05c for instance with vm_state active and task_state None.
Nov 29 20:17:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6b0c67a2-6a4c-479a-a07f-dd843820ebc0 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.311s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:22 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:17:22 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:17:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.862s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:22 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:17:22 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:17:22 user nova-compute[75356]: DEBUG nova.network.neutron [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:17:22 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:17:22 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:17:23 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:17:23 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:17:23 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Creating image(s)
Nov 29 20:17:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "/opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "/opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "/opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:23 user nova-compute[75356]: DEBUG nova.policy [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91cd534885224b259429518c575b82e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e9eb99ca1b4dddb0075e78847b980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:17:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.353s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.372s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk 1073741824" returned: 0 in 0.108s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.491s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:24 user nova-compute[75356]: DEBUG nova.compute.manager [req-cceff08c-e75f-4fb0-9b1c-079d690a3343 req-88f60d27-6cd1-4ca5-a13d-086e173100a7 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Received event network-vif-plugged-56a80963-a1f2-429e-8474-1795928fd05c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cceff08c-e75f-4fb0-9b1c-079d690a3343 req-88f60d27-6cd1-4ca5-a13d-086e173100a7 service nova] Acquiring lock "0b59517a-c467-432a-a73a-d1460c1574e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cceff08c-e75f-4fb0-9b1c-079d690a3343 req-88f60d27-6cd1-4ca5-a13d-086e173100a7 service nova] Lock "0b59517a-c467-432a-a73a-d1460c1574e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cceff08c-e75f-4fb0-9b1c-079d690a3343 req-88f60d27-6cd1-4ca5-a13d-086e173100a7 service nova] Lock "0b59517a-c467-432a-a73a-d1460c1574e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:24 user nova-compute[75356]: DEBUG nova.compute.manager [req-cceff08c-e75f-4fb0-9b1c-079d690a3343 req-88f60d27-6cd1-4ca5-a13d-086e173100a7 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] No waiting events found dispatching network-vif-plugged-56a80963-a1f2-429e-8474-1795928fd05c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:17:24 user nova-compute[75356]: WARNING nova.compute.manager [req-cceff08c-e75f-4fb0-9b1c-079d690a3343 req-88f60d27-6cd1-4ca5-a13d-086e173100a7 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Received unexpected event network-vif-plugged-56a80963-a1f2-429e-8474-1795928fd05c for instance with vm_state active and task_state None.
Nov 29 20:17:24 user nova-compute[75356]: DEBUG nova.compute.manager [req-cceff08c-e75f-4fb0-9b1c-079d690a3343 req-88f60d27-6cd1-4ca5-a13d-086e173100a7 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received event network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cceff08c-e75f-4fb0-9b1c-079d690a3343 req-88f60d27-6cd1-4ca5-a13d-086e173100a7 service nova] Acquiring lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cceff08c-e75f-4fb0-9b1c-079d690a3343 req-88f60d27-6cd1-4ca5-a13d-086e173100a7 service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cceff08c-e75f-4fb0-9b1c-079d690a3343 req-88f60d27-6cd1-4ca5-a13d-086e173100a7 service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:24 user nova-compute[75356]: DEBUG nova.compute.manager [req-cceff08c-e75f-4fb0-9b1c-079d690a3343 req-88f60d27-6cd1-4ca5-a13d-086e173100a7 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] No waiting events found dispatching network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:17:24 user nova-compute[75356]: WARNING nova.compute.manager [req-cceff08c-e75f-4fb0-9b1c-079d690a3343 req-88f60d27-6cd1-4ca5-a13d-086e173100a7 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received unexpected event network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e for instance with vm_state active and task_state None.
Nov 29 20:17:24 user nova-compute[75356]: DEBUG nova.compute.manager [req-cceff08c-e75f-4fb0-9b1c-079d690a3343 req-88f60d27-6cd1-4ca5-a13d-086e173100a7 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received event network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cceff08c-e75f-4fb0-9b1c-079d690a3343 req-88f60d27-6cd1-4ca5-a13d-086e173100a7 service nova] Acquiring lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cceff08c-e75f-4fb0-9b1c-079d690a3343 req-88f60d27-6cd1-4ca5-a13d-086e173100a7 service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cceff08c-e75f-4fb0-9b1c-079d690a3343 req-88f60d27-6cd1-4ca5-a13d-086e173100a7 service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:24 user nova-compute[75356]: DEBUG nova.compute.manager [req-cceff08c-e75f-4fb0-9b1c-079d690a3343 req-88f60d27-6cd1-4ca5-a13d-086e173100a7 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] No waiting events found dispatching network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:17:24 user nova-compute[75356]: WARNING nova.compute.manager [req-cceff08c-e75f-4fb0-9b1c-079d690a3343 req-88f60d27-6cd1-4ca5-a13d-086e173100a7 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received unexpected event network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e for instance with vm_state active and task_state None.
Nov 29 20:17:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.353s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:24 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Checking if we can resize image /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:17:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:24 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Cannot resize image /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:17:24 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:17:24 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Ensure instance console log exists: /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:17:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:25 user nova-compute[75356]: DEBUG nova.network.neutron [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Successfully created port: cfb6a771-e8ce-43da-aebb-742cb2afdbcb {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:17:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:26 user nova-compute[75356]: DEBUG nova.compute.manager [req-b457a97c-b097-43bd-a96c-349576bce0fd req-63c5d1a9-1d9c-43b6-be44-3a9c20c0ec98 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received event network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b457a97c-b097-43bd-a96c-349576bce0fd req-63c5d1a9-1d9c-43b6-be44-3a9c20c0ec98 service nova] Acquiring lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b457a97c-b097-43bd-a96c-349576bce0fd req-63c5d1a9-1d9c-43b6-be44-3a9c20c0ec98 service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b457a97c-b097-43bd-a96c-349576bce0fd req-63c5d1a9-1d9c-43b6-be44-3a9c20c0ec98 service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:26 user nova-compute[75356]: DEBUG nova.compute.manager [req-b457a97c-b097-43bd-a96c-349576bce0fd req-63c5d1a9-1d9c-43b6-be44-3a9c20c0ec98 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] No waiting events found dispatching network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:17:26 user nova-compute[75356]: WARNING nova.compute.manager [req-b457a97c-b097-43bd-a96c-349576bce0fd req-63c5d1a9-1d9c-43b6-be44-3a9c20c0ec98 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received unexpected event network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e for instance with vm_state active and task_state None.
Nov 29 20:17:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:27 user nova-compute[75356]: DEBUG nova.network.neutron [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Successfully updated port: cfb6a771-e8ce-43da-aebb-742cb2afdbcb {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:17:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "refresh_cache-972e22c1-bd85-4507-9166-ace3fce8e698" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:17:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquired lock "refresh_cache-972e22c1-bd85-4507-9166-ace3fce8e698" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:17:27 user nova-compute[75356]: DEBUG nova.network.neutron [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:17:27 user nova-compute[75356]: DEBUG nova.network.neutron [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.compute.manager [req-a2261f02-e7c8-4779-b2ac-f724accbb785 req-10be3225-f2f0-431e-981c-2680d9ffe6a3 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received event network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a2261f02-e7c8-4779-b2ac-f724accbb785 req-10be3225-f2f0-431e-981c-2680d9ffe6a3 service nova] Acquiring lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a2261f02-e7c8-4779-b2ac-f724accbb785 req-10be3225-f2f0-431e-981c-2680d9ffe6a3 service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a2261f02-e7c8-4779-b2ac-f724accbb785 req-10be3225-f2f0-431e-981c-2680d9ffe6a3 service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.compute.manager [req-a2261f02-e7c8-4779-b2ac-f724accbb785 req-10be3225-f2f0-431e-981c-2680d9ffe6a3 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] No waiting events found dispatching network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:17:28 user nova-compute[75356]: WARNING nova.compute.manager [req-a2261f02-e7c8-4779-b2ac-f724accbb785 req-10be3225-f2f0-431e-981c-2680d9ffe6a3 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received unexpected event network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e for instance with vm_state active and task_state None.
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.compute.manager [req-a2261f02-e7c8-4779-b2ac-f724accbb785 req-10be3225-f2f0-431e-981c-2680d9ffe6a3 service nova] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Received event network-changed-cfb6a771-e8ce-43da-aebb-742cb2afdbcb {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.compute.manager [req-a2261f02-e7c8-4779-b2ac-f724accbb785 req-10be3225-f2f0-431e-981c-2680d9ffe6a3 service nova] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Refreshing instance network info cache due to event network-changed-cfb6a771-e8ce-43da-aebb-742cb2afdbcb. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a2261f02-e7c8-4779-b2ac-f724accbb785 req-10be3225-f2f0-431e-981c-2680d9ffe6a3 service nova] Acquiring lock "refresh_cache-972e22c1-bd85-4507-9166-ace3fce8e698" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Acquiring lock "ee4a5666-bfea-47bf-bd21-d24685967a3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "ee4a5666-bfea-47bf-bd21-d24685967a3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.network.neutron [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Updating instance_info_cache with network_info: [{"id": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "address": "fa:16:3e:3b:bc:00", "network": {"id": "4e1439ac-1b43-4407-997e-6ac5b6a0066f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2125172073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2e9eb99ca1b4dddb0075e78847b980b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb6a771-e8", "ovs_interfaceid": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Releasing lock "refresh_cache-972e22c1-bd85-4507-9166-ace3fce8e698" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Instance network_info: |[{"id": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "address": "fa:16:3e:3b:bc:00", "network": {"id": "4e1439ac-1b43-4407-997e-6ac5b6a0066f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2125172073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2e9eb99ca1b4dddb0075e78847b980b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb6a771-e8", "ovs_interfaceid": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a2261f02-e7c8-4779-b2ac-f724accbb785 req-10be3225-f2f0-431e-981c-2680d9ffe6a3 service nova] Acquired lock "refresh_cache-972e22c1-bd85-4507-9166-ace3fce8e698" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.network.neutron [req-a2261f02-e7c8-4779-b2ac-f724accbb785 req-10be3225-f2f0-431e-981c-2680d9ffe6a3 service nova] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Refreshing network info cache for port cfb6a771-e8ce-43da-aebb-742cb2afdbcb {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Start _get_guest_xml network_info=[{"id": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "address": "fa:16:3e:3b:bc:00", "network": {"id": "4e1439ac-1b43-4407-997e-6ac5b6a0066f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2125172073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2e9eb99ca1b4dddb0075e78847b980b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb6a771-e8", "ovs_interfaceid": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:17:28 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:28 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-277366552',display_name='tempest-VolumesAdminNegativeTest-server-277366552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-277366552',id=6,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTZq3fJeobsfPwRfLW1sVmiHO8EbDMOofCaocHP2AH8bSIXXbUYpzSh+zi76VBR1nWc6VoncPuiWCEIzq60QjrxuFW3M7+cnmK4LlVeywgzLHOALsyJDDwg8pGXba9ISw==',key_name='tempest-keypair-258596985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2e9eb99ca1b4dddb0075e78847b980b',ramdisk_id='',reservation_id='r-jkdlbj7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1603071749',owner_user_name='tempest-VolumesAdminNegativeTest-1603071749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:17:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91cd534885224b259429518c575b82e7',uuid=972e22c1-bd85-4507-9166-ace3fce8e698,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "address": "fa:16:3e:3b:bc:00", "network": {"id": "4e1439ac-1b43-4407-997e-6ac5b6a0066f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2125172073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2e9eb99ca1b4dddb0075e78847b980b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb6a771-e8", "ovs_interfaceid": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Converting VIF {"id": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "address": "fa:16:3e:3b:bc:00", "network": {"id": "4e1439ac-1b43-4407-997e-6ac5b6a0066f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2125172073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2e9eb99ca1b4dddb0075e78847b980b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb6a771-e8", "ovs_interfaceid": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bc:00,bridge_name='br-int',has_traffic_filtering=True,id=cfb6a771-e8ce-43da-aebb-742cb2afdbcb,network=Network(4e1439ac-1b43-4407-997e-6ac5b6a0066f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb6a771-e8') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.objects.instance [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lazy-loading 'pci_devices' on Instance uuid 972e22c1-bd85-4507-9166-ace3fce8e698 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:17:28 user nova-compute[75356]:   <uuid>972e22c1-bd85-4507-9166-ace3fce8e698</uuid>
Nov 29 20:17:28 user nova-compute[75356]:   <name>instance-00000006</name>
Nov 29 20:17:28 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:17:28 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:17:28 user nova-compute[75356]:   <metadata>
Nov 29 20:17:28 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:17:28 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:17:28 user nova-compute[75356]:       <nova:name>tempest-VolumesAdminNegativeTest-server-277366552</nova:name>
Nov 29 20:17:28 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:17:28</nova:creationTime>
Nov 29 20:17:28 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:17:28 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:17:28 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:17:28 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:17:28 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:17:28 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:17:28 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:17:28 user nova-compute[75356]:       <nova:owner>
Nov 29 20:17:28 user nova-compute[75356]:         <nova:user uuid="91cd534885224b259429518c575b82e7">tempest-VolumesAdminNegativeTest-1603071749-project-member</nova:user>
Nov 29 20:17:28 user nova-compute[75356]:         <nova:project uuid="f2e9eb99ca1b4dddb0075e78847b980b">tempest-VolumesAdminNegativeTest-1603071749</nova:project>
Nov 29 20:17:28 user nova-compute[75356]:       </nova:owner>
Nov 29 20:17:28 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:17:28 user nova-compute[75356]:       <nova:ports>
Nov 29 20:17:28 user nova-compute[75356]:         <nova:port uuid="cfb6a771-e8ce-43da-aebb-742cb2afdbcb">
Nov 29 20:17:28 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 20:17:28 user nova-compute[75356]:         </nova:port>
Nov 29 20:17:28 user nova-compute[75356]:       </nova:ports>
Nov 29 20:17:28 user nova-compute[75356]:     </nova:instance>
Nov 29 20:17:28 user nova-compute[75356]:   </metadata>
Nov 29 20:17:28 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:17:28 user nova-compute[75356]:     <system>
Nov 29 20:17:28 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:17:28 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:17:28 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:17:28 user nova-compute[75356]:       <entry name="serial">972e22c1-bd85-4507-9166-ace3fce8e698</entry>
Nov 29 20:17:28 user nova-compute[75356]:       <entry name="uuid">972e22c1-bd85-4507-9166-ace3fce8e698</entry>
Nov 29 20:17:28 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:17:28 user nova-compute[75356]:     </system>
Nov 29 20:17:28 user nova-compute[75356]:   </sysinfo>
Nov 29 20:17:28 user nova-compute[75356]:   <os>
Nov 29 20:17:28 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:17:28 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:17:28 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:17:28 user nova-compute[75356]:   </os>
Nov 29 20:17:28 user nova-compute[75356]:   <features>
Nov 29 20:17:28 user nova-compute[75356]:     <acpi/>
Nov 29 20:17:28 user nova-compute[75356]:     <apic/>
Nov 29 20:17:28 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:17:28 user nova-compute[75356]:   </features>
Nov 29 20:17:28 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:17:28 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:17:28 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:17:28 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:17:28 user nova-compute[75356]:   </clock>
Nov 29 20:17:28 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:17:28 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:17:28 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:17:28 user nova-compute[75356]:   </cpu>
Nov 29 20:17:28 user nova-compute[75356]:   <devices>
Nov 29 20:17:28 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:17:28 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:17:28 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk"/>
Nov 29 20:17:28 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:17:28 user nova-compute[75356]:     </disk>
Nov 29 20:17:28 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:17:28 user nova-compute[75356]:       <mac address="fa:16:3e:3b:bc:00"/>
Nov 29 20:17:28 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:17:28 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:17:28 user nova-compute[75356]:       <target dev="tapcfb6a771-e8"/>
Nov 29 20:17:28 user nova-compute[75356]:     </interface>
Nov 29 20:17:28 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:17:28 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/console.log" append="off"/>
Nov 29 20:17:28 user nova-compute[75356]:     </serial>
Nov 29 20:17:28 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:17:28 user nova-compute[75356]:     <video>
Nov 29 20:17:28 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:17:28 user nova-compute[75356]:     </video>
Nov 29 20:17:28 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:17:28 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:17:28 user nova-compute[75356]:     </rng>
Nov 29 20:17:28 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:17:28 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:17:28 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:17:28 user nova-compute[75356]:     </memballoon>
Nov 29 20:17:28 user nova-compute[75356]:   </devices>
Nov 29 20:17:28 user nova-compute[75356]: </domain>
Nov 29 20:17:28 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-277366552',display_name='tempest-VolumesAdminNegativeTest-server-277366552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-277366552',id=6,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTZq3fJeobsfPwRfLW1sVmiHO8EbDMOofCaocHP2AH8bSIXXbUYpzSh+zi76VBR1nWc6VoncPuiWCEIzq60QjrxuFW3M7+cnmK4LlVeywgzLHOALsyJDDwg8pGXba9ISw==',key_name='tempest-keypair-258596985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2e9eb99ca1b4dddb0075e78847b980b',ramdisk_id='',reservation_id='r-jkdlbj7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1603071749',owner_user_name='tempest-VolumesAdminNegativeTest-1603071749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:17:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91cd534885224b259429518c575b82e7',uuid=972e22c1-bd85-4507-9166-ace3fce8e698,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "address": "fa:16:3e:3b:bc:00", "network": {"id": "4e1439ac-1b43-4407-997e-6ac5b6a0066f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2125172073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2e9eb99ca1b4dddb0075e78847b980b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb6a771-e8", "ovs_interfaceid": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Converting VIF {"id": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "address": "fa:16:3e:3b:bc:00", "network": {"id": "4e1439ac-1b43-4407-997e-6ac5b6a0066f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2125172073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2e9eb99ca1b4dddb0075e78847b980b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb6a771-e8", "ovs_interfaceid": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bc:00,bridge_name='br-int',has_traffic_filtering=True,id=cfb6a771-e8ce-43da-aebb-742cb2afdbcb,network=Network(4e1439ac-1b43-4407-997e-6ac5b6a0066f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb6a771-e8') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG os_vif [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bc:00,bridge_name='br-int',has_traffic_filtering=True,id=cfb6a771-e8ce-43da-aebb-742cb2afdbcb,network=Network(4e1439ac-1b43-4407-997e-6ac5b6a0066f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb6a771-e8') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e3fc8de-ab80-56b2-af39-2308c346c5f7', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfb6a771-e8, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcfb6a771-e8, col_values=(('qos', UUID('004c5aab-4438-4d4a-bfe9-f0c92e879ee6')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcfb6a771-e8, col_values=(('external_ids', {'iface-id': 'cfb6a771-e8ce-43da-aebb-742cb2afdbcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:bc:00', 'vm-uuid': '972e22c1-bd85-4507-9166-ace3fce8e698'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:17:28 user nova-compute[75356]: INFO nova.compute.claims [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Claim successful on node user
Nov 29 20:17:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:17:28 user nova-compute[75356]: INFO os_vif [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bc:00,bridge_name='br-int',has_traffic_filtering=True,id=cfb6a771-e8ce-43da-aebb-742cb2afdbcb,network=Network(4e1439ac-1b43-4407-997e-6ac5b6a0066f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb6a771-e8')
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:17:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] No VIF found with MAC fa:16:3e:3b:bc:00, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:17:29 user nova-compute[75356]: DEBUG nova.network.neutron [req-a2261f02-e7c8-4779-b2ac-f724accbb785 req-10be3225-f2f0-431e-981c-2680d9ffe6a3 service nova] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Updated VIF entry in instance network info cache for port cfb6a771-e8ce-43da-aebb-742cb2afdbcb. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:17:29 user nova-compute[75356]: DEBUG nova.network.neutron [req-a2261f02-e7c8-4779-b2ac-f724accbb785 req-10be3225-f2f0-431e-981c-2680d9ffe6a3 service nova] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Updating instance_info_cache with network_info: [{"id": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "address": "fa:16:3e:3b:bc:00", "network": {"id": "4e1439ac-1b43-4407-997e-6ac5b6a0066f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2125172073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2e9eb99ca1b4dddb0075e78847b980b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb6a771-e8", "ovs_interfaceid": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:17:29 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:17:29 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:17:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a2261f02-e7c8-4779-b2ac-f724accbb785 req-10be3225-f2f0-431e-981c-2680d9ffe6a3 service nova] Releasing lock "refresh_cache-972e22c1-bd85-4507-9166-ace3fce8e698" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:17:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.640s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:29 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:17:29 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:17:29 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:17:29 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 29 20:17:29 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:17:29 user nova-compute[75356]: DEBUG nova.policy [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8507e047b776409da86c2613319c75bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5ffd2755d0a4059aef77a33d42c29d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:17:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Acquiring lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:29 user nova-compute[75356]: DEBUG nova.compute.manager [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:17:29 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:17:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:17:29 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Creating image(s)
Nov 29 20:17:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "/opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "/opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Acquiring lock "8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:29 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:17:29 user nova-compute[75356]: INFO nova.compute.claims [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Claim successful on node user
Nov 29 20:17:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77.part --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77.part --force-share --output=json" returned: 0 in 0.286s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:30 user nova-compute[75356]: DEBUG nova.virt.images [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] d60f5b9d-5836-45d5-a727-2af5402148d9 was qcow2, converting to raw {{(pid=75356) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG nova.privsep.utils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75356) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77.part /opt/stack/data/nova/instances/_base/8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77.converted {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77.part /opt/stack/data/nova/instances/_base/8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77.converted" returned: 0 in 0.213s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77.converted --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.709s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.774s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG nova.compute.manager [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG nova.compute.manager [req-84d5720f-edf7-4cbe-a87b-c2f35d56747b req-bb0057e5-8201-48c4-877d-6068fd7769f1 service nova] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Received event network-vif-plugged-cfb6a771-e8ce-43da-aebb-742cb2afdbcb {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-84d5720f-edf7-4cbe-a87b-c2f35d56747b req-bb0057e5-8201-48c4-877d-6068fd7769f1 service nova] Acquiring lock "972e22c1-bd85-4507-9166-ace3fce8e698-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-84d5720f-edf7-4cbe-a87b-c2f35d56747b req-bb0057e5-8201-48c4-877d-6068fd7769f1 service nova] Lock "972e22c1-bd85-4507-9166-ace3fce8e698-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-84d5720f-edf7-4cbe-a87b-c2f35d56747b req-bb0057e5-8201-48c4-877d-6068fd7769f1 service nova] Lock "972e22c1-bd85-4507-9166-ace3fce8e698-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG nova.compute.manager [req-84d5720f-edf7-4cbe-a87b-c2f35d56747b req-bb0057e5-8201-48c4-877d-6068fd7769f1 service nova] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] No waiting events found dispatching network-vif-plugged-cfb6a771-e8ce-43da-aebb-742cb2afdbcb {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:17:31 user nova-compute[75356]: WARNING nova.compute.manager [req-84d5720f-edf7-4cbe-a87b-c2f35d56747b req-bb0057e5-8201-48c4-877d-6068fd7769f1 service nova] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Received unexpected event network-vif-plugged-cfb6a771-e8ce-43da-aebb-742cb2afdbcb for instance with vm_state building and task_state spawning.
Nov 29 20:17:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77 --force-share --output=json" returned: 0 in 0.226s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Acquiring lock "8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG nova.compute.manager [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG nova.network.neutron [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:17:31 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:17:31 user nova-compute[75356]: DEBUG nova.compute.manager [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77 --force-share --output=json" returned: 0 in 0.265s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77,backing_fmt=raw /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Successfully created port: b400acb7-2f4f-45da-80f9-069c8cc27f45 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG nova.policy [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5b4a48f9bfd406cae779bfc3dc5e302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076d6fb1d7e1485f847881bd7fe665f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77,backing_fmt=raw /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk 1073741824" returned: 0 in 0.069s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.339s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG nova.compute.manager [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:17:32 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Creating image(s)
Nov 29 20:17:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "/opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "/opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77 --force-share --output=json" returned: 0 in 0.329s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Acquiring lock "fb7280bd-7153-4868-b1c9-35cc77e96277" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.006s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG nova.compute.manager [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Cannot resize image /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Ensure instance console log exists: /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.387s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:32 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:17:32 user nova-compute[75356]: INFO nova.compute.claims [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Claim successful on node user
Nov 29 20:17:32 user nova-compute[75356]: DEBUG nova.network.neutron [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Successfully created port: 577e6509-523f-46e2-9994-9d1eb9ff0c13 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.366s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Successfully updated port: b400acb7-2f4f-45da-80f9-069c8cc27f45 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk 1073741824" returned: 0 in 0.127s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Acquiring lock "refresh_cache-ee4a5666-bfea-47bf-bd21-d24685967a3e" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Acquired lock "refresh_cache-ee4a5666-bfea-47bf-bd21-d24685967a3e" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.512s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.231s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:33 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Instance spawned successfully.
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Cannot resize image /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Ensure instance console log exists: /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.compute.manager [req-1e2f1eca-a2f1-4786-8e9d-333d05d23e84 req-371096bf-fd70-4c3b-869f-208570faed28 service nova] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Received event network-vif-plugged-cfb6a771-e8ce-43da-aebb-742cb2afdbcb {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1e2f1eca-a2f1-4786-8e9d-333d05d23e84 req-371096bf-fd70-4c3b-869f-208570faed28 service nova] Acquiring lock "972e22c1-bd85-4507-9166-ace3fce8e698-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1e2f1eca-a2f1-4786-8e9d-333d05d23e84 req-371096bf-fd70-4c3b-869f-208570faed28 service nova] Lock "972e22c1-bd85-4507-9166-ace3fce8e698-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1e2f1eca-a2f1-4786-8e9d-333d05d23e84 req-371096bf-fd70-4c3b-869f-208570faed28 service nova] Lock "972e22c1-bd85-4507-9166-ace3fce8e698-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.compute.manager [req-1e2f1eca-a2f1-4786-8e9d-333d05d23e84 req-371096bf-fd70-4c3b-869f-208570faed28 service nova] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] No waiting events found dispatching network-vif-plugged-cfb6a771-e8ce-43da-aebb-742cb2afdbcb {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:17:33 user nova-compute[75356]: WARNING nova.compute.manager [req-1e2f1eca-a2f1-4786-8e9d-333d05d23e84 req-371096bf-fd70-4c3b-869f-208570faed28 service nova] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Received unexpected event network-vif-plugged-cfb6a771-e8ce-43da-aebb-742cb2afdbcb for instance with vm_state building and task_state spawning.
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.compute.manager [req-1e2f1eca-a2f1-4786-8e9d-333d05d23e84 req-371096bf-fd70-4c3b-869f-208570faed28 service nova] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Received event network-changed-b400acb7-2f4f-45da-80f9-069c8cc27f45 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.compute.manager [req-1e2f1eca-a2f1-4786-8e9d-333d05d23e84 req-371096bf-fd70-4c3b-869f-208570faed28 service nova] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Refreshing instance network info cache due to event network-changed-b400acb7-2f4f-45da-80f9-069c8cc27f45. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1e2f1eca-a2f1-4786-8e9d-333d05d23e84 req-371096bf-fd70-4c3b-869f-208570faed28 service nova] Acquiring lock "refresh_cache-ee4a5666-bfea-47bf-bd21-d24685967a3e" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.898s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.compute.manager [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.network.neutron [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Successfully updated port: 577e6509-523f-46e2-9994-9d1eb9ff0c13 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Acquiring lock "refresh_cache-3d1a8bb2-82f9-4a3f-aeff-a5472477d651" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Acquired lock "refresh_cache-3d1a8bb2-82f9-4a3f-aeff-a5472477d651" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.network.neutron [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:17:33 user nova-compute[75356]: INFO nova.compute.manager [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Took 10.77 seconds to spawn the instance on the hypervisor.
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.compute.manager [req-11dca4d5-186a-4a1b-baac-cab2cb1240a4 req-31b284fa-3511-4bf2-90ae-af98eb2ee7dc service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Received event network-changed-577e6509-523f-46e2-9994-9d1eb9ff0c13 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.compute.manager [req-11dca4d5-186a-4a1b-baac-cab2cb1240a4 req-31b284fa-3511-4bf2-90ae-af98eb2ee7dc service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Refreshing instance network info cache due to event network-changed-577e6509-523f-46e2-9994-9d1eb9ff0c13. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-11dca4d5-186a-4a1b-baac-cab2cb1240a4 req-31b284fa-3511-4bf2-90ae-af98eb2ee7dc service nova] Acquiring lock "refresh_cache-3d1a8bb2-82f9-4a3f-aeff-a5472477d651" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.compute.manager [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.network.neutron [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.network.neutron [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:17:33 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:17:33 user nova-compute[75356]: DEBUG nova.compute.manager [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.policy [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9cfe06906d3b40849bfc37aba8222636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4965cd9c0823424d9e7dd283d7f7b210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:17:34 user nova-compute[75356]: INFO nova.compute.manager [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Took 12.38 seconds to build instance.
Nov 29 20:17:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5272a92d-8fbe-4438-95df-db1a345d1d18 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "972e22c1-bd85-4507-9166-ace3fce8e698" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.818s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.compute.manager [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:17:34 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Creating image(s)
Nov 29 20:17:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "/opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "/opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.network.neutron [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Updating instance_info_cache with network_info: [{"id": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "address": "fa:16:3e:34:be:70", "network": {"id": "fe921eef-0c3b-459b-b302-b879394d578b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-572349767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577e6509-52", "ovs_interfaceid": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Updating instance_info_cache with network_info: [{"id": "b400acb7-2f4f-45da-80f9-069c8cc27f45", "address": "fa:16:3e:87:5a:bf", "network": {"id": "6712a3cd-234a-421e-9d18-5d1e28708025", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-371973715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ffd2755d0a4059aef77a33d42c29d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb400acb7-2f", "ovs_interfaceid": "b400acb7-2f4f-45da-80f9-069c8cc27f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Releasing lock "refresh_cache-ee4a5666-bfea-47bf-bd21-d24685967a3e" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Instance network_info: |[{"id": "b400acb7-2f4f-45da-80f9-069c8cc27f45", "address": "fa:16:3e:87:5a:bf", "network": {"id": "6712a3cd-234a-421e-9d18-5d1e28708025", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-371973715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ffd2755d0a4059aef77a33d42c29d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb400acb7-2f", "ovs_interfaceid": "b400acb7-2f4f-45da-80f9-069c8cc27f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1e2f1eca-a2f1-4786-8e9d-333d05d23e84 req-371096bf-fd70-4c3b-869f-208570faed28 service nova] Acquired lock "refresh_cache-ee4a5666-bfea-47bf-bd21-d24685967a3e" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.network.neutron [req-1e2f1eca-a2f1-4786-8e9d-333d05d23e84 req-371096bf-fd70-4c3b-869f-208570faed28 service nova] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Refreshing network info cache for port b400acb7-2f4f-45da-80f9-069c8cc27f45 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Start _get_guest_xml network_info=[{"id": "b400acb7-2f4f-45da-80f9-069c8cc27f45", "address": "fa:16:3e:87:5a:bf", "network": {"id": "6712a3cd-234a-421e-9d18-5d1e28708025", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-371973715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ffd2755d0a4059aef77a33d42c29d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb400acb7-2f", "ovs_interfaceid": "b400acb7-2f4f-45da-80f9-069c8cc27f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:17:18Z,direct_url=<?>,disk_format='qcow2',id=d60f5b9d-5836-45d5-a727-2af5402148d9,min_disk=0,min_ram=0,name='',owner='45d320425afc4452961bc2d9916d4539',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:17:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'scsi', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/sda', 'encryption_format': None, 'image_id': 'd60f5b9d-5836-45d5-a727-2af5402148d9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:17:34 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:34 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Releasing lock "refresh_cache-3d1a8bb2-82f9-4a3f-aeff-a5472477d651" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.compute.manager [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Instance network_info: |[{"id": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "address": "fa:16:3e:34:be:70", "network": {"id": "fe921eef-0c3b-459b-b302-b879394d578b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-572349767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577e6509-52", "ovs_interfaceid": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-11dca4d5-186a-4a1b-baac-cab2cb1240a4 req-31b284fa-3511-4bf2-90ae-af98eb2ee7dc service nova] Acquired lock "refresh_cache-3d1a8bb2-82f9-4a3f-aeff-a5472477d651" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.network.neutron [req-11dca4d5-186a-4a1b-baac-cab2cb1240a4 req-31b284fa-3511-4bf2-90ae-af98eb2ee7dc service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Refreshing network info cache for port 577e6509-523f-46e2-9994-9d1eb9ff0c13 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Start _get_guest_xml network_info=[{"id": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "address": "fa:16:3e:34:be:70", "network": {"id": "fe921eef-0c3b-459b-b302-b879394d578b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-572349767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577e6509-52", "ovs_interfaceid": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:17:18Z,direct_url=<?>,disk_format='qcow2',id=d60f5b9d-5836-45d5-a727-2af5402148d9,min_disk=0,min_ram=0,name='',owner='45d320425afc4452961bc2d9916d4539',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:17:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:17:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-258501228',display_name='tempest-AttachSCSIVolumeTestJSON-server-258501228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-258501228',id=7,image_ref='d60f5b9d-5836-45d5-a727-2af5402148d9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBABTFvJmVZEqNIYLENnYf5SjeZAVZykkBfrEigmhsx7Hx6GI9666iHudVkf8kmZwQgprOLiXO4idW2ldOm6y1DVez9txK3UPgMTwQqKsR1oHnsXAloPNaaL17B5OGWFlg==',key_name='tempest-keypair-1468309686',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5ffd2755d0a4059aef77a33d42c29d5',ramdisk_id='',reservation_id='r-dp0g4r0k',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d60f5b9d-5836-45d5-a727-2af5402148d9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1102272910',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1102272910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:17:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8507e047b776409da86c2613319c75bf',uuid=ee4a5666-bfea-47bf-bd21-d24685967a3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b400acb7-2f4f-45da-80f9-069c8cc27f45", "address": "fa:16:3e:87:5a:bf", "network": {"id": "6712a3cd-234a-421e-9d18-5d1e28708025", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-371973715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ffd2755d0a4059aef77a33d42c29d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb400acb7-2f", "ovs_interfaceid": "b400acb7-2f4f-45da-80f9-069c8cc27f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Converting VIF {"id": "b400acb7-2f4f-45da-80f9-069c8cc27f45", "address": "fa:16:3e:87:5a:bf", "network": {"id": "6712a3cd-234a-421e-9d18-5d1e28708025", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-371973715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ffd2755d0a4059aef77a33d42c29d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb400acb7-2f", "ovs_interfaceid": "b400acb7-2f4f-45da-80f9-069c8cc27f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:5a:bf,bridge_name='br-int',has_traffic_filtering=True,id=b400acb7-2f4f-45da-80f9-069c8cc27f45,network=Network(6712a3cd-234a-421e-9d18-5d1e28708025),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb400acb7-2f') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.objects.instance [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lazy-loading 'pci_devices' on Instance uuid ee4a5666-bfea-47bf-bd21-d24685967a3e {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.325s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:17:34 user nova-compute[75356]:   <uuid>ee4a5666-bfea-47bf-bd21-d24685967a3e</uuid>
Nov 29 20:17:34 user nova-compute[75356]:   <name>instance-00000007</name>
Nov 29 20:17:34 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:17:34 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:17:34 user nova-compute[75356]:   <metadata>
Nov 29 20:17:34 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:17:34 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:17:34 user nova-compute[75356]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-258501228</nova:name>
Nov 29 20:17:34 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:17:34</nova:creationTime>
Nov 29 20:17:34 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:17:34 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:17:34 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:17:34 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:17:34 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:17:34 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:17:34 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:17:34 user nova-compute[75356]:       <nova:owner>
Nov 29 20:17:34 user nova-compute[75356]:         <nova:user uuid="8507e047b776409da86c2613319c75bf">tempest-AttachSCSIVolumeTestJSON-1102272910-project-member</nova:user>
Nov 29 20:17:34 user nova-compute[75356]:         <nova:project uuid="b5ffd2755d0a4059aef77a33d42c29d5">tempest-AttachSCSIVolumeTestJSON-1102272910</nova:project>
Nov 29 20:17:34 user nova-compute[75356]:       </nova:owner>
Nov 29 20:17:34 user nova-compute[75356]:       <nova:root type="image" uuid="d60f5b9d-5836-45d5-a727-2af5402148d9"/>
Nov 29 20:17:34 user nova-compute[75356]:       <nova:ports>
Nov 29 20:17:34 user nova-compute[75356]:         <nova:port uuid="b400acb7-2f4f-45da-80f9-069c8cc27f45">
Nov 29 20:17:34 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 20:17:34 user nova-compute[75356]:         </nova:port>
Nov 29 20:17:34 user nova-compute[75356]:       </nova:ports>
Nov 29 20:17:34 user nova-compute[75356]:     </nova:instance>
Nov 29 20:17:34 user nova-compute[75356]:   </metadata>
Nov 29 20:17:34 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:17:34 user nova-compute[75356]:     <system>
Nov 29 20:17:34 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:17:34 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:17:34 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:17:34 user nova-compute[75356]:       <entry name="serial">ee4a5666-bfea-47bf-bd21-d24685967a3e</entry>
Nov 29 20:17:34 user nova-compute[75356]:       <entry name="uuid">ee4a5666-bfea-47bf-bd21-d24685967a3e</entry>
Nov 29 20:17:34 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:17:34 user nova-compute[75356]:     </system>
Nov 29 20:17:34 user nova-compute[75356]:   </sysinfo>
Nov 29 20:17:34 user nova-compute[75356]:   <os>
Nov 29 20:17:34 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:17:34 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:17:34 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:17:34 user nova-compute[75356]:   </os>
Nov 29 20:17:34 user nova-compute[75356]:   <features>
Nov 29 20:17:34 user nova-compute[75356]:     <acpi/>
Nov 29 20:17:34 user nova-compute[75356]:     <apic/>
Nov 29 20:17:34 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:17:34 user nova-compute[75356]:   </features>
Nov 29 20:17:34 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:17:34 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:17:34 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:17:34 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:17:34 user nova-compute[75356]:   </clock>
Nov 29 20:17:34 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:17:34 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:17:34 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:17:34 user nova-compute[75356]:   </cpu>
Nov 29 20:17:34 user nova-compute[75356]:   <devices>
Nov 29 20:17:34 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:17:34 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:17:34 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk"/>
Nov 29 20:17:34 user nova-compute[75356]:       <target dev="sda" bus="scsi"/>
Nov 29 20:17:34 user nova-compute[75356]:       <address type="drive" controller="0" unit="0"/>
Nov 29 20:17:34 user nova-compute[75356]:     </disk>
Nov 29 20:17:34 user nova-compute[75356]:     <disk type="file" device="cdrom">
Nov 29 20:17:34 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 20:17:34 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk.config"/>
Nov 29 20:17:34 user nova-compute[75356]:       <target dev="sdb" bus="scsi"/>
Nov 29 20:17:34 user nova-compute[75356]:       <address type="drive" controller="0" unit="1"/>
Nov 29 20:17:34 user nova-compute[75356]:     </disk>
Nov 29 20:17:34 user nova-compute[75356]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 29 20:17:34 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:17:34 user nova-compute[75356]:       <mac address="fa:16:3e:87:5a:bf"/>
Nov 29 20:17:34 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:17:34 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:17:34 user nova-compute[75356]:       <target dev="tapb400acb7-2f"/>
Nov 29 20:17:34 user nova-compute[75356]:     </interface>
Nov 29 20:17:34 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:17:34 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/console.log" append="off"/>
Nov 29 20:17:34 user nova-compute[75356]:     </serial>
Nov 29 20:17:34 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:17:34 user nova-compute[75356]:     <video>
Nov 29 20:17:34 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:17:34 user nova-compute[75356]:     </video>
Nov 29 20:17:34 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:17:34 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:17:34 user nova-compute[75356]:     </rng>
Nov 29 20:17:34 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:17:34 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:17:34 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:17:34 user nova-compute[75356]:     </memballoon>
Nov 29 20:17:34 user nova-compute[75356]:   </devices>
Nov 29 20:17:34 user nova-compute[75356]: </domain>
Nov 29 20:17:34 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:17:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-258501228',display_name='tempest-AttachSCSIVolumeTestJSON-server-258501228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-258501228',id=7,image_ref='d60f5b9d-5836-45d5-a727-2af5402148d9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBABTFvJmVZEqNIYLENnYf5SjeZAVZykkBfrEigmhsx7Hx6GI9666iHudVkf8kmZwQgprOLiXO4idW2ldOm6y1DVez9txK3UPgMTwQqKsR1oHnsXAloPNaaL17B5OGWFlg==',key_name='tempest-keypair-1468309686',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5ffd2755d0a4059aef77a33d42c29d5',ramdisk_id='',reservation_id='r-dp0g4r0k',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d60f5b9d-5836-45d5-a727-2af5402148d9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1102272910',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1102272910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:17:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8507e047b776409da86c2613319c75bf',uuid=ee4a5666-bfea-47bf-bd21-d24685967a3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b400acb7-2f4f-45da-80f9-069c8cc27f45", "address": "fa:16:3e:87:5a:bf", "network": {"id": "6712a3cd-234a-421e-9d18-5d1e28708025", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-371973715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ffd2755d0a4059aef77a33d42c29d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb400acb7-2f", "ovs_interfaceid": "b400acb7-2f4f-45da-80f9-069c8cc27f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Converting VIF {"id": "b400acb7-2f4f-45da-80f9-069c8cc27f45", "address": "fa:16:3e:87:5a:bf", "network": {"id": "6712a3cd-234a-421e-9d18-5d1e28708025", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-371973715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ffd2755d0a4059aef77a33d42c29d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb400acb7-2f", "ovs_interfaceid": "b400acb7-2f4f-45da-80f9-069c8cc27f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:5a:bf,bridge_name='br-int',has_traffic_filtering=True,id=b400acb7-2f4f-45da-80f9-069c8cc27f45,network=Network(6712a3cd-234a-421e-9d18-5d1e28708025),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb400acb7-2f') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG os_vif [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:5a:bf,bridge_name='br-int',has_traffic_filtering=True,id=b400acb7-2f4f-45da-80f9-069c8cc27f45,network=Network(6712a3cd-234a-421e-9d18-5d1e28708025),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb400acb7-2f') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:17:34 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:34 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32b3028b-b0ff-5f11-b2d6-6baedae0c91c', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb400acb7-2f, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb400acb7-2f, col_values=(('qos', UUID('8e36bfd0-1636-41b6-b59b-e7e6f9263610')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb400acb7-2f, col_values=(('external_ids', {'iface-id': 'b400acb7-2f4f-45da-80f9-069c8cc27f45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:5a:bf', 'vm-uuid': 'ee4a5666-bfea-47bf-bd21-d24685967a3e'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2087794140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2087794140',id=8,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMcSB5W90J44Qo16Oh0Cpy3jhi4X0540/9A+XafSyfNEzKrqoj4TuajJuNFlGXhbGXb/O9kxaBhSAt46g/kgqUtmOKqWshX+iOmBJWeort/VCkacPfcnj7JuOcU0rQEdQ==',key_name='tempest-keypair-504121784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='076d6fb1d7e1485f847881bd7fe665f3',ramdisk_id='',reservation_id='r-8hmccieq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-75465737',owner_user_name='tempest-TaggedAttachmentsTest-75465737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:17:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5b4a48f9bfd406cae779bfc3dc5e302',uuid=3d1a8bb2-82f9-4a3f-aeff-a5472477d651,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "address": "fa:16:3e:34:be:70", "network": {"id": "fe921eef-0c3b-459b-b302-b879394d578b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-572349767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577e6509-52", "ovs_interfaceid": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Converting VIF {"id": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "address": "fa:16:3e:34:be:70", "network": {"id": "fe921eef-0c3b-459b-b302-b879394d578b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-572349767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577e6509-52", "ovs_interfaceid": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:be:70,bridge_name='br-int',has_traffic_filtering=True,id=577e6509-523f-46e2-9994-9d1eb9ff0c13,network=Network(fe921eef-0c3b-459b-b302-b879394d578b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap577e6509-52') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.objects.instance [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:34 user nova-compute[75356]: INFO os_vif [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:5a:bf,bridge_name='br-int',has_traffic_filtering=True,id=b400acb7-2f4f-45da-80f9-069c8cc27f45,network=Network(6712a3cd-234a-421e-9d18-5d1e28708025),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb400acb7-2f')
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:17:34 user nova-compute[75356]:   <uuid>3d1a8bb2-82f9-4a3f-aeff-a5472477d651</uuid>
Nov 29 20:17:34 user nova-compute[75356]:   <name>instance-00000008</name>
Nov 29 20:17:34 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:17:34 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:17:34 user nova-compute[75356]:   <metadata>
Nov 29 20:17:34 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:17:34 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:17:34 user nova-compute[75356]:       <nova:name>tempest-device-tagging-server-2087794140</nova:name>
Nov 29 20:17:34 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:17:34</nova:creationTime>
Nov 29 20:17:34 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:17:34 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:17:34 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:17:34 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:17:34 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:17:34 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:17:34 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:17:34 user nova-compute[75356]:       <nova:owner>
Nov 29 20:17:34 user nova-compute[75356]:         <nova:user uuid="e5b4a48f9bfd406cae779bfc3dc5e302">tempest-TaggedAttachmentsTest-75465737-project-member</nova:user>
Nov 29 20:17:34 user nova-compute[75356]:         <nova:project uuid="076d6fb1d7e1485f847881bd7fe665f3">tempest-TaggedAttachmentsTest-75465737</nova:project>
Nov 29 20:17:34 user nova-compute[75356]:       </nova:owner>
Nov 29 20:17:34 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:17:34 user nova-compute[75356]:       <nova:ports>
Nov 29 20:17:34 user nova-compute[75356]:         <nova:port uuid="577e6509-523f-46e2-9994-9d1eb9ff0c13">
Nov 29 20:17:34 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 20:17:34 user nova-compute[75356]:         </nova:port>
Nov 29 20:17:34 user nova-compute[75356]:       </nova:ports>
Nov 29 20:17:34 user nova-compute[75356]:     </nova:instance>
Nov 29 20:17:34 user nova-compute[75356]:   </metadata>
Nov 29 20:17:34 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:17:34 user nova-compute[75356]:     <system>
Nov 29 20:17:34 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:17:34 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:17:34 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:17:34 user nova-compute[75356]:       <entry name="serial">3d1a8bb2-82f9-4a3f-aeff-a5472477d651</entry>
Nov 29 20:17:34 user nova-compute[75356]:       <entry name="uuid">3d1a8bb2-82f9-4a3f-aeff-a5472477d651</entry>
Nov 29 20:17:34 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:17:34 user nova-compute[75356]:     </system>
Nov 29 20:17:34 user nova-compute[75356]:   </sysinfo>
Nov 29 20:17:34 user nova-compute[75356]:   <os>
Nov 29 20:17:34 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:17:34 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:17:34 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:17:34 user nova-compute[75356]:   </os>
Nov 29 20:17:34 user nova-compute[75356]:   <features>
Nov 29 20:17:34 user nova-compute[75356]:     <acpi/>
Nov 29 20:17:34 user nova-compute[75356]:     <apic/>
Nov 29 20:17:34 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:17:34 user nova-compute[75356]:   </features>
Nov 29 20:17:34 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:17:34 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:17:34 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:17:34 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:17:34 user nova-compute[75356]:   </clock>
Nov 29 20:17:34 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:17:34 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:17:34 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:17:34 user nova-compute[75356]:   </cpu>
Nov 29 20:17:34 user nova-compute[75356]:   <devices>
Nov 29 20:17:34 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:17:34 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:17:34 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk"/>
Nov 29 20:17:34 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:17:34 user nova-compute[75356]:     </disk>
Nov 29 20:17:34 user nova-compute[75356]:     <disk type="file" device="cdrom">
Nov 29 20:17:34 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 20:17:34 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk.config"/>
Nov 29 20:17:34 user nova-compute[75356]:       <target dev="hda" bus="ide"/>
Nov 29 20:17:34 user nova-compute[75356]:     </disk>
Nov 29 20:17:34 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:17:34 user nova-compute[75356]:       <mac address="fa:16:3e:34:be:70"/>
Nov 29 20:17:34 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:17:34 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:17:34 user nova-compute[75356]:       <target dev="tap577e6509-52"/>
Nov 29 20:17:34 user nova-compute[75356]:     </interface>
Nov 29 20:17:34 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:17:34 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/console.log" append="off"/>
Nov 29 20:17:34 user nova-compute[75356]:     </serial>
Nov 29 20:17:34 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:17:34 user nova-compute[75356]:     <video>
Nov 29 20:17:34 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:17:34 user nova-compute[75356]:     </video>
Nov 29 20:17:34 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:17:34 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:17:34 user nova-compute[75356]:     </rng>
Nov 29 20:17:34 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:17:34 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:17:34 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:17:34 user nova-compute[75356]:     </memballoon>
Nov 29 20:17:34 user nova-compute[75356]:   </devices>
Nov 29 20:17:34 user nova-compute[75356]: </domain>
Nov 29 20:17:34 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2087794140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2087794140',id=8,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMcSB5W90J44Qo16Oh0Cpy3jhi4X0540/9A+XafSyfNEzKrqoj4TuajJuNFlGXhbGXb/O9kxaBhSAt46g/kgqUtmOKqWshX+iOmBJWeort/VCkacPfcnj7JuOcU0rQEdQ==',key_name='tempest-keypair-504121784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='076d6fb1d7e1485f847881bd7fe665f3',ramdisk_id='',reservation_id='r-8hmccieq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-75465737',owner_user_name='tempest-TaggedAttachmentsTest-75465737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:17:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5b4a48f9bfd406cae779bfc3dc5e302',uuid=3d1a8bb2-82f9-4a3f-aeff-a5472477d651,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "address": "fa:16:3e:34:be:70", "network": {"id": "fe921eef-0c3b-459b-b302-b879394d578b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-572349767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577e6509-52", "ovs_interfaceid": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Converting VIF {"id": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "address": "fa:16:3e:34:be:70", "network": {"id": "fe921eef-0c3b-459b-b302-b879394d578b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-572349767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577e6509-52", "ovs_interfaceid": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:be:70,bridge_name='br-int',has_traffic_filtering=True,id=577e6509-523f-46e2-9994-9d1eb9ff0c13,network=Network(fe921eef-0c3b-459b-b302-b879394d578b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap577e6509-52') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG os_vif [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:be:70,bridge_name='br-int',has_traffic_filtering=True,id=577e6509-523f-46e2-9994-9d1eb9ff0c13,network=Network(fe921eef-0c3b-459b-b302-b879394d578b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap577e6509-52') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a521aa2f-6ceb-5ca7-9c09-100883fe2ea9', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap577e6509-52, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap577e6509-52, col_values=(('qos', UUID('0aa92398-6676-4e1a-9a4b-2f9e41fd3338')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap577e6509-52, col_values=(('external_ids', {'iface-id': '577e6509-523f-46e2-9994-9d1eb9ff0c13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:be:70', 'vm-uuid': '3d1a8bb2-82f9-4a3f-aeff-a5472477d651'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.275s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:34 user nova-compute[75356]: INFO os_vif [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:be:70,bridge_name='br-int',has_traffic_filtering=True,id=577e6509-523f-46e2-9994-9d1eb9ff0c13,network=Network(fe921eef-0c3b-459b-b302-b879394d578b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap577e6509-52')
Nov 29 20:17:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk 1073741824" returned: 0 in 0.219s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.497s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] No BDM found with device name sda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] No VIF found with MAC fa:16:3e:87:5a:bf, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:17:35 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Using config drive
Nov 29 20:17:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] No BDM found with device name hda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] No VIF found with MAC fa:16:3e:34:be:70, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:17:35 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Using config drive
Nov 29 20:17:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.239s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG nova.network.neutron [req-1e2f1eca-a2f1-4786-8e9d-333d05d23e84 req-371096bf-fd70-4c3b-869f-208570faed28 service nova] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Updated VIF entry in instance network info cache for port b400acb7-2f4f-45da-80f9-069c8cc27f45. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG nova.network.neutron [req-1e2f1eca-a2f1-4786-8e9d-333d05d23e84 req-371096bf-fd70-4c3b-869f-208570faed28 service nova] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Updating instance_info_cache with network_info: [{"id": "b400acb7-2f4f-45da-80f9-069c8cc27f45", "address": "fa:16:3e:87:5a:bf", "network": {"id": "6712a3cd-234a-421e-9d18-5d1e28708025", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-371973715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ffd2755d0a4059aef77a33d42c29d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb400acb7-2f", "ovs_interfaceid": "b400acb7-2f4f-45da-80f9-069c8cc27f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1e2f1eca-a2f1-4786-8e9d-333d05d23e84 req-371096bf-fd70-4c3b-869f-208570faed28 service nova] Releasing lock "refresh_cache-ee4a5666-bfea-47bf-bd21-d24685967a3e" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG nova.network.neutron [req-11dca4d5-186a-4a1b-baac-cab2cb1240a4 req-31b284fa-3511-4bf2-90ae-af98eb2ee7dc service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Updated VIF entry in instance network info cache for port 577e6509-523f-46e2-9994-9d1eb9ff0c13. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG nova.network.neutron [req-11dca4d5-186a-4a1b-baac-cab2cb1240a4 req-31b284fa-3511-4bf2-90ae-af98eb2ee7dc service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Updating instance_info_cache with network_info: [{"id": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "address": "fa:16:3e:34:be:70", "network": {"id": "fe921eef-0c3b-459b-b302-b879394d578b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-572349767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577e6509-52", "ovs_interfaceid": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-11dca4d5-186a-4a1b-baac-cab2cb1240a4 req-31b284fa-3511-4bf2-90ae-af98eb2ee7dc service nova] Releasing lock "refresh_cache-3d1a8bb2-82f9-4a3f-aeff-a5472477d651" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Cannot resize image /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Ensure instance console log exists: /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:35 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Creating config drive at /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk.config
Nov 29 20:17:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsmgz08k5 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:35 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Creating config drive at /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk.config
Nov 29 20:17:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn_x_yn8k {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsmgz08k5" returned: 0 in 0.097s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn_x_yn8k" returned: 0 in 0.057s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:35 user nova-compute[75356]: DEBUG nova.network.neutron [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Successfully created port: 14000a37-7834-4054-8a54-331e7d5d9d7b {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:17:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:38 user nova-compute[75356]: DEBUG nova.network.neutron [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Successfully updated port: 14000a37-7834-4054-8a54-331e7d5d9d7b {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:17:38 user nova-compute[75356]: DEBUG nova.compute.manager [req-3140ad92-0fc0-488a-9c5e-48d27c330cd2 req-91f0dc0f-4fa8-403b-8fc0-e961ee6abf23 service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Received event network-changed-14000a37-7834-4054-8a54-331e7d5d9d7b {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:38 user nova-compute[75356]: DEBUG nova.compute.manager [req-3140ad92-0fc0-488a-9c5e-48d27c330cd2 req-91f0dc0f-4fa8-403b-8fc0-e961ee6abf23 service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Refreshing instance network info cache due to event network-changed-14000a37-7834-4054-8a54-331e7d5d9d7b. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:17:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3140ad92-0fc0-488a-9c5e-48d27c330cd2 req-91f0dc0f-4fa8-403b-8fc0-e961ee6abf23 service nova] Acquiring lock "refresh_cache-fb7280bd-7153-4868-b1c9-35cc77e96277" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:17:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3140ad92-0fc0-488a-9c5e-48d27c330cd2 req-91f0dc0f-4fa8-403b-8fc0-e961ee6abf23 service nova] Acquired lock "refresh_cache-fb7280bd-7153-4868-b1c9-35cc77e96277" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:17:38 user nova-compute[75356]: DEBUG nova.network.neutron [req-3140ad92-0fc0-488a-9c5e-48d27c330cd2 req-91f0dc0f-4fa8-403b-8fc0-e961ee6abf23 service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Refreshing network info cache for port 14000a37-7834-4054-8a54-331e7d5d9d7b {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:17:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Acquiring lock "refresh_cache-fb7280bd-7153-4868-b1c9-35cc77e96277" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:17:38 user nova-compute[75356]: DEBUG nova.network.neutron [req-3140ad92-0fc0-488a-9c5e-48d27c330cd2 req-91f0dc0f-4fa8-403b-8fc0-e961ee6abf23 service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:17:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Acquiring lock "f09171b0-1615-49ee-8c66-8b9c4f0af591" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Lock "f09171b0-1615-49ee-8c66-8b9c4f0af591" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:38 user nova-compute[75356]: DEBUG nova.compute.manager [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:17:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:38 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:17:38 user nova-compute[75356]: INFO nova.compute.claims [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Claim successful on node user
Nov 29 20:17:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.network.neutron [req-3140ad92-0fc0-488a-9c5e-48d27c330cd2 req-91f0dc0f-4fa8-403b-8fc0-e961ee6abf23 service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3140ad92-0fc0-488a-9c5e-48d27c330cd2 req-91f0dc0f-4fa8-403b-8fc0-e961ee6abf23 service nova] Releasing lock "refresh_cache-fb7280bd-7153-4868-b1c9-35cc77e96277" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Acquired lock "refresh_cache-fb7280bd-7153-4868-b1c9-35cc77e96277" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.network.neutron [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.network.neutron [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.compute.manager [req-e2d7e413-0208-40b9-b40c-dfd662a5671c req-5d2c9f6c-753d-4624-8d97-fba1864fa830 service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Received event network-vif-plugged-577e6509-523f-46e2-9994-9d1eb9ff0c13 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e2d7e413-0208-40b9-b40c-dfd662a5671c req-5d2c9f6c-753d-4624-8d97-fba1864fa830 service nova] Acquiring lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e2d7e413-0208-40b9-b40c-dfd662a5671c req-5d2c9f6c-753d-4624-8d97-fba1864fa830 service nova] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e2d7e413-0208-40b9-b40c-dfd662a5671c req-5d2c9f6c-753d-4624-8d97-fba1864fa830 service nova] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.compute.manager [req-e2d7e413-0208-40b9-b40c-dfd662a5671c req-5d2c9f6c-753d-4624-8d97-fba1864fa830 service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] No waiting events found dispatching network-vif-plugged-577e6509-523f-46e2-9994-9d1eb9ff0c13 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:17:39 user nova-compute[75356]: WARNING nova.compute.manager [req-e2d7e413-0208-40b9-b40c-dfd662a5671c req-5d2c9f6c-753d-4624-8d97-fba1864fa830 service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Received unexpected event network-vif-plugged-577e6509-523f-46e2-9994-9d1eb9ff0c13 for instance with vm_state building and task_state spawning.
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.network.neutron [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Updating instance_info_cache with network_info: [{"id": "14000a37-7834-4054-8a54-331e7d5d9d7b", "address": "fa:16:3e:36:54:40", "network": {"id": "c577b91d-6b91-44ff-b28f-40bc465b16b5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2092872784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4965cd9c0823424d9e7dd283d7f7b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14000a37-78", "ovs_interfaceid": "14000a37-7834-4054-8a54-331e7d5d9d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.779s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.compute.manager [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Releasing lock "refresh_cache-fb7280bd-7153-4868-b1c9-35cc77e96277" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.compute.manager [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Instance network_info: |[{"id": "14000a37-7834-4054-8a54-331e7d5d9d7b", "address": "fa:16:3e:36:54:40", "network": {"id": "c577b91d-6b91-44ff-b28f-40bc465b16b5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2092872784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4965cd9c0823424d9e7dd283d7f7b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14000a37-78", "ovs_interfaceid": "14000a37-7834-4054-8a54-331e7d5d9d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Start _get_guest_xml network_info=[{"id": "14000a37-7834-4054-8a54-331e7d5d9d7b", "address": "fa:16:3e:36:54:40", "network": {"id": "c577b91d-6b91-44ff-b28f-40bc465b16b5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2092872784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4965cd9c0823424d9e7dd283d7f7b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14000a37-78", "ovs_interfaceid": "14000a37-7834-4054-8a54-331e7d5d9d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:39 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:39 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.compute.manager [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.network.neutron [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1098333332',display_name='tempest-TestVolumeSwap-server-1098333332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1098333332',id=9,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG5ceNtdkGPD4EGF6iljLg0XeFPVMEtWrgNZnw/qTXeLBAEoYqA5r82GXdU5mIM33szpNzH2mA8AsD/5kYPJuCV6o0fy9VCwW2fGO3kRG34iYBdlAvyjOrsbfYxYXpaDw==',key_name='tempest-keypair-1085431435',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4965cd9c0823424d9e7dd283d7f7b210',ramdisk_id='',reservation_id='r-3fspgp5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1405815801',owner_user_name='tempest-TestVolumeSwap-1405815801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:17:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cfe06906d3b40849bfc37aba8222636',uuid=fb7280bd-7153-4868-b1c9-35cc77e96277,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14000a37-7834-4054-8a54-331e7d5d9d7b", "address": "fa:16:3e:36:54:40", "network": {"id": "c577b91d-6b91-44ff-b28f-40bc465b16b5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2092872784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4965cd9c0823424d9e7dd283d7f7b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14000a37-78", "ovs_interfaceid": "14000a37-7834-4054-8a54-331e7d5d9d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Converting VIF {"id": "14000a37-7834-4054-8a54-331e7d5d9d7b", "address": "fa:16:3e:36:54:40", "network": {"id": "c577b91d-6b91-44ff-b28f-40bc465b16b5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2092872784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4965cd9c0823424d9e7dd283d7f7b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14000a37-78", "ovs_interfaceid": "14000a37-7834-4054-8a54-331e7d5d9d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:54:40,bridge_name='br-int',has_traffic_filtering=True,id=14000a37-7834-4054-8a54-331e7d5d9d7b,network=Network(c577b91d-6b91-44ff-b28f-40bc465b16b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14000a37-78') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.objects.instance [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lazy-loading 'pci_devices' on Instance uuid fb7280bd-7153-4868-b1c9-35cc77e96277 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:17:39 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:17:39 user nova-compute[75356]:   <uuid>fb7280bd-7153-4868-b1c9-35cc77e96277</uuid>
Nov 29 20:17:39 user nova-compute[75356]:   <name>instance-00000009</name>
Nov 29 20:17:39 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:17:39 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:17:39 user nova-compute[75356]:   <metadata>
Nov 29 20:17:39 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:17:39 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:17:39 user nova-compute[75356]:       <nova:name>tempest-TestVolumeSwap-server-1098333332</nova:name>
Nov 29 20:17:39 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:17:39</nova:creationTime>
Nov 29 20:17:39 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:17:39 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:17:39 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:17:39 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:17:39 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:17:39 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:17:39 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:17:39 user nova-compute[75356]:       <nova:owner>
Nov 29 20:17:39 user nova-compute[75356]:         <nova:user uuid="9cfe06906d3b40849bfc37aba8222636">tempest-TestVolumeSwap-1405815801-project-member</nova:user>
Nov 29 20:17:39 user nova-compute[75356]:         <nova:project uuid="4965cd9c0823424d9e7dd283d7f7b210">tempest-TestVolumeSwap-1405815801</nova:project>
Nov 29 20:17:39 user nova-compute[75356]:       </nova:owner>
Nov 29 20:17:39 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:17:39 user nova-compute[75356]:       <nova:ports>
Nov 29 20:17:39 user nova-compute[75356]:         <nova:port uuid="14000a37-7834-4054-8a54-331e7d5d9d7b">
Nov 29 20:17:39 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 20:17:39 user nova-compute[75356]:         </nova:port>
Nov 29 20:17:39 user nova-compute[75356]:       </nova:ports>
Nov 29 20:17:39 user nova-compute[75356]:     </nova:instance>
Nov 29 20:17:39 user nova-compute[75356]:   </metadata>
Nov 29 20:17:39 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:17:39 user nova-compute[75356]:     <system>
Nov 29 20:17:39 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:17:39 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:17:39 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:17:39 user nova-compute[75356]:       <entry name="serial">fb7280bd-7153-4868-b1c9-35cc77e96277</entry>
Nov 29 20:17:39 user nova-compute[75356]:       <entry name="uuid">fb7280bd-7153-4868-b1c9-35cc77e96277</entry>
Nov 29 20:17:39 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:17:39 user nova-compute[75356]:     </system>
Nov 29 20:17:39 user nova-compute[75356]:   </sysinfo>
Nov 29 20:17:39 user nova-compute[75356]:   <os>
Nov 29 20:17:39 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:17:39 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:17:39 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:17:39 user nova-compute[75356]:   </os>
Nov 29 20:17:39 user nova-compute[75356]:   <features>
Nov 29 20:17:39 user nova-compute[75356]:     <acpi/>
Nov 29 20:17:39 user nova-compute[75356]:     <apic/>
Nov 29 20:17:39 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:17:39 user nova-compute[75356]:   </features>
Nov 29 20:17:39 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:17:39 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:17:39 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:17:39 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:17:39 user nova-compute[75356]:   </clock>
Nov 29 20:17:39 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:17:39 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:17:39 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:17:39 user nova-compute[75356]:   </cpu>
Nov 29 20:17:39 user nova-compute[75356]:   <devices>
Nov 29 20:17:39 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:17:39 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:17:39 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk"/>
Nov 29 20:17:39 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:17:39 user nova-compute[75356]:     </disk>
Nov 29 20:17:39 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:17:39 user nova-compute[75356]:       <mac address="fa:16:3e:36:54:40"/>
Nov 29 20:17:39 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:17:39 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:17:39 user nova-compute[75356]:       <target dev="tap14000a37-78"/>
Nov 29 20:17:39 user nova-compute[75356]:     </interface>
Nov 29 20:17:39 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:17:39 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/console.log" append="off"/>
Nov 29 20:17:39 user nova-compute[75356]:     </serial>
Nov 29 20:17:39 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:17:39 user nova-compute[75356]:     <video>
Nov 29 20:17:39 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:17:39 user nova-compute[75356]:     </video>
Nov 29 20:17:39 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:17:39 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:17:39 user nova-compute[75356]:     </rng>
Nov 29 20:17:39 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:17:39 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:17:39 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:17:39 user nova-compute[75356]:     </memballoon>
Nov 29 20:17:39 user nova-compute[75356]:   </devices>
Nov 29 20:17:39 user nova-compute[75356]: </domain>
Nov 29 20:17:39 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1098333332',display_name='tempest-TestVolumeSwap-server-1098333332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1098333332',id=9,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG5ceNtdkGPD4EGF6iljLg0XeFPVMEtWrgNZnw/qTXeLBAEoYqA5r82GXdU5mIM33szpNzH2mA8AsD/5kYPJuCV6o0fy9VCwW2fGO3kRG34iYBdlAvyjOrsbfYxYXpaDw==',key_name='tempest-keypair-1085431435',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4965cd9c0823424d9e7dd283d7f7b210',ramdisk_id='',reservation_id='r-3fspgp5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1405815801',owner_user_name='tempest-TestVolumeSwap-1405815801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:17:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cfe06906d3b40849bfc37aba8222636',uuid=fb7280bd-7153-4868-b1c9-35cc77e96277,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14000a37-7834-4054-8a54-331e7d5d9d7b", "address": "fa:16:3e:36:54:40", "network": {"id": "c577b91d-6b91-44ff-b28f-40bc465b16b5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2092872784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4965cd9c0823424d9e7dd283d7f7b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14000a37-78", "ovs_interfaceid": "14000a37-7834-4054-8a54-331e7d5d9d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Converting VIF {"id": "14000a37-7834-4054-8a54-331e7d5d9d7b", "address": "fa:16:3e:36:54:40", "network": {"id": "c577b91d-6b91-44ff-b28f-40bc465b16b5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2092872784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4965cd9c0823424d9e7dd283d7f7b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14000a37-78", "ovs_interfaceid": "14000a37-7834-4054-8a54-331e7d5d9d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:54:40,bridge_name='br-int',has_traffic_filtering=True,id=14000a37-7834-4054-8a54-331e7d5d9d7b,network=Network(c577b91d-6b91-44ff-b28f-40bc465b16b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14000a37-78') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG os_vif [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:54:40,bridge_name='br-int',has_traffic_filtering=True,id=14000a37-7834-4054-8a54-331e7d5d9d7b,network=Network(c577b91d-6b91-44ff-b28f-40bc465b16b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14000a37-78') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af97e857-7dd6-568b-83cd-c8454d5863d0', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.policy [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1e3ea854abf4278936b6fdf1d517761', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de78788d21744bcb173947de904ed69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14000a37-78, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap14000a37-78, col_values=(('qos', UUID('f6b3c407-7da6-466c-b415-6ef753a553ab')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap14000a37-78, col_values=(('external_ids', {'iface-id': '14000a37-7834-4054-8a54-331e7d5d9d7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:54:40', 'vm-uuid': 'fb7280bd-7153-4868-b1c9-35cc77e96277'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:39 user nova-compute[75356]: INFO os_vif [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:54:40,bridge_name='br-int',has_traffic_filtering=True,id=14000a37-7834-4054-8a54-331e7d5d9d7b,network=Network(c577b91d-6b91-44ff-b28f-40bc465b16b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14000a37-78')
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.compute.manager [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:17:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] No VIF found with MAC fa:16:3e:36:54:40, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:17:40 user nova-compute[75356]: DEBUG nova.compute.manager [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:17:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:17:40 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Creating image(s)
Nov 29 20:17:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Acquiring lock "/opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Lock "/opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Lock "/opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.207s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.196s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/disk 1073741824" returned: 0 in 0.228s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.430s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:40 user nova-compute[75356]: DEBUG nova.network.neutron [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Successfully created port: 924ed0c8-9079-4837-b3bb-4ec2e2c6e359 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:17:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.249s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:40 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:17:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Cannot resize image /opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Ensure instance console log exists: /opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG nova.network.neutron [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Successfully updated port: 924ed0c8-9079-4837-b3bb-4ec2e2c6e359 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Acquiring lock "refresh_cache-f09171b0-1615-49ee-8c66-8b9c4f0af591" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Acquired lock "refresh_cache-f09171b0-1615-49ee-8c66-8b9c4f0af591" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG nova.network.neutron [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG nova.compute.manager [req-441bbd17-360a-40dd-b2e0-9d51ea53fb41 req-0de5e1e7-0457-41da-b489-e99ddaeb9270 service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Received event network-changed-924ed0c8-9079-4837-b3bb-4ec2e2c6e359 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG nova.compute.manager [req-441bbd17-360a-40dd-b2e0-9d51ea53fb41 req-0de5e1e7-0457-41da-b489-e99ddaeb9270 service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Refreshing instance network info cache due to event network-changed-924ed0c8-9079-4837-b3bb-4ec2e2c6e359. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-441bbd17-360a-40dd-b2e0-9d51ea53fb41 req-0de5e1e7-0457-41da-b489-e99ddaeb9270 service nova] Acquiring lock "refresh_cache-f09171b0-1615-49ee-8c66-8b9c4f0af591" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG nova.compute.manager [req-6ce1d629-b87f-45ed-8526-ad68fb7b893d req-4e6d7d81-25af-4f4f-8248-f0546d7a480b service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Received event network-vif-plugged-577e6509-523f-46e2-9994-9d1eb9ff0c13 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6ce1d629-b87f-45ed-8526-ad68fb7b893d req-4e6d7d81-25af-4f4f-8248-f0546d7a480b service nova] Acquiring lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6ce1d629-b87f-45ed-8526-ad68fb7b893d req-4e6d7d81-25af-4f4f-8248-f0546d7a480b service nova] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6ce1d629-b87f-45ed-8526-ad68fb7b893d req-4e6d7d81-25af-4f4f-8248-f0546d7a480b service nova] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG nova.compute.manager [req-6ce1d629-b87f-45ed-8526-ad68fb7b893d req-4e6d7d81-25af-4f4f-8248-f0546d7a480b service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] No waiting events found dispatching network-vif-plugged-577e6509-523f-46e2-9994-9d1eb9ff0c13 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:17:41 user nova-compute[75356]: WARNING nova.compute.manager [req-6ce1d629-b87f-45ed-8526-ad68fb7b893d req-4e6d7d81-25af-4f4f-8248-f0546d7a480b service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Received unexpected event network-vif-plugged-577e6509-523f-46e2-9994-9d1eb9ff0c13 for instance with vm_state building and task_state spawning.
Nov 29 20:17:41 user nova-compute[75356]: DEBUG nova.network.neutron [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG nova.compute.manager [req-2b1f2073-9962-4f44-853f-c82925950f72 req-db59ece9-2854-435f-b8b5-7f78ee08e09b service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Received event network-vif-plugged-14000a37-7834-4054-8a54-331e7d5d9d7b {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2b1f2073-9962-4f44-853f-c82925950f72 req-db59ece9-2854-435f-b8b5-7f78ee08e09b service nova] Acquiring lock "fb7280bd-7153-4868-b1c9-35cc77e96277-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2b1f2073-9962-4f44-853f-c82925950f72 req-db59ece9-2854-435f-b8b5-7f78ee08e09b service nova] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2b1f2073-9962-4f44-853f-c82925950f72 req-db59ece9-2854-435f-b8b5-7f78ee08e09b service nova] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG nova.compute.manager [req-2b1f2073-9962-4f44-853f-c82925950f72 req-db59ece9-2854-435f-b8b5-7f78ee08e09b service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] No waiting events found dispatching network-vif-plugged-14000a37-7834-4054-8a54-331e7d5d9d7b {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:17:41 user nova-compute[75356]: WARNING nova.compute.manager [req-2b1f2073-9962-4f44-853f-c82925950f72 req-db59ece9-2854-435f-b8b5-7f78ee08e09b service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Received unexpected event network-vif-plugged-14000a37-7834-4054-8a54-331e7d5d9d7b for instance with vm_state building and task_state spawning.
Nov 29 20:17:41 user nova-compute[75356]: DEBUG nova.network.neutron [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Updating instance_info_cache with network_info: [{"id": "924ed0c8-9079-4837-b3bb-4ec2e2c6e359", "address": "fa:16:3e:bb:ea:02", "network": {"id": "945008af-d620-4459-95c8-9aa9515d0718", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1884938817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de78788d21744bcb173947de904ed69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924ed0c8-90", "ovs_interfaceid": "924ed0c8-9079-4837-b3bb-4ec2e2c6e359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Releasing lock "refresh_cache-f09171b0-1615-49ee-8c66-8b9c4f0af591" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG nova.compute.manager [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Instance network_info: |[{"id": "924ed0c8-9079-4837-b3bb-4ec2e2c6e359", "address": "fa:16:3e:bb:ea:02", "network": {"id": "945008af-d620-4459-95c8-9aa9515d0718", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1884938817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de78788d21744bcb173947de904ed69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924ed0c8-90", "ovs_interfaceid": "924ed0c8-9079-4837-b3bb-4ec2e2c6e359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-441bbd17-360a-40dd-b2e0-9d51ea53fb41 req-0de5e1e7-0457-41da-b489-e99ddaeb9270 service nova] Acquired lock "refresh_cache-f09171b0-1615-49ee-8c66-8b9c4f0af591" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG nova.network.neutron [req-441bbd17-360a-40dd-b2e0-9d51ea53fb41 req-0de5e1e7-0457-41da-b489-e99ddaeb9270 service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Refreshing network info cache for port 924ed0c8-9079-4837-b3bb-4ec2e2c6e359 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:17:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Start _get_guest_xml network_info=[{"id": "924ed0c8-9079-4837-b3bb-4ec2e2c6e359", "address": "fa:16:3e:bb:ea:02", "network": {"id": "945008af-d620-4459-95c8-9aa9515d0718", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1884938817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de78788d21744bcb173947de904ed69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924ed0c8-90", "ovs_interfaceid": "924ed0c8-9079-4837-b3bb-4ec2e2c6e359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:17:42 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:42 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-329021864',display_name='tempest-VolumesAssistedSnapshotsTest-server-329021864',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-329021864',id=10,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpuZoeGEW+qKdJdr8AkjZHp5veDLJA3Za8BVlHjlGgrjB2ViXm3QRdZwInTpguMp9iZPBYrpjupk0MVMrxMqg57xO2s2KYEVmANOF/1iGyA3qw8cy8dzeQ/4M/uPIuJyw==',key_name='tempest-keypair-766467664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8de78788d21744bcb173947de904ed69',ramdisk_id='',reservation_id='r-4y5zse10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-423101085',owner_user_name='tempest-VolumesAssistedSnapshotsTest-423101085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:17:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1e3ea854abf4278936b6fdf1d517761',uuid=f09171b0-1615-49ee-8c66-8b9c4f0af591,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "924ed0c8-9079-4837-b3bb-4ec2e2c6e359", "address": "fa:16:3e:bb:ea:02", "network": {"id": "945008af-d620-4459-95c8-9aa9515d0718", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1884938817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de78788d21744bcb173947de904ed69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924ed0c8-90", "ovs_interfaceid": "924ed0c8-9079-4837-b3bb-4ec2e2c6e359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Converting VIF {"id": "924ed0c8-9079-4837-b3bb-4ec2e2c6e359", "address": "fa:16:3e:bb:ea:02", "network": {"id": "945008af-d620-4459-95c8-9aa9515d0718", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1884938817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de78788d21744bcb173947de904ed69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924ed0c8-90", "ovs_interfaceid": "924ed0c8-9079-4837-b3bb-4ec2e2c6e359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:ea:02,bridge_name='br-int',has_traffic_filtering=True,id=924ed0c8-9079-4837-b3bb-4ec2e2c6e359,network=Network(945008af-d620-4459-95c8-9aa9515d0718),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924ed0c8-90') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.objects.instance [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Lazy-loading 'pci_devices' on Instance uuid f09171b0-1615-49ee-8c66-8b9c4f0af591 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:17:42 user nova-compute[75356]:   <uuid>f09171b0-1615-49ee-8c66-8b9c4f0af591</uuid>
Nov 29 20:17:42 user nova-compute[75356]:   <name>instance-0000000a</name>
Nov 29 20:17:42 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:17:42 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:17:42 user nova-compute[75356]:   <metadata>
Nov 29 20:17:42 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:17:42 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:17:42 user nova-compute[75356]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-329021864</nova:name>
Nov 29 20:17:42 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:17:42</nova:creationTime>
Nov 29 20:17:42 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:17:42 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:17:42 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:17:42 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:17:42 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:17:42 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:17:42 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:17:42 user nova-compute[75356]:       <nova:owner>
Nov 29 20:17:42 user nova-compute[75356]:         <nova:user uuid="e1e3ea854abf4278936b6fdf1d517761">tempest-VolumesAssistedSnapshotsTest-423101085-project-member</nova:user>
Nov 29 20:17:42 user nova-compute[75356]:         <nova:project uuid="8de78788d21744bcb173947de904ed69">tempest-VolumesAssistedSnapshotsTest-423101085</nova:project>
Nov 29 20:17:42 user nova-compute[75356]:       </nova:owner>
Nov 29 20:17:42 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:17:42 user nova-compute[75356]:       <nova:ports>
Nov 29 20:17:42 user nova-compute[75356]:         <nova:port uuid="924ed0c8-9079-4837-b3bb-4ec2e2c6e359">
Nov 29 20:17:42 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 20:17:42 user nova-compute[75356]:         </nova:port>
Nov 29 20:17:42 user nova-compute[75356]:       </nova:ports>
Nov 29 20:17:42 user nova-compute[75356]:     </nova:instance>
Nov 29 20:17:42 user nova-compute[75356]:   </metadata>
Nov 29 20:17:42 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:17:42 user nova-compute[75356]:     <system>
Nov 29 20:17:42 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:17:42 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:17:42 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:17:42 user nova-compute[75356]:       <entry name="serial">f09171b0-1615-49ee-8c66-8b9c4f0af591</entry>
Nov 29 20:17:42 user nova-compute[75356]:       <entry name="uuid">f09171b0-1615-49ee-8c66-8b9c4f0af591</entry>
Nov 29 20:17:42 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:17:42 user nova-compute[75356]:     </system>
Nov 29 20:17:42 user nova-compute[75356]:   </sysinfo>
Nov 29 20:17:42 user nova-compute[75356]:   <os>
Nov 29 20:17:42 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:17:42 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:17:42 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:17:42 user nova-compute[75356]:   </os>
Nov 29 20:17:42 user nova-compute[75356]:   <features>
Nov 29 20:17:42 user nova-compute[75356]:     <acpi/>
Nov 29 20:17:42 user nova-compute[75356]:     <apic/>
Nov 29 20:17:42 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:17:42 user nova-compute[75356]:   </features>
Nov 29 20:17:42 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:17:42 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:17:42 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:17:42 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:17:42 user nova-compute[75356]:   </clock>
Nov 29 20:17:42 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:17:42 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:17:42 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:17:42 user nova-compute[75356]:   </cpu>
Nov 29 20:17:42 user nova-compute[75356]:   <devices>
Nov 29 20:17:42 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:17:42 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:17:42 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/disk"/>
Nov 29 20:17:42 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:17:42 user nova-compute[75356]:     </disk>
Nov 29 20:17:42 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:17:42 user nova-compute[75356]:       <mac address="fa:16:3e:bb:ea:02"/>
Nov 29 20:17:42 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:17:42 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:17:42 user nova-compute[75356]:       <target dev="tap924ed0c8-90"/>
Nov 29 20:17:42 user nova-compute[75356]:     </interface>
Nov 29 20:17:42 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:17:42 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/console.log" append="off"/>
Nov 29 20:17:42 user nova-compute[75356]:     </serial>
Nov 29 20:17:42 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:17:42 user nova-compute[75356]:     <video>
Nov 29 20:17:42 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:17:42 user nova-compute[75356]:     </video>
Nov 29 20:17:42 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:17:42 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:17:42 user nova-compute[75356]:     </rng>
Nov 29 20:17:42 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:17:42 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:17:42 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:17:42 user nova-compute[75356]:     </memballoon>
Nov 29 20:17:42 user nova-compute[75356]:   </devices>
Nov 29 20:17:42 user nova-compute[75356]: </domain>
Nov 29 20:17:42 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-329021864',display_name='tempest-VolumesAssistedSnapshotsTest-server-329021864',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-329021864',id=10,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpuZoeGEW+qKdJdr8AkjZHp5veDLJA3Za8BVlHjlGgrjB2ViXm3QRdZwInTpguMp9iZPBYrpjupk0MVMrxMqg57xO2s2KYEVmANOF/1iGyA3qw8cy8dzeQ/4M/uPIuJyw==',key_name='tempest-keypair-766467664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8de78788d21744bcb173947de904ed69',ramdisk_id='',reservation_id='r-4y5zse10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-423101085',owner_user_name='tempest-VolumesAssistedSnapshotsTest-423101085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:17:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1e3ea854abf4278936b6fdf1d517761',uuid=f09171b0-1615-49ee-8c66-8b9c4f0af591,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "924ed0c8-9079-4837-b3bb-4ec2e2c6e359", "address": "fa:16:3e:bb:ea:02", "network": {"id": "945008af-d620-4459-95c8-9aa9515d0718", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1884938817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de78788d21744bcb173947de904ed69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924ed0c8-90", "ovs_interfaceid": "924ed0c8-9079-4837-b3bb-4ec2e2c6e359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Converting VIF {"id": "924ed0c8-9079-4837-b3bb-4ec2e2c6e359", "address": "fa:16:3e:bb:ea:02", "network": {"id": "945008af-d620-4459-95c8-9aa9515d0718", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1884938817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de78788d21744bcb173947de904ed69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924ed0c8-90", "ovs_interfaceid": "924ed0c8-9079-4837-b3bb-4ec2e2c6e359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:ea:02,bridge_name='br-int',has_traffic_filtering=True,id=924ed0c8-9079-4837-b3bb-4ec2e2c6e359,network=Network(945008af-d620-4459-95c8-9aa9515d0718),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924ed0c8-90') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG os_vif [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:ea:02,bridge_name='br-int',has_traffic_filtering=True,id=924ed0c8-9079-4837-b3bb-4ec2e2c6e359,network=Network(945008af-d620-4459-95c8-9aa9515d0718),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924ed0c8-90') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf21ba17-6dad-5530-ba39-3b712fc2c0c3', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap924ed0c8-90, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap924ed0c8-90, col_values=(('qos', UUID('742c8aba-a828-4069-b8b5-8106d30ccda0')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap924ed0c8-90, col_values=(('external_ids', {'iface-id': '924ed0c8-9079-4837-b3bb-4ec2e2c6e359', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:ea:02', 'vm-uuid': 'f09171b0-1615-49ee-8c66-8b9c4f0af591'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:42 user nova-compute[75356]: INFO os_vif [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:ea:02,bridge_name='br-int',has_traffic_filtering=True,id=924ed0c8-9079-4837-b3bb-4ec2e2c6e359,network=Network(945008af-d620-4459-95c8-9aa9515d0718),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924ed0c8-90')
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] No VIF found with MAC fa:16:3e:bb:ea:02, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.network.neutron [req-441bbd17-360a-40dd-b2e0-9d51ea53fb41 req-0de5e1e7-0457-41da-b489-e99ddaeb9270 service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Updated VIF entry in instance network info cache for port 924ed0c8-9079-4837-b3bb-4ec2e2c6e359. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG nova.network.neutron [req-441bbd17-360a-40dd-b2e0-9d51ea53fb41 req-0de5e1e7-0457-41da-b489-e99ddaeb9270 service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Updating instance_info_cache with network_info: [{"id": "924ed0c8-9079-4837-b3bb-4ec2e2c6e359", "address": "fa:16:3e:bb:ea:02", "network": {"id": "945008af-d620-4459-95c8-9aa9515d0718", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1884938817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de78788d21744bcb173947de904ed69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924ed0c8-90", "ovs_interfaceid": "924ed0c8-9079-4837-b3bb-4ec2e2c6e359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:17:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-441bbd17-360a-40dd-b2e0-9d51ea53fb41 req-0de5e1e7-0457-41da-b489-e99ddaeb9270 service nova] Releasing lock "refresh_cache-f09171b0-1615-49ee-8c66-8b9c4f0af591" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:17:43 user nova-compute[75356]: DEBUG nova.compute.manager [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:17:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:17:43 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Instance spawned successfully.
Nov 29 20:17:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:17:43 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:17:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:17:43 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Instance spawned successfully.
Nov 29 20:17:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:17:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:43 user nova-compute[75356]: INFO nova.compute.manager [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Took 13.79 seconds to spawn the instance on the hypervisor.
Nov 29 20:17:43 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:17:43 user nova-compute[75356]: INFO nova.compute.manager [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Took 11.26 seconds to spawn the instance on the hypervisor.
Nov 29 20:17:43 user nova-compute[75356]: DEBUG nova.compute.manager [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:17:43 user nova-compute[75356]: INFO nova.compute.manager [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Took 15.01 seconds to build instance.
Nov 29 20:17:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca5fb1e7-76fd-450b-b06d-68a90c5650c6 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "ee4a5666-bfea-47bf-bd21-d24685967a3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.243s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:43 user nova-compute[75356]: INFO nova.compute.manager [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Took 13.90 seconds to build instance.
Nov 29 20:17:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7cda1122-5fa8-4764-8f42-2439ba921f06 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.082s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-e701dc60-75b2-4f36-bfe4-b5fb43e33f19 req-c6f881ac-84af-4a3c-9f97-3164ba2bf45a service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Received event network-vif-plugged-14000a37-7834-4054-8a54-331e7d5d9d7b {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e701dc60-75b2-4f36-bfe4-b5fb43e33f19 req-c6f881ac-84af-4a3c-9f97-3164ba2bf45a service nova] Acquiring lock "fb7280bd-7153-4868-b1c9-35cc77e96277-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e701dc60-75b2-4f36-bfe4-b5fb43e33f19 req-c6f881ac-84af-4a3c-9f97-3164ba2bf45a service nova] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e701dc60-75b2-4f36-bfe4-b5fb43e33f19 req-c6f881ac-84af-4a3c-9f97-3164ba2bf45a service nova] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-e701dc60-75b2-4f36-bfe4-b5fb43e33f19 req-c6f881ac-84af-4a3c-9f97-3164ba2bf45a service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] No waiting events found dispatching network-vif-plugged-14000a37-7834-4054-8a54-331e7d5d9d7b {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:17:43 user nova-compute[75356]: WARNING nova.compute.manager [req-e701dc60-75b2-4f36-bfe4-b5fb43e33f19 req-c6f881ac-84af-4a3c-9f97-3164ba2bf45a service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Received unexpected event network-vif-plugged-14000a37-7834-4054-8a54-331e7d5d9d7b for instance with vm_state building and task_state spawning.
Nov 29 20:17:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:44 user nova-compute[75356]: DEBUG nova.compute.manager [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:17:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:17:44 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Instance spawned successfully.
Nov 29 20:17:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:17:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:44 user nova-compute[75356]: INFO nova.compute.manager [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Took 10.48 seconds to spawn the instance on the hypervisor.
Nov 29 20:17:44 user nova-compute[75356]: DEBUG nova.compute.manager [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:17:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:44 user nova-compute[75356]: INFO nova.compute.manager [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Took 12.09 seconds to build instance.
Nov 29 20:17:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e22b2f43-8ec4-4aaf-bb43-b113770a215e tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.471s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:45 user nova-compute[75356]: DEBUG nova.compute.manager [req-c1d94695-e6a8-4e70-a4f1-f7cc4045bab9 req-01e3008b-029f-4db3-8261-3fccab8300d1 service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Received event network-vif-plugged-924ed0c8-9079-4837-b3bb-4ec2e2c6e359 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c1d94695-e6a8-4e70-a4f1-f7cc4045bab9 req-01e3008b-029f-4db3-8261-3fccab8300d1 service nova] Acquiring lock "f09171b0-1615-49ee-8c66-8b9c4f0af591-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c1d94695-e6a8-4e70-a4f1-f7cc4045bab9 req-01e3008b-029f-4db3-8261-3fccab8300d1 service nova] Lock "f09171b0-1615-49ee-8c66-8b9c4f0af591-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c1d94695-e6a8-4e70-a4f1-f7cc4045bab9 req-01e3008b-029f-4db3-8261-3fccab8300d1 service nova] Lock "f09171b0-1615-49ee-8c66-8b9c4f0af591-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:45 user nova-compute[75356]: DEBUG nova.compute.manager [req-c1d94695-e6a8-4e70-a4f1-f7cc4045bab9 req-01e3008b-029f-4db3-8261-3fccab8300d1 service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] No waiting events found dispatching network-vif-plugged-924ed0c8-9079-4837-b3bb-4ec2e2c6e359 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:17:45 user nova-compute[75356]: WARNING nova.compute.manager [req-c1d94695-e6a8-4e70-a4f1-f7cc4045bab9 req-01e3008b-029f-4db3-8261-3fccab8300d1 service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Received unexpected event network-vif-plugged-924ed0c8-9079-4837-b3bb-4ec2e2c6e359 for instance with vm_state building and task_state spawning.
Nov 29 20:17:45 user nova-compute[75356]: DEBUG nova.compute.manager [req-c1d94695-e6a8-4e70-a4f1-f7cc4045bab9 req-01e3008b-029f-4db3-8261-3fccab8300d1 service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Received event network-vif-plugged-924ed0c8-9079-4837-b3bb-4ec2e2c6e359 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c1d94695-e6a8-4e70-a4f1-f7cc4045bab9 req-01e3008b-029f-4db3-8261-3fccab8300d1 service nova] Acquiring lock "f09171b0-1615-49ee-8c66-8b9c4f0af591-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c1d94695-e6a8-4e70-a4f1-f7cc4045bab9 req-01e3008b-029f-4db3-8261-3fccab8300d1 service nova] Lock "f09171b0-1615-49ee-8c66-8b9c4f0af591-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c1d94695-e6a8-4e70-a4f1-f7cc4045bab9 req-01e3008b-029f-4db3-8261-3fccab8300d1 service nova] Lock "f09171b0-1615-49ee-8c66-8b9c4f0af591-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:45 user nova-compute[75356]: DEBUG nova.compute.manager [req-c1d94695-e6a8-4e70-a4f1-f7cc4045bab9 req-01e3008b-029f-4db3-8261-3fccab8300d1 service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] No waiting events found dispatching network-vif-plugged-924ed0c8-9079-4837-b3bb-4ec2e2c6e359 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:17:45 user nova-compute[75356]: WARNING nova.compute.manager [req-c1d94695-e6a8-4e70-a4f1-f7cc4045bab9 req-01e3008b-029f-4db3-8261-3fccab8300d1 service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Received unexpected event network-vif-plugged-924ed0c8-9079-4837-b3bb-4ec2e2c6e359 for instance with vm_state building and task_state spawning.
Nov 29 20:17:46 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:17:46 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Cleaning up deleted instances {{(pid=75356) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 20:17:46 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] There are 0 instances to clean {{(pid=75356) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 20:17:46 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:17:46 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75356) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 20:17:46 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:17:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:46 user nova-compute[75356]: DEBUG nova.compute.manager [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:17:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:17:47 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Instance spawned successfully.
Nov 29 20:17:47 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:17:47 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:47 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:47 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:47 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:47 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:47 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:17:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:47 user nova-compute[75356]: INFO nova.compute.manager [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Took 7.08 seconds to spawn the instance on the hypervisor.
Nov 29 20:17:47 user nova-compute[75356]: DEBUG nova.compute.manager [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:17:47 user nova-compute[75356]: INFO nova.compute.manager [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Took 8.56 seconds to build instance.
Nov 29 20:17:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1da7dd95-1976-4dd0-a021-d2e24881236f tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Lock "f09171b0-1615-49ee-8c66-8b9c4f0af591" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.712s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:48 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:17:48 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:17:49 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:17:49 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:17:49 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:17:50 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:17:50 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:17:50 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 20:17:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-8db40390-15ae-458b-92c9-7b3bb623ca50" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:17:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-8db40390-15ae-458b-92c9-7b3bb623ca50" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:17:50 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:17:50 user nova-compute[75356]: DEBUG nova.objects.instance [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lazy-loading 'info_cache' on Instance uuid 8db40390-15ae-458b-92c9-7b3bb623ca50 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:17:50 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Updating instance_info_cache with network_info: [{"id": "624866cb-b225-4a69-a62b-56d89ce17653", "address": "fa:16:3e:4f:06:83", "network": {"id": "7965cbec-9ba2-4bf6-b812-d82f8ebcd64a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-125869777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459348467eb445f2966cd9c21f69fc73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624866cb-b2", "ovs_interfaceid": "624866cb-b225-4a69-a62b-56d89ce17653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:17:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-8db40390-15ae-458b-92c9-7b3bb623ca50" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:17:51 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:17:51 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:17:51 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:17:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:51 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:17:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Acquiring lock "1e4d92bf-f8c0-45f8-ba80-48f17fefc108" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Lock "1e4d92bf-f8c0-45f8-ba80-48f17fefc108" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:17:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:53 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:17:53 user nova-compute[75356]: INFO nova.compute.claims [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Claim successful on node user
Nov 29 20:17:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:53 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:17:53 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:17:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.747s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:17:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:17:53 user nova-compute[75356]: DEBUG nova.network.neutron [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:17:53 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:17:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:17:54 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Creating image(s)
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e4d92bf-f8c0-45f8-ba80-48f17fefc108/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Lock "/opt/stack/data/nova/instances/1e4d92bf-f8c0-45f8-ba80-48f17fefc108/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Lock "/opt/stack/data/nova/instances/1e4d92bf-f8c0-45f8-ba80-48f17fefc108/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db40390-15ae-458b-92c9-7b3bb623ca50/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.218s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG nova.policy [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '726978311bd5459494b2e85e1efe833e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5552f4e7a54f9b98156f157ec4231c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db40390-15ae-458b-92c9-7b3bb623ca50/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db40390-15ae-458b-92c9-7b3bb623ca50/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.204s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/1e4d92bf-f8c0-45f8-ba80-48f17fefc108/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/1e4d92bf-f8c0-45f8-ba80-48f17fefc108/disk 1073741824" returned: 0 in 0.052s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db40390-15ae-458b-92c9-7b3bb623ca50/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.211s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e4d92bf-f8c0-45f8-ba80-48f17fefc108/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e4d92bf-f8c0-45f8-ba80-48f17fefc108/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e4d92bf-f8c0-45f8-ba80-48f17fefc108/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:55 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Cannot resize image /opt/stack/data/nova/instances/1e4d92bf-f8c0-45f8-ba80-48f17fefc108/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:17:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:17:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Ensure instance console log exists: /opt/stack/data/nova/instances/1e4d92bf-f8c0-45f8-ba80-48f17fefc108/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:17:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:55 user nova-compute[75356]: DEBUG nova.compute.manager [req-a146cd3c-dbbd-492a-b3d6-c1b811ef1ecd req-4cf23b63-ddbb-4f32-850a-dba3d56f9c86 service nova] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Received event network-vif-plugged-624866cb-b225-4a69-a62b-56d89ce17653 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a146cd3c-dbbd-492a-b3d6-c1b811ef1ecd req-4cf23b63-ddbb-4f32-850a-dba3d56f9c86 service nova] Acquiring lock "8db40390-15ae-458b-92c9-7b3bb623ca50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a146cd3c-dbbd-492a-b3d6-c1b811ef1ecd req-4cf23b63-ddbb-4f32-850a-dba3d56f9c86 service nova] Lock "8db40390-15ae-458b-92c9-7b3bb623ca50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a146cd3c-dbbd-492a-b3d6-c1b811ef1ecd req-4cf23b63-ddbb-4f32-850a-dba3d56f9c86 service nova] Lock "8db40390-15ae-458b-92c9-7b3bb623ca50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:55 user nova-compute[75356]: DEBUG nova.compute.manager [req-a146cd3c-dbbd-492a-b3d6-c1b811ef1ecd req-4cf23b63-ddbb-4f32-850a-dba3d56f9c86 service nova] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] No waiting events found dispatching network-vif-plugged-624866cb-b225-4a69-a62b-56d89ce17653 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:17:55 user nova-compute[75356]: WARNING nova.compute.manager [req-a146cd3c-dbbd-492a-b3d6-c1b811ef1ecd req-4cf23b63-ddbb-4f32-850a-dba3d56f9c86 service nova] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Received unexpected event network-vif-plugged-624866cb-b225-4a69-a62b-56d89ce17653 for instance with vm_state active and task_state None.
Nov 29 20:17:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:17:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:17:56 user nova-compute[75356]: DEBUG nova.network.neutron [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Successfully created port: d3cff2c2-9659-48c0-843b-09fb5dd4e2b4 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:17:56 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:56 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:56 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=7625MB free_disk=25.54602813720703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:17:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:56 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 8db40390-15ae-458b-92c9-7b3bb623ca50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:17:56 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 9751c435-4d10-46dc-86e7-39d40e8209d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:17:56 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0b59517a-c467-432a-a73a-d1460c1574e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:17:56 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:17:56 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 96cbbbdb-e1cc-49da-9a9f-5b83031b235b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:17:56 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 972e22c1-bd85-4507-9166-ace3fce8e698 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:17:56 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ee4a5666-bfea-47bf-bd21-d24685967a3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:17:56 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:17:56 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance fb7280bd-7153-4868-b1c9-35cc77e96277 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:17:56 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance f09171b0-1615-49ee-8c66-8b9c4f0af591 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:17:56 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 1e4d92bf-f8c0-45f8-ba80-48f17fefc108 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:17:56 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:17:56 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:17:56 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing inventories for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 20:17:56 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Updating ProviderTree inventory for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 20:17:56 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Updating inventory in ProviderTree for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 20:17:56 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing aggregate associations for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a, aggregates: None {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 20:17:56 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing trait associations for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.071s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.network.neutron [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Successfully updated port: d3cff2c2-9659-48c0-843b-09fb5dd4e2b4 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.compute.manager [req-3f1d6ead-227c-4866-be6d-9886577ea347 req-2ba741ee-c374-4715-9d0d-891270d8761a service nova] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Received event network-vif-plugged-624866cb-b225-4a69-a62b-56d89ce17653 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3f1d6ead-227c-4866-be6d-9886577ea347 req-2ba741ee-c374-4715-9d0d-891270d8761a service nova] Acquiring lock "8db40390-15ae-458b-92c9-7b3bb623ca50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3f1d6ead-227c-4866-be6d-9886577ea347 req-2ba741ee-c374-4715-9d0d-891270d8761a service nova] Lock "8db40390-15ae-458b-92c9-7b3bb623ca50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3f1d6ead-227c-4866-be6d-9886577ea347 req-2ba741ee-c374-4715-9d0d-891270d8761a service nova] Lock "8db40390-15ae-458b-92c9-7b3bb623ca50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.compute.manager [req-3f1d6ead-227c-4866-be6d-9886577ea347 req-2ba741ee-c374-4715-9d0d-891270d8761a service nova] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] No waiting events found dispatching network-vif-plugged-624866cb-b225-4a69-a62b-56d89ce17653 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:17:57 user nova-compute[75356]: WARNING nova.compute.manager [req-3f1d6ead-227c-4866-be6d-9886577ea347 req-2ba741ee-c374-4715-9d0d-891270d8761a service nova] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Received unexpected event network-vif-plugged-624866cb-b225-4a69-a62b-56d89ce17653 for instance with vm_state active and task_state None.
Nov 29 20:17:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Acquiring lock "refresh_cache-1e4d92bf-f8c0-45f8-ba80-48f17fefc108" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Acquired lock "refresh_cache-1e4d92bf-f8c0-45f8-ba80-48f17fefc108" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.network.neutron [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.network.neutron [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.network.neutron [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Updating instance_info_cache with network_info: [{"id": "d3cff2c2-9659-48c0-843b-09fb5dd4e2b4", "address": "fa:16:3e:76:1e:55", "network": {"id": "c9ca57f1-f027-4505-9561-7d70df8ae387", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85354408285b41f9a373abccf0e04f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3cff2c2-96", "ovs_interfaceid": "d3cff2c2-9659-48c0-843b-09fb5dd4e2b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Releasing lock "refresh_cache-1e4d92bf-f8c0-45f8-ba80-48f17fefc108" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Instance network_info: |[{"id": "d3cff2c2-9659-48c0-843b-09fb5dd4e2b4", "address": "fa:16:3e:76:1e:55", "network": {"id": "c9ca57f1-f027-4505-9561-7d70df8ae387", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85354408285b41f9a373abccf0e04f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3cff2c2-96", "ovs_interfaceid": "d3cff2c2-9659-48c0-843b-09fb5dd4e2b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Start _get_guest_xml network_info=[{"id": "d3cff2c2-9659-48c0-843b-09fb5dd4e2b4", "address": "fa:16:3e:76:1e:55", "network": {"id": "c9ca57f1-f027-4505-9561-7d70df8ae387", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85354408285b41f9a373abccf0e04f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3cff2c2-96", "ovs_interfaceid": "d3cff2c2-9659-48c0-843b-09fb5dd4e2b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:17:57 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:57 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1608374642',display_name='tempest-VolumesNegativeTest-instance-1608374642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1608374642',id=11,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b5552f4e7a54f9b98156f157ec4231c',ramdisk_id='',reservation_id='r-k8gzgxf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-98419257',owner_user_name='tempest-VolumesNegativeTest-98419257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:17:54Z,user_data=None,user_id='726978311bd5459494b2e85e1efe833e',uuid=1e4d92bf-f8c0-45f8-ba80-48f17fefc108,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3cff2c2-9659-48c0-843b-09fb5dd4e2b4", "address": "fa:16:3e:76:1e:55", "network": {"id": "c9ca57f1-f027-4505-9561-7d70df8ae387", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85354408285b41f9a373abccf0e04f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3cff2c2-96", "ovs_interfaceid": "d3cff2c2-9659-48c0-843b-09fb5dd4e2b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Converting VIF {"id": "d3cff2c2-9659-48c0-843b-09fb5dd4e2b4", "address": "fa:16:3e:76:1e:55", "network": {"id": "c9ca57f1-f027-4505-9561-7d70df8ae387", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85354408285b41f9a373abccf0e04f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3cff2c2-96", "ovs_interfaceid": "d3cff2c2-9659-48c0-843b-09fb5dd4e2b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:1e:55,bridge_name='br-int',has_traffic_filtering=True,id=d3cff2c2-9659-48c0-843b-09fb5dd4e2b4,network=Network(c9ca57f1-f027-4505-9561-7d70df8ae387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3cff2c2-96') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.objects.instance [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e4d92bf-f8c0-45f8-ba80-48f17fefc108 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:17:57 user nova-compute[75356]:   <uuid>1e4d92bf-f8c0-45f8-ba80-48f17fefc108</uuid>
Nov 29 20:17:57 user nova-compute[75356]:   <name>instance-0000000b</name>
Nov 29 20:17:57 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:17:57 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:17:57 user nova-compute[75356]:   <metadata>
Nov 29 20:17:57 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:17:57 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:17:57 user nova-compute[75356]:       <nova:name>tempest-VolumesNegativeTest-instance-1608374642</nova:name>
Nov 29 20:17:57 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:17:57</nova:creationTime>
Nov 29 20:17:57 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:17:57 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:17:57 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:17:57 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:17:57 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:17:57 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:17:57 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:17:57 user nova-compute[75356]:       <nova:owner>
Nov 29 20:17:57 user nova-compute[75356]:         <nova:user uuid="726978311bd5459494b2e85e1efe833e">tempest-VolumesNegativeTest-98419257-project-member</nova:user>
Nov 29 20:17:57 user nova-compute[75356]:         <nova:project uuid="0b5552f4e7a54f9b98156f157ec4231c">tempest-VolumesNegativeTest-98419257</nova:project>
Nov 29 20:17:57 user nova-compute[75356]:       </nova:owner>
Nov 29 20:17:57 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:17:57 user nova-compute[75356]:       <nova:ports>
Nov 29 20:17:57 user nova-compute[75356]:         <nova:port uuid="d3cff2c2-9659-48c0-843b-09fb5dd4e2b4">
Nov 29 20:17:57 user nova-compute[75356]:           <nova:ip type="fixed" address="192.168.233.206" ipVersion="4"/>
Nov 29 20:17:57 user nova-compute[75356]:         </nova:port>
Nov 29 20:17:57 user nova-compute[75356]:       </nova:ports>
Nov 29 20:17:57 user nova-compute[75356]:     </nova:instance>
Nov 29 20:17:57 user nova-compute[75356]:   </metadata>
Nov 29 20:17:57 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:17:57 user nova-compute[75356]:     <system>
Nov 29 20:17:57 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:17:57 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:17:57 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:17:57 user nova-compute[75356]:       <entry name="serial">1e4d92bf-f8c0-45f8-ba80-48f17fefc108</entry>
Nov 29 20:17:57 user nova-compute[75356]:       <entry name="uuid">1e4d92bf-f8c0-45f8-ba80-48f17fefc108</entry>
Nov 29 20:17:57 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:17:57 user nova-compute[75356]:     </system>
Nov 29 20:17:57 user nova-compute[75356]:   </sysinfo>
Nov 29 20:17:57 user nova-compute[75356]:   <os>
Nov 29 20:17:57 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:17:57 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:17:57 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:17:57 user nova-compute[75356]:   </os>
Nov 29 20:17:57 user nova-compute[75356]:   <features>
Nov 29 20:17:57 user nova-compute[75356]:     <acpi/>
Nov 29 20:17:57 user nova-compute[75356]:     <apic/>
Nov 29 20:17:57 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:17:57 user nova-compute[75356]:   </features>
Nov 29 20:17:57 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:17:57 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:17:57 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:17:57 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:17:57 user nova-compute[75356]:   </clock>
Nov 29 20:17:57 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:17:57 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:17:57 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:17:57 user nova-compute[75356]:   </cpu>
Nov 29 20:17:57 user nova-compute[75356]:   <devices>
Nov 29 20:17:57 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:17:57 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:17:57 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/1e4d92bf-f8c0-45f8-ba80-48f17fefc108/disk"/>
Nov 29 20:17:57 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:17:57 user nova-compute[75356]:     </disk>
Nov 29 20:17:57 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:17:57 user nova-compute[75356]:       <mac address="fa:16:3e:76:1e:55"/>
Nov 29 20:17:57 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:17:57 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:17:57 user nova-compute[75356]:       <target dev="tapd3cff2c2-96"/>
Nov 29 20:17:57 user nova-compute[75356]:     </interface>
Nov 29 20:17:57 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:17:57 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/1e4d92bf-f8c0-45f8-ba80-48f17fefc108/console.log" append="off"/>
Nov 29 20:17:57 user nova-compute[75356]:     </serial>
Nov 29 20:17:57 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:17:57 user nova-compute[75356]:     <video>
Nov 29 20:17:57 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:17:57 user nova-compute[75356]:     </video>
Nov 29 20:17:57 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:17:57 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:17:57 user nova-compute[75356]:     </rng>
Nov 29 20:17:57 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:17:57 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:17:57 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:17:57 user nova-compute[75356]:     </memballoon>
Nov 29 20:17:57 user nova-compute[75356]:   </devices>
Nov 29 20:17:57 user nova-compute[75356]: </domain>
Nov 29 20:17:57 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1608374642',display_name='tempest-VolumesNegativeTest-instance-1608374642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1608374642',id=11,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b5552f4e7a54f9b98156f157ec4231c',ramdisk_id='',reservation_id='r-k8gzgxf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-98419257',owner_user_name='tempest-VolumesNegativeTest-98419257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:17:54Z,user_data=None,user_id='726978311bd5459494b2e85e1efe833e',uuid=1e4d92bf-f8c0-45f8-ba80-48f17fefc108,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3cff2c2-9659-48c0-843b-09fb5dd4e2b4", "address": "fa:16:3e:76:1e:55", "network": {"id": "c9ca57f1-f027-4505-9561-7d70df8ae387", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85354408285b41f9a373abccf0e04f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3cff2c2-96", "ovs_interfaceid": "d3cff2c2-9659-48c0-843b-09fb5dd4e2b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Converting VIF {"id": "d3cff2c2-9659-48c0-843b-09fb5dd4e2b4", "address": "fa:16:3e:76:1e:55", "network": {"id": "c9ca57f1-f027-4505-9561-7d70df8ae387", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85354408285b41f9a373abccf0e04f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3cff2c2-96", "ovs_interfaceid": "d3cff2c2-9659-48c0-843b-09fb5dd4e2b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:1e:55,bridge_name='br-int',has_traffic_filtering=True,id=d3cff2c2-9659-48c0-843b-09fb5dd4e2b4,network=Network(c9ca57f1-f027-4505-9561-7d70df8ae387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3cff2c2-96') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG os_vif [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:1e:55,bridge_name='br-int',has_traffic_filtering=True,id=d3cff2c2-9659-48c0-843b-09fb5dd4e2b4,network=Network(c9ca57f1-f027-4505-9561-7d70df8ae387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3cff2c2-96') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a9b71ff-17b6-51a3-a62a-10a360e580d7', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3cff2c2-96, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3cff2c2-96, col_values=(('qos', UUID('6ef224e2-bf3e-48c4-b862-c6fc391dde12')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3cff2c2-96, col_values=(('external_ids', {'iface-id': 'd3cff2c2-9659-48c0-843b-09fb5dd4e2b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:1e:55', 'vm-uuid': '1e4d92bf-f8c0-45f8-ba80-48f17fefc108'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:57 user nova-compute[75356]: INFO os_vif [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:1e:55,bridge_name='br-int',has_traffic_filtering=True,id=d3cff2c2-9659-48c0-843b-09fb5dd4e2b4,network=Network(c9ca57f1-f027-4505-9561-7d70df8ae387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3cff2c2-96')
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:17:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] No VIF found with MAC fa:16:3e:76:1e:55, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:17:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-8c896a07-c08e-4c37-9c7c-456e4e6aeea1 req-368747de-36b5-47b9-a6b0-c9c717a946f7 service nova] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Received event network-changed-d3cff2c2-9659-48c0-843b-09fb5dd4e2b4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-8c896a07-c08e-4c37-9c7c-456e4e6aeea1 req-368747de-36b5-47b9-a6b0-c9c717a946f7 service nova] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Refreshing instance network info cache due to event network-changed-d3cff2c2-9659-48c0-843b-09fb5dd4e2b4. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:17:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-8c896a07-c08e-4c37-9c7c-456e4e6aeea1 req-368747de-36b5-47b9-a6b0-c9c717a946f7 service nova] Acquiring lock "refresh_cache-1e4d92bf-f8c0-45f8-ba80-48f17fefc108" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:17:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-8c896a07-c08e-4c37-9c7c-456e4e6aeea1 req-368747de-36b5-47b9-a6b0-c9c717a946f7 service nova] Acquired lock "refresh_cache-1e4d92bf-f8c0-45f8-ba80-48f17fefc108" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:17:59 user nova-compute[75356]: DEBUG nova.network.neutron [req-8c896a07-c08e-4c37-9c7c-456e4e6aeea1 req-368747de-36b5-47b9-a6b0-c9c717a946f7 service nova] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Refreshing network info cache for port d3cff2c2-9659-48c0-843b-09fb5dd4e2b4 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:17:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:17:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-1697462a-2f87-46ed-9de2-d17f94297670 req-72841b1a-83d3-4555-90fc-a1a5f6906b76 service nova] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Received event network-vif-plugged-d3cff2c2-9659-48c0-843b-09fb5dd4e2b4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:17:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1697462a-2f87-46ed-9de2-d17f94297670 req-72841b1a-83d3-4555-90fc-a1a5f6906b76 service nova] Acquiring lock "1e4d92bf-f8c0-45f8-ba80-48f17fefc108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:17:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1697462a-2f87-46ed-9de2-d17f94297670 req-72841b1a-83d3-4555-90fc-a1a5f6906b76 service nova] Lock "1e4d92bf-f8c0-45f8-ba80-48f17fefc108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:17:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1697462a-2f87-46ed-9de2-d17f94297670 req-72841b1a-83d3-4555-90fc-a1a5f6906b76 service nova] Lock "1e4d92bf-f8c0-45f8-ba80-48f17fefc108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:17:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-1697462a-2f87-46ed-9de2-d17f94297670 req-72841b1a-83d3-4555-90fc-a1a5f6906b76 service nova] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] No waiting events found dispatching network-vif-plugged-d3cff2c2-9659-48c0-843b-09fb5dd4e2b4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:17:59 user nova-compute[75356]: WARNING nova.compute.manager [req-1697462a-2f87-46ed-9de2-d17f94297670 req-72841b1a-83d3-4555-90fc-a1a5f6906b76 service nova] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Received unexpected event network-vif-plugged-d3cff2c2-9659-48c0-843b-09fb5dd4e2b4 for instance with vm_state building and task_state spawning.
Nov 29 20:17:59 user nova-compute[75356]: DEBUG nova.network.neutron [req-8c896a07-c08e-4c37-9c7c-456e4e6aeea1 req-368747de-36b5-47b9-a6b0-c9c717a946f7 service nova] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Updated VIF entry in instance network info cache for port d3cff2c2-9659-48c0-843b-09fb5dd4e2b4. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:17:59 user nova-compute[75356]: DEBUG nova.network.neutron [req-8c896a07-c08e-4c37-9c7c-456e4e6aeea1 req-368747de-36b5-47b9-a6b0-c9c717a946f7 service nova] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Updating instance_info_cache with network_info: [{"id": "d3cff2c2-9659-48c0-843b-09fb5dd4e2b4", "address": "fa:16:3e:76:1e:55", "network": {"id": "c9ca57f1-f027-4505-9561-7d70df8ae387", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85354408285b41f9a373abccf0e04f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3cff2c2-96", "ovs_interfaceid": "d3cff2c2-9659-48c0-843b-09fb5dd4e2b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:17:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-8c896a07-c08e-4c37-9c7c-456e4e6aeea1 req-368747de-36b5-47b9-a6b0-c9c717a946f7 service nova] Releasing lock "refresh_cache-1e4d92bf-f8c0-45f8-ba80-48f17fefc108" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:18:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:01 user nova-compute[75356]: DEBUG nova.compute.manager [req-b8709b7b-d4be-4d52-b965-57068926dd4e req-72c3c760-8cad-4222-af04-f85218e6ef4a service nova] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Received event network-vif-plugged-d3cff2c2-9659-48c0-843b-09fb5dd4e2b4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b8709b7b-d4be-4d52-b965-57068926dd4e req-72c3c760-8cad-4222-af04-f85218e6ef4a service nova] Acquiring lock "1e4d92bf-f8c0-45f8-ba80-48f17fefc108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b8709b7b-d4be-4d52-b965-57068926dd4e req-72c3c760-8cad-4222-af04-f85218e6ef4a service nova] Lock "1e4d92bf-f8c0-45f8-ba80-48f17fefc108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b8709b7b-d4be-4d52-b965-57068926dd4e req-72c3c760-8cad-4222-af04-f85218e6ef4a service nova] Lock "1e4d92bf-f8c0-45f8-ba80-48f17fefc108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:01 user nova-compute[75356]: DEBUG nova.compute.manager [req-b8709b7b-d4be-4d52-b965-57068926dd4e req-72c3c760-8cad-4222-af04-f85218e6ef4a service nova] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] No waiting events found dispatching network-vif-plugged-d3cff2c2-9659-48c0-843b-09fb5dd4e2b4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:18:01 user nova-compute[75356]: WARNING nova.compute.manager [req-b8709b7b-d4be-4d52-b965-57068926dd4e req-72c3c760-8cad-4222-af04-f85218e6ef4a service nova] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Received unexpected event network-vif-plugged-d3cff2c2-9659-48c0-843b-09fb5dd4e2b4 for instance with vm_state building and task_state spawning.
Nov 29 20:18:02 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:18:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:18:02 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Instance spawned successfully.
Nov 29 20:18:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:18:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:18:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:18:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:18:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:18:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:18:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:18:02 user nova-compute[75356]: INFO nova.compute.manager [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Took 8.20 seconds to spawn the instance on the hypervisor.
Nov 29 20:18:02 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:18:02 user nova-compute[75356]: INFO nova.compute.manager [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Took 9.46 seconds to build instance.
Nov 29 20:18:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2bfc90-25a5-4270-8957-a20293d1da43 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Lock "1e4d92bf-f8c0-45f8-ba80-48f17fefc108" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.605s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "87fe5c12-c611-4855-8190-6406eca25dba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:11 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:18:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:18:11 user nova-compute[75356]: INFO nova.compute.claims [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Claim successful on node user
Nov 29 20:18:11 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:18:12 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:18:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:12 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:18:12 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:18:12 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:18:12 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:18:12 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:18:12 user nova-compute[75356]: INFO nova.virt.block_device [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Booting with volume c9df962b-5c68-44f7-aebf-2c91f69811c7 at /dev/vda
Nov 29 20:18:12 user nova-compute[75356]: DEBUG nova.policy [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '737af0562f894f89a83f7575eaeb01d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a951d8b7b8741a688b87fb45529db1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:18:12 user nova-compute[75356]: DEBUG os_brick.utils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:18:12 user nova-compute[75356]: INFO oslo.privsep.daemon [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpesjuqjv4/privsep.sock']
Nov 29 20:18:12 user sudo[86859]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpesjuqjv4/privsep.sock
Nov 29 20:18:12 user sudo[86859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 20:18:12 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Successfully created port: 27e5a6aa-c30c-4d12-bbf0-1473aac563cc {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:18:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:13 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Successfully created port: ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:18:13 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Successfully created port: 0e166a72-2c1d-4e32-9e16-69566aa2859a {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:18:14 user sudo[86859]: pam_unix(sudo:session): session closed for user root
Nov 29 20:18:14 user nova-compute[75356]: INFO oslo.privsep.daemon [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Spawned new privsep daemon via rootwrap
Nov 29 20:18:14 user nova-compute[75356]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 20:18:14 user nova-compute[75356]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 20:18:14 user nova-compute[75356]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 29 20:18:14 user nova-compute[75356]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86863
Nov 29 20:18:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b56787d-aed4-47fd-86d3-69a5bff5621c]: (2,) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f0d638-5585-47f6-9d49-b658d237a50e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:14 user nova-compute[75356]: WARNING os_brick.initiator.connectors.nvmeof [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 29 20:18:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29b4fe0-7564-4965-abfa-5c53dfd858f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dad8b5-b5aa-46a9-b47f-633949f0a080]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[062ca807-c4d4-4131-a0e1-a41407087a91]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:18:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:18:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:18:14 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:18:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3a1388-235e-48c3-a98d-9c5043722bec]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:18:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:18:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:18:14 user nova-compute[75356]: DEBUG os_brick.utils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] <== get_connector_properties: return (2071ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:18:14 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Updating existing volume attachment record: ee19a9cf-db39-481b-a6e3-9a150abc1b7e {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:18:14 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Successfully created port: 2e856d03-9c9d-4484-bc17-220a97f74696 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:18:15 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Successfully created port: 79852366-6beb-4192-bea2-ca9971d59810 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:18:15 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Successfully updated port: 27e5a6aa-c30c-4d12-bbf0-1473aac563cc {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:18:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-a7d51ded-79c8-4be4-8bdc-c39a5d908969 req-984bde49-9f79-4fd3-b7da-c89bd393c249 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-changed-27e5a6aa-c30c-4d12-bbf0-1473aac563cc {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-a7d51ded-79c8-4be4-8bdc-c39a5d908969 req-984bde49-9f79-4fd3-b7da-c89bd393c249 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Refreshing instance network info cache due to event network-changed-27e5a6aa-c30c-4d12-bbf0-1473aac563cc. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:18:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a7d51ded-79c8-4be4-8bdc-c39a5d908969 req-984bde49-9f79-4fd3-b7da-c89bd393c249 service nova] Acquiring lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:18:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a7d51ded-79c8-4be4-8bdc-c39a5d908969 req-984bde49-9f79-4fd3-b7da-c89bd393c249 service nova] Acquired lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:18:15 user nova-compute[75356]: DEBUG nova.network.neutron [req-a7d51ded-79c8-4be4-8bdc-c39a5d908969 req-984bde49-9f79-4fd3-b7da-c89bd393c249 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Refreshing network info cache for port 27e5a6aa-c30c-4d12-bbf0-1473aac563cc {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:18:16 user nova-compute[75356]: DEBUG nova.network.neutron [req-a7d51ded-79c8-4be4-8bdc-c39a5d908969 req-984bde49-9f79-4fd3-b7da-c89bd393c249 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:18:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:16 user nova-compute[75356]: DEBUG nova.network.neutron [req-a7d51ded-79c8-4be4-8bdc-c39a5d908969 req-984bde49-9f79-4fd3-b7da-c89bd393c249 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:18:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a7d51ded-79c8-4be4-8bdc-c39a5d908969 req-984bde49-9f79-4fd3-b7da-c89bd393c249 service nova] Releasing lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:18:17 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Successfully updated port: 990817da-1c01-455d-9144-c6de7cab7e11 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:18:17 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Successfully updated port: 3135621b-7479-43f8-9ea4-c5106df4873c {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:18:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-b85f447c-79be-475e-9252-020847f7627a req-ca56f1cb-441c-4dae-94eb-2dc3aea85395 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-changed-990817da-1c01-455d-9144-c6de7cab7e11 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-b85f447c-79be-475e-9252-020847f7627a req-ca56f1cb-441c-4dae-94eb-2dc3aea85395 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Refreshing instance network info cache due to event network-changed-990817da-1c01-455d-9144-c6de7cab7e11. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:18:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b85f447c-79be-475e-9252-020847f7627a req-ca56f1cb-441c-4dae-94eb-2dc3aea85395 service nova] Acquiring lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:18:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b85f447c-79be-475e-9252-020847f7627a req-ca56f1cb-441c-4dae-94eb-2dc3aea85395 service nova] Acquired lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:18:18 user nova-compute[75356]: DEBUG nova.network.neutron [req-b85f447c-79be-475e-9252-020847f7627a req-ca56f1cb-441c-4dae-94eb-2dc3aea85395 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Refreshing network info cache for port 990817da-1c01-455d-9144-c6de7cab7e11 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:18:18 user nova-compute[75356]: DEBUG nova.network.neutron [req-b85f447c-79be-475e-9252-020847f7627a req-ca56f1cb-441c-4dae-94eb-2dc3aea85395 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:18:18 user nova-compute[75356]: DEBUG nova.network.neutron [req-b85f447c-79be-475e-9252-020847f7627a req-ca56f1cb-441c-4dae-94eb-2dc3aea85395 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:18:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b85f447c-79be-475e-9252-020847f7627a req-ca56f1cb-441c-4dae-94eb-2dc3aea85395 service nova] Releasing lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:18:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-b85f447c-79be-475e-9252-020847f7627a req-ca56f1cb-441c-4dae-94eb-2dc3aea85395 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-changed-3135621b-7479-43f8-9ea4-c5106df4873c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-b85f447c-79be-475e-9252-020847f7627a req-ca56f1cb-441c-4dae-94eb-2dc3aea85395 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Refreshing instance network info cache due to event network-changed-3135621b-7479-43f8-9ea4-c5106df4873c. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:18:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b85f447c-79be-475e-9252-020847f7627a req-ca56f1cb-441c-4dae-94eb-2dc3aea85395 service nova] Acquiring lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:18:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b85f447c-79be-475e-9252-020847f7627a req-ca56f1cb-441c-4dae-94eb-2dc3aea85395 service nova] Acquired lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:18:18 user nova-compute[75356]: DEBUG nova.network.neutron [req-b85f447c-79be-475e-9252-020847f7627a req-ca56f1cb-441c-4dae-94eb-2dc3aea85395 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Refreshing network info cache for port 3135621b-7479-43f8-9ea4-c5106df4873c {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:18:18 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Successfully updated port: ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:18:18 user nova-compute[75356]: DEBUG nova.network.neutron [req-b85f447c-79be-475e-9252-020847f7627a req-ca56f1cb-441c-4dae-94eb-2dc3aea85395 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:18:18 user nova-compute[75356]: DEBUG nova.network.neutron [req-b85f447c-79be-475e-9252-020847f7627a req-ca56f1cb-441c-4dae-94eb-2dc3aea85395 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:18:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b85f447c-79be-475e-9252-020847f7627a req-ca56f1cb-441c-4dae-94eb-2dc3aea85395 service nova] Releasing lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:18:19 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Successfully updated port: 0e166a72-2c1d-4e32-9e16-69566aa2859a {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:18:19 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Successfully updated port: 2e856d03-9c9d-4484-bc17-220a97f74696 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:18:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-changed-ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Refreshing instance network info cache due to event network-changed-ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:18:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] Acquiring lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:18:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] Acquired lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:18:20 user nova-compute[75356]: DEBUG nova.network.neutron [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Refreshing network info cache for port ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:18:20 user nova-compute[75356]: DEBUG nova.network.neutron [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:18:20 user nova-compute[75356]: DEBUG nova.network.neutron [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:18:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] Releasing lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:18:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-changed-0e166a72-2c1d-4e32-9e16-69566aa2859a {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Refreshing instance network info cache due to event network-changed-0e166a72-2c1d-4e32-9e16-69566aa2859a. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:18:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] Acquiring lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:18:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] Acquired lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:18:20 user nova-compute[75356]: DEBUG nova.network.neutron [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Refreshing network info cache for port 0e166a72-2c1d-4e32-9e16-69566aa2859a {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:18:20 user nova-compute[75356]: DEBUG nova.network.neutron [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:18:21 user nova-compute[75356]: DEBUG nova.network.neutron [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:18:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] Releasing lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:18:21 user nova-compute[75356]: DEBUG nova.compute.manager [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-changed-2e856d03-9c9d-4484-bc17-220a97f74696 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:21 user nova-compute[75356]: DEBUG nova.compute.manager [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Refreshing instance network info cache due to event network-changed-2e856d03-9c9d-4484-bc17-220a97f74696. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:18:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] Acquiring lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:18:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] Acquired lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:18:21 user nova-compute[75356]: DEBUG nova.network.neutron [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Refreshing network info cache for port 2e856d03-9c9d-4484-bc17-220a97f74696 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:18:21 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Successfully updated port: 79852366-6beb-4192-bea2-ca9971d59810 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:18:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Acquiring lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:18:21 user nova-compute[75356]: DEBUG nova.network.neutron [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:18:21 user nova-compute[75356]: DEBUG nova.network.neutron [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:18:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d92ae7c2-516d-4b91-96a4-84bd50b80398 req-6425eb99-30ca-4bf6-88b0-775a483fd52f service nova] Releasing lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:18:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Acquired lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:18:21 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:18:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:21 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG nova.compute.manager [req-24509bef-db92-4685-bd9f-c0b76ce31108 req-300a1ae8-431f-4f55-b0d0-3eeca88107dc service nova] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Received event network-vif-plugged-b400acb7-2f4f-45da-80f9-069c8cc27f45 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-24509bef-db92-4685-bd9f-c0b76ce31108 req-300a1ae8-431f-4f55-b0d0-3eeca88107dc service nova] Acquiring lock "ee4a5666-bfea-47bf-bd21-d24685967a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-24509bef-db92-4685-bd9f-c0b76ce31108 req-300a1ae8-431f-4f55-b0d0-3eeca88107dc service nova] Lock "ee4a5666-bfea-47bf-bd21-d24685967a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-24509bef-db92-4685-bd9f-c0b76ce31108 req-300a1ae8-431f-4f55-b0d0-3eeca88107dc service nova] Lock "ee4a5666-bfea-47bf-bd21-d24685967a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG nova.compute.manager [req-24509bef-db92-4685-bd9f-c0b76ce31108 req-300a1ae8-431f-4f55-b0d0-3eeca88107dc service nova] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] No waiting events found dispatching network-vif-plugged-b400acb7-2f4f-45da-80f9-069c8cc27f45 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:18:22 user nova-compute[75356]: WARNING nova.compute.manager [req-24509bef-db92-4685-bd9f-c0b76ce31108 req-300a1ae8-431f-4f55-b0d0-3eeca88107dc service nova] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Received unexpected event network-vif-plugged-b400acb7-2f4f-45da-80f9-069c8cc27f45 for instance with vm_state active and task_state None.
Nov 29 20:18:22 user nova-compute[75356]: DEBUG nova.compute.manager [req-24509bef-db92-4685-bd9f-c0b76ce31108 req-300a1ae8-431f-4f55-b0d0-3eeca88107dc service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-changed-79852366-6beb-4192-bea2-ca9971d59810 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG nova.compute.manager [req-24509bef-db92-4685-bd9f-c0b76ce31108 req-300a1ae8-431f-4f55-b0d0-3eeca88107dc service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Refreshing instance network info cache due to event network-changed-79852366-6beb-4192-bea2-ca9971d59810. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-24509bef-db92-4685-bd9f-c0b76ce31108 req-300a1ae8-431f-4f55-b0d0-3eeca88107dc service nova] Acquiring lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:18:22 user nova-compute[75356]: INFO nova.virt.block_device [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Booting with volume 8d224672-854d-4749-b8fb-942523caa12f at /dev/vdb
Nov 29 20:18:22 user nova-compute[75356]: DEBUG os_brick.utils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ce0c2f-7f3e-4170-bdc7-49a8ef0affd2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfad3ca0-5fb7-47fa-b0dc-7b6df1782bcd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00ee749-4de2-4494-90e0-22e37601ba5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed723ee-b417-495f-afdb-34a480b52ec9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:18:22 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:18:22 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6414ca94-1050-40c3-8d6c-c08196add372]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG os_brick.utils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Updating existing volume attachment record: 23c7c0f6-19b3-4585-9028-b14e3e348010 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:18:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:23 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Updating instance_info_cache with network_info: [{"id": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "address": "fa:16:3e:0e:b4:fe", "network": {"id": "6123d0a4-2d12-4965-b318-00d82c21b25f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-131558133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e5a6aa-c3", "ovs_interfaceid": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "990817da-1c01-455d-9144-c6de7cab7e11", "address": "fa:16:3e:41:b2:32", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990817da-1c", "ovs_interfaceid": "990817da-1c01-455d-9144-c6de7cab7e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3135621b-7479-43f8-9ea4-c5106df4873c", "address": "fa:16:3e:38:04:13", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3135621b-74", "ovs_interfaceid": "3135621b-7479-43f8-9ea4-c5106df4873c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc", "address": "fa:16:3e:d0:1c:12", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec8333a3-8d", "ovs_interfaceid": "ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "address": "fa:16:3e:dd:b5:0a", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e166a72-2c", "ovs_interfaceid": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e856d03-9c9d-4484-bc17-220a97f74696", "address": "fa:16:3e:a6:18:62", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e856d03-9c", "ovs_interfaceid": "2e856d03-9c9d-4484-bc17-220a97f74696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "79852366-6beb-4192-bea2-ca9971d59810", "address": "fa:16:3e:37:f9:ae", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79852366-6b", "ovs_interfaceid": "79852366-6beb-4192-bea2-ca9971d59810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:18:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Releasing lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:18:23 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Instance network_info: |[{"id": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "address": "fa:16:3e:0e:b4:fe", "network": {"id": "6123d0a4-2d12-4965-b318-00d82c21b25f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-131558133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e5a6aa-c3", "ovs_interfaceid": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "990817da-1c01-455d-9144-c6de7cab7e11", "address": "fa:16:3e:41:b2:32", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990817da-1c", "ovs_interfaceid": "990817da-1c01-455d-9144-c6de7cab7e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3135621b-7479-43f8-9ea4-c5106df4873c", "address": "fa:16:3e:38:04:13", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3135621b-74", "ovs_interfaceid": "3135621b-7479-43f8-9ea4-c5106df4873c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc", "address": "fa:16:3e:d0:1c:12", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec8333a3-8d", "ovs_interfaceid": "ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "address": "fa:16:3e:dd:b5:0a", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e166a72-2c", "ovs_interfaceid": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e856d03-9c9d-4484-bc17-220a97f74696", "address": "fa:16:3e:a6:18:62", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e856d03-9c", "ovs_interfaceid": "2e856d03-9c9d-4484-bc17-220a97f74696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "79852366-6beb-4192-bea2-ca9971d59810", "address": "fa:16:3e:37:f9:ae", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79852366-6b", "ovs_interfaceid": "79852366-6beb-4192-bea2-ca9971d59810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:18:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-24509bef-db92-4685-bd9f-c0b76ce31108 req-300a1ae8-431f-4f55-b0d0-3eeca88107dc service nova] Acquired lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:18:23 user nova-compute[75356]: DEBUG nova.network.neutron [req-24509bef-db92-4685-bd9f-c0b76ce31108 req-300a1ae8-431f-4f55-b0d0-3eeca88107dc service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Refreshing network info cache for port 79852366-6beb-4192-bea2-ca9971d59810 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:18:24 user nova-compute[75356]: DEBUG nova.network.neutron [req-24509bef-db92-4685-bd9f-c0b76ce31108 req-300a1ae8-431f-4f55-b0d0-3eeca88107dc service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Updated VIF entry in instance network info cache for port 79852366-6beb-4192-bea2-ca9971d59810. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:18:24 user nova-compute[75356]: DEBUG nova.network.neutron [req-24509bef-db92-4685-bd9f-c0b76ce31108 req-300a1ae8-431f-4f55-b0d0-3eeca88107dc service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Updating instance_info_cache with network_info: [{"id": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "address": "fa:16:3e:0e:b4:fe", "network": {"id": "6123d0a4-2d12-4965-b318-00d82c21b25f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-131558133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e5a6aa-c3", "ovs_interfaceid": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "990817da-1c01-455d-9144-c6de7cab7e11", "address": "fa:16:3e:41:b2:32", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990817da-1c", "ovs_interfaceid": "990817da-1c01-455d-9144-c6de7cab7e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3135621b-7479-43f8-9ea4-c5106df4873c", "address": "fa:16:3e:38:04:13", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3135621b-74", "ovs_interfaceid": "3135621b-7479-43f8-9ea4-c5106df4873c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc", "address": "fa:16:3e:d0:1c:12", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec8333a3-8d", "ovs_interfaceid": "ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "address": "fa:16:3e:dd:b5:0a", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e166a72-2c", "ovs_interfaceid": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e856d03-9c9d-4484-bc17-220a97f74696", "address": "fa:16:3e:a6:18:62", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e856d03-9c", "ovs_interfaceid": "2e856d03-9c9d-4484-bc17-220a97f74696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "79852366-6beb-4192-bea2-ca9971d59810", "address": "fa:16:3e:37:f9:ae", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79852366-6b", "ovs_interfaceid": "79852366-6beb-4192-bea2-ca9971d59810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:18:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-24509bef-db92-4685-bd9f-c0b76ce31108 req-300a1ae8-431f-4f55-b0d0-3eeca88107dc service nova] Releasing lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:18:24 user nova-compute[75356]: DEBUG nova.compute.manager [req-24509bef-db92-4685-bd9f-c0b76ce31108 req-300a1ae8-431f-4f55-b0d0-3eeca88107dc service nova] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Received event network-vif-plugged-b400acb7-2f4f-45da-80f9-069c8cc27f45 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-24509bef-db92-4685-bd9f-c0b76ce31108 req-300a1ae8-431f-4f55-b0d0-3eeca88107dc service nova] Acquiring lock "ee4a5666-bfea-47bf-bd21-d24685967a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-24509bef-db92-4685-bd9f-c0b76ce31108 req-300a1ae8-431f-4f55-b0d0-3eeca88107dc service nova] Lock "ee4a5666-bfea-47bf-bd21-d24685967a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-24509bef-db92-4685-bd9f-c0b76ce31108 req-300a1ae8-431f-4f55-b0d0-3eeca88107dc service nova] Lock "ee4a5666-bfea-47bf-bd21-d24685967a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:24 user nova-compute[75356]: DEBUG nova.compute.manager [req-24509bef-db92-4685-bd9f-c0b76ce31108 req-300a1ae8-431f-4f55-b0d0-3eeca88107dc service nova] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] No waiting events found dispatching network-vif-plugged-b400acb7-2f4f-45da-80f9-069c8cc27f45 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:18:24 user nova-compute[75356]: WARNING nova.compute.manager [req-24509bef-db92-4685-bd9f-c0b76ce31108 req-300a1ae8-431f-4f55-b0d0-3eeca88107dc service nova] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Received unexpected event network-vif-plugged-b400acb7-2f4f-45da-80f9-069c8cc27f45 for instance with vm_state active and task_state None.
Nov 29 20:18:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:29 user nova-compute[75356]: INFO nova.virt.block_device [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Booting with volume 4b189071-f183-448d-8a64-fa5c0aa5c547 at /dev/vdc
Nov 29 20:18:29 user nova-compute[75356]: DEBUG os_brick.utils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:18:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d656f343-a9e4-48f6-956d-9f7e6affca5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb9d1e7-3836-458a-a409-80e714044cd1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b129701b-cf21-49e9-80cd-eb425920b0bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3cee8e-e41e-4255-aecc-641984320743]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:18:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:18:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:18:30 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:18:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf47c1f8-67f8-453e-8dca-19686f753c08]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:18:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:18:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:18:30 user nova-compute[75356]: DEBUG os_brick.utils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:18:30 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Updating existing volume attachment record: fb399c23-e564-4e3b-9ecd-af5e67240e09 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:18:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:37 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:18:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:18:37 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Creating image(s)
Nov 29 20:18:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Did not create local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 20:18:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Ensure instance console log exists: /opt/stack/data/nova/instances/87fe5c12-c611-4855-8190-6406eca25dba/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:18:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Start _get_guest_xml network_info=[{"id": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "address": "fa:16:3e:0e:b4:fe", "network": {"id": "6123d0a4-2d12-4965-b318-00d82c21b25f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-131558133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e5a6aa-c3", "ovs_interfaceid": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "990817da-1c01-455d-9144-c6de7cab7e11", "address": "fa:16:3e:41:b2:32", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990817da-1c", "ovs_interfaceid": "990817da-1c01-455d-9144-c6de7cab7e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3135621b-7479-43f8-9ea4-c5106df4873c", "address": "fa:16:3e:38:04:13", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3135621b-74", "ovs_interfaceid": "3135621b-7479-43f8-9ea4-c5106df4873c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc", "address": "fa:16:3e:d0:1c:12", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec8333a3-8d", "ovs_interfaceid": "ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "address": "fa:16:3e:dd:b5:0a", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e166a72-2c", "ovs_interfaceid": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e856d03-9c9d-4484-bc17-220a97f74696", "address": "fa:16:3e:a6:18:62", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e856d03-9c", "ovs_interfaceid": "2e856d03-9c9d-4484-bc17-220a97f74696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "79852366-6beb-4192-bea2-ca9971d59810", "address": "fa:16:3e:37:f9:ae", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79852366-6b", "ovs_interfaceid": "79852366-6beb-4192-bea2-ca9971d59810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMpmZAFH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '87fe5c12-c611-4855-8190-6406eca25dba', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9df962b-5c68-44f7-aebf-2c91f69811c7', 'serial': 'c9df962b-5c68-44f7-aebf-2c91f69811c7'}, 'attachment_id': 'ee19a9cf-db39-481b-a6e3-9a150abc1b7e', 'volume_type': None}, {'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': 1, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLznVCJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '87fe5c12-c611-4855-8190-6406eca25dba', 'attached_at': '', 'detached_at': '', 'volume_id': '8d224672-854d-4749-b8fb-942523caa12f', 'serial': '8d224672-854d-4749-b8fb-942523caa12f'}, 'attachment_id': '23c7c0f6-19b3-4585-9028-b14e3e348010', 'volume_type': None}, {'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdc', 'boot_index': 2, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QaKstcYk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '87fe5c12-c611-4855-8190-6406eca25dba', 'attached_at': '', 'detached_at': '', 'volume_id': '4b189071-f183-448d-8a64-fa5c0aa5c547', 'serial': '4b189071-f183-448d-8a64-fa5c0aa5c547'}, 'attachment_id': 'fb399c23-e564-4e3b-9ecd-af5e67240e09', 'volume_type': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:18:37 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:18:37 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:18:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:18:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:18:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:18:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:18:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:18:37 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:18:37 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:18:37 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:18:37 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:18:37 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:18:37 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:18:37 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:18:37 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:18:37 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:18:37 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:18:37 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG os_brick.initiator.connector [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Factory for ISCSI on None {{(pid=75356) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMpmZAFH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:18:38 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:18:38 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:18:38 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:18:38 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:18:38 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 -p 172.16.0.220:3260" returned: 21 in 0.038s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce953bb-5417-4735-b2c4-b8ad95421840]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:18:38 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacea078-290a-4bfc-86d4-a795258c427f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7] added
Nov 29 20:18:38 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3716211-2b24-4f73-a519-957f46491b54]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e17091-96a0-492f-8609-6ca06a00f031]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yMpmZAFH {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yMpmZAFH" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b567a46d-f1a8-4260-8468-deb3046b6713]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yMpmZAFH'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd591aa-097f-4f29-85bd-8429f6975e92]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[551a81d5-3475-4544-b338-ae884b8a914e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 20:18:38 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 20:18:38 user nova-compute[75356]:  {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:18:38 user nova-compute[75356]: WARNING os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 20:18:38 user nova-compute[75356]: 
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[20145e1a-bd63-41ee-9867-3e86a1a73ca3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7, portal: 172.16.0.220,3260]
Nov 29 20:18:38 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7, portal: 172.16.0.220,3260] successful.
Nov 29 20:18:38 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f0c160-b093-4acf-ac02-538f9f57219b]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[199a3834-e175-48d9-aaa0-8402a916e718]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:18:38 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:18:38 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ba68fb-f4bd-415c-832e-c44e39a74a8e]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:38 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMpmZAFH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26364316665343030', 'path': '/dev/sdb'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364316665343030', 'path': '/dev/sdb'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLznVCJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:18:39 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:18:39 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:18:39 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5417336c-6d54-4295-ab2d-d41e1bac691c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:18:39 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d20554-5a47-46ff-b681-99dbbd3fe9fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f] added
Nov 29 20:18:39 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[05513efa-b9d7-41ac-84b4-74f637911295]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5894624c-0a47-4e9c-9af0-be7f66d71e2b]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OLznVCJi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OLznVCJi" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[004739e0-a5c4-4855-8625-7102e275e97e]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OLznVCJi'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fec838-099f-4301-9bc9-992f02cfe2d8]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14fb3d2-07de-417b-8ab7-0025365001e8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:18:39 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:18:39 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df781d8-60dc-449d-b51d-4c38e026853b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f, portal: 172.16.0.220,3260]
Nov 29 20:18:39 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f, portal: 172.16.0.220,3260] successful.
Nov 29 20:18:39 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafb6d3c-e016-405c-be33-81405eb0cbbf]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da96234-bcd3-45cc-bd02-160dcac02d9c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:18:39 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:18:39 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:18:39 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:18:39 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c251a2f7-b7fc-432b-9480-7fda4462d410]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:18:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLznVCJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26563626238386636', 'path': '/dev/sdc'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563626238386636', 'path': '/dev/sdc'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QaKstcYk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:18:40 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:18:40 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:18:40 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c222ab5-15d2-495d-97ac-40e5712c3326]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:18:40 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6eeea0-6099-42d3-816f-d2809d160562]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547] added
Nov 29 20:18:40 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[578dd258-2e75-4db6-b3ec-de8407953b96]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a28ed89-7b4b-4c91-8210-80478abc6c30]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QaKstcYk {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QaKstcYk" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[db70fe04-0b13-4e91-828e-97c79436cd22]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QaKstcYk'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[82069347-2e41-4750-9e04-04501458c106]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[decc5ac8-af87-4e77-9e54-f73136f6b54e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:18:40 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:18:40 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:18:40 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:18:40 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[035dfe51-63f5-4b78-9d2a-438ae5bdf341]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547, portal: 172.16.0.220,3260]
Nov 29 20:18:40 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547, portal: 172.16.0.220,3260] successful.
Nov 29 20:18:40 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec68edb-19a0-4640-a578-1462c94dea4f]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08b195f-4573-42e9-a869-544a33edf140]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:18:40 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:18:40 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:18:40 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:18:40 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:18:40 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:18:40 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea4abc9-c2d8-450b-aee7-42d82fd7ed08]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:40 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:18:41 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:18:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QaKstcYk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:18:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:18:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '23665626534646633', 'path': '/dev/sdd'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:18:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665626534646633', 'path': '/dev/sdd'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:18:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1786059119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1786059119',id=12,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Nh0/p7EJswGp3VeXBY5B4OA3/el93z5xaGce4Ke5DnkmOxiLU/Ea5qDNIyc4+O48K6kNq5XnDRcAKQjSZ9woOM9ldfSQfP7ETfWoKe6dHcYQO+HWCJ1XyNkiIA72EDw==',key_name='tempest-keypair-1957815519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a951d8b7b8741a688b87fb45529db1c',ramdisk_id='',reservation_id='r-7j320fe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1407027468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1407027468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:18:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='737af0562f894f89a83f7575eaeb01d6',uuid=87fe5c12-c611-4855-8190-6406eca25dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "address": "fa:16:3e:0e:b4:fe", "network": {"id": "6123d0a4-2d12-4965-b318-00d82c21b25f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-131558133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e5a6aa-c3", "ovs_interfaceid": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:18:41 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converting VIF {"id": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "address": "fa:16:3e:0e:b4:fe", "network": {"id": "6123d0a4-2d12-4965-b318-00d82c21b25f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-131558133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e5a6aa-c3", "ovs_interfaceid": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:18:41 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:b4:fe,bridge_name='br-int',has_traffic_filtering=True,id=27e5a6aa-c30c-4d12-bbf0-1473aac563cc,network=Network(6123d0a4-2d12-4965-b318-00d82c21b25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e5a6aa-c3') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:18:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1786059119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1786059119',id=12,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Nh0/p7EJswGp3VeXBY5B4OA3/el93z5xaGce4Ke5DnkmOxiLU/Ea5qDNIyc4+O48K6kNq5XnDRcAKQjSZ9woOM9ldfSQfP7ETfWoKe6dHcYQO+HWCJ1XyNkiIA72EDw==',key_name='tempest-keypair-1957815519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a951d8b7b8741a688b87fb45529db1c',ramdisk_id='',reservation_id='r-7j320fe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1407027468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1407027468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:18:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='737af0562f894f89a83f7575eaeb01d6',uuid=87fe5c12-c611-4855-8190-6406eca25dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "990817da-1c01-455d-9144-c6de7cab7e11", "address": "fa:16:3e:41:b2:32", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990817da-1c", "ovs_interfaceid": "990817da-1c01-455d-9144-c6de7cab7e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:18:41 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converting VIF {"id": "990817da-1c01-455d-9144-c6de7cab7e11", "address": "fa:16:3e:41:b2:32", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990817da-1c", "ovs_interfaceid": "990817da-1c01-455d-9144-c6de7cab7e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:18:41 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:b2:32,bridge_name='br-int',has_traffic_filtering=True,id=990817da-1c01-455d-9144-c6de7cab7e11,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap990817da-1c') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:18:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1786059119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1786059119',id=12,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Nh0/p7EJswGp3VeXBY5B4OA3/el93z5xaGce4Ke5DnkmOxiLU/Ea5qDNIyc4+O48K6kNq5XnDRcAKQjSZ9woOM9ldfSQfP7ETfWoKe6dHcYQO+HWCJ1XyNkiIA72EDw==',key_name='tempest-keypair-1957815519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a951d8b7b8741a688b87fb45529db1c',ramdisk_id='',reservation_id='r-7j320fe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1407027468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1407027468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:18:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='737af0562f894f89a83f7575eaeb01d6',uuid=87fe5c12-c611-4855-8190-6406eca25dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3135621b-7479-43f8-9ea4-c5106df4873c", "address": "fa:16:3e:38:04:13", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3135621b-74", "ovs_interfaceid": "3135621b-7479-43f8-9ea4-c5106df4873c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:18:41 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converting VIF {"id": "3135621b-7479-43f8-9ea4-c5106df4873c", "address": "fa:16:3e:38:04:13", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3135621b-74", "ovs_interfaceid": "3135621b-7479-43f8-9ea4-c5106df4873c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:18:41 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:04:13,bridge_name='br-int',has_traffic_filtering=True,id=3135621b-7479-43f8-9ea4-c5106df4873c,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3135621b-74') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1786059119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1786059119',id=12,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Nh0/p7EJswGp3VeXBY5B4OA3/el93z5xaGce4Ke5DnkmOxiLU/Ea5qDNIyc4+O48K6kNq5XnDRcAKQjSZ9woOM9ldfSQfP7ETfWoKe6dHcYQO+HWCJ1XyNkiIA72EDw==',key_name='tempest-keypair-1957815519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a951d8b7b8741a688b87fb45529db1c',ramdisk_id='',reservation_id='r-7j320fe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1407027468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1407027468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:18:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='737af0562f894f89a83f7575eaeb01d6',uuid=87fe5c12-c611-4855-8190-6406eca25dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc", "address": "fa:16:3e:d0:1c:12", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec8333a3-8d", "ovs_interfaceid": "ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converting VIF {"id": "ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc", "address": "fa:16:3e:d0:1c:12", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec8333a3-8d", "ovs_interfaceid": "ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1c:12,bridge_name='br-int',has_traffic_filtering=True,id=ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec8333a3-8d') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1786059119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1786059119',id=12,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Nh0/p7EJswGp3VeXBY5B4OA3/el93z5xaGce4Ke5DnkmOxiLU/Ea5qDNIyc4+O48K6kNq5XnDRcAKQjSZ9woOM9ldfSQfP7ETfWoKe6dHcYQO+HWCJ1XyNkiIA72EDw==',key_name='tempest-keypair-1957815519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a951d8b7b8741a688b87fb45529db1c',ramdisk_id='',reservation_id='r-7j320fe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1407027468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1407027468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:18:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='737af0562f894f89a83f7575eaeb01d6',uuid=87fe5c12-c611-4855-8190-6406eca25dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "address": "fa:16:3e:dd:b5:0a", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e166a72-2c", "ovs_interfaceid": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converting VIF {"id": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "address": "fa:16:3e:dd:b5:0a", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e166a72-2c", "ovs_interfaceid": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:b5:0a,bridge_name='br-int',has_traffic_filtering=True,id=0e166a72-2c1d-4e32-9e16-69566aa2859a,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e166a72-2c') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1786059119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1786059119',id=12,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Nh0/p7EJswGp3VeXBY5B4OA3/el93z5xaGce4Ke5DnkmOxiLU/Ea5qDNIyc4+O48K6kNq5XnDRcAKQjSZ9woOM9ldfSQfP7ETfWoKe6dHcYQO+HWCJ1XyNkiIA72EDw==',key_name='tempest-keypair-1957815519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a951d8b7b8741a688b87fb45529db1c',ramdisk_id='',reservation_id='r-7j320fe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1407027468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1407027468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:18:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='737af0562f894f89a83f7575eaeb01d6',uuid=87fe5c12-c611-4855-8190-6406eca25dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e856d03-9c9d-4484-bc17-220a97f74696", "address": "fa:16:3e:a6:18:62", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e856d03-9c", "ovs_interfaceid": "2e856d03-9c9d-4484-bc17-220a97f74696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converting VIF {"id": "2e856d03-9c9d-4484-bc17-220a97f74696", "address": "fa:16:3e:a6:18:62", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e856d03-9c", "ovs_interfaceid": "2e856d03-9c9d-4484-bc17-220a97f74696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:18:62,bridge_name='br-int',has_traffic_filtering=True,id=2e856d03-9c9d-4484-bc17-220a97f74696,network=Network(d8cceb20-7800-4f94-9044-cdc204990f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e856d03-9c') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1786059119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1786059119',id=12,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Nh0/p7EJswGp3VeXBY5B4OA3/el93z5xaGce4Ke5DnkmOxiLU/Ea5qDNIyc4+O48K6kNq5XnDRcAKQjSZ9woOM9ldfSQfP7ETfWoKe6dHcYQO+HWCJ1XyNkiIA72EDw==',key_name='tempest-keypair-1957815519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a951d8b7b8741a688b87fb45529db1c',ramdisk_id='',reservation_id='r-7j320fe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1407027468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1407027468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:18:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='737af0562f894f89a83f7575eaeb01d6',uuid=87fe5c12-c611-4855-8190-6406eca25dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79852366-6beb-4192-bea2-ca9971d59810", "address": "fa:16:3e:37:f9:ae", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79852366-6b", "ovs_interfaceid": "79852366-6beb-4192-bea2-ca9971d59810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converting VIF {"id": "79852366-6beb-4192-bea2-ca9971d59810", "address": "fa:16:3e:37:f9:ae", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79852366-6b", "ovs_interfaceid": "79852366-6beb-4192-bea2-ca9971d59810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:f9:ae,bridge_name='br-int',has_traffic_filtering=True,id=79852366-6beb-4192-bea2-ca9971d59810,network=Network(d8cceb20-7800-4f94-9044-cdc204990f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79852366-6b') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.objects.instance [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lazy-loading 'pci_devices' on Instance uuid 87fe5c12-c611-4855-8190-6406eca25dba {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:18:42 user nova-compute[75356]:   <uuid>87fe5c12-c611-4855-8190-6406eca25dba</uuid>
Nov 29 20:18:42 user nova-compute[75356]:   <name>instance-0000000c</name>
Nov 29 20:18:42 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:18:42 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:18:42 user nova-compute[75356]:   <metadata>
Nov 29 20:18:42 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:18:42 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:18:42 user nova-compute[75356]:       <nova:name>tempest-device-tagging-server-1786059119</nova:name>
Nov 29 20:18:42 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:18:37</nova:creationTime>
Nov 29 20:18:42 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:18:42 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:18:42 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:18:42 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:18:42 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:18:42 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:18:42 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:18:42 user nova-compute[75356]:       <nova:owner>
Nov 29 20:18:42 user nova-compute[75356]:         <nova:user uuid="737af0562f894f89a83f7575eaeb01d6">tempest-TaggedBootDevicesTest_v242-1407027468-project-member</nova:user>
Nov 29 20:18:42 user nova-compute[75356]:         <nova:project uuid="7a951d8b7b8741a688b87fb45529db1c">tempest-TaggedBootDevicesTest_v242-1407027468</nova:project>
Nov 29 20:18:42 user nova-compute[75356]:       </nova:owner>
Nov 29 20:18:42 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:18:42 user nova-compute[75356]:       <nova:ports>
Nov 29 20:18:42 user nova-compute[75356]:         <nova:port uuid="27e5a6aa-c30c-4d12-bbf0-1473aac563cc">
Nov 29 20:18:42 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 20:18:42 user nova-compute[75356]:         </nova:port>
Nov 29 20:18:42 user nova-compute[75356]:         <nova:port uuid="990817da-1c01-455d-9144-c6de7cab7e11">
Nov 29 20:18:42 user nova-compute[75356]:           <nova:ip type="fixed" address="10.1.1.162" ipVersion="4"/>
Nov 29 20:18:42 user nova-compute[75356]:         </nova:port>
Nov 29 20:18:42 user nova-compute[75356]:         <nova:port uuid="3135621b-7479-43f8-9ea4-c5106df4873c">
Nov 29 20:18:42 user nova-compute[75356]:           <nova:ip type="fixed" address="10.1.1.17" ipVersion="4"/>
Nov 29 20:18:42 user nova-compute[75356]:         </nova:port>
Nov 29 20:18:42 user nova-compute[75356]:         <nova:port uuid="ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc">
Nov 29 20:18:42 user nova-compute[75356]:           <nova:ip type="fixed" address="10.1.1.34" ipVersion="4"/>
Nov 29 20:18:42 user nova-compute[75356]:         </nova:port>
Nov 29 20:18:42 user nova-compute[75356]:         <nova:port uuid="0e166a72-2c1d-4e32-9e16-69566aa2859a">
Nov 29 20:18:42 user nova-compute[75356]:           <nova:ip type="fixed" address="10.1.1.249" ipVersion="4"/>
Nov 29 20:18:42 user nova-compute[75356]:         </nova:port>
Nov 29 20:18:42 user nova-compute[75356]:         <nova:port uuid="2e856d03-9c9d-4484-bc17-220a97f74696">
Nov 29 20:18:42 user nova-compute[75356]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 29 20:18:42 user nova-compute[75356]:         </nova:port>
Nov 29 20:18:42 user nova-compute[75356]:         <nova:port uuid="79852366-6beb-4192-bea2-ca9971d59810">
Nov 29 20:18:42 user nova-compute[75356]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 29 20:18:42 user nova-compute[75356]:         </nova:port>
Nov 29 20:18:42 user nova-compute[75356]:       </nova:ports>
Nov 29 20:18:42 user nova-compute[75356]:     </nova:instance>
Nov 29 20:18:42 user nova-compute[75356]:   </metadata>
Nov 29 20:18:42 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:18:42 user nova-compute[75356]:     <system>
Nov 29 20:18:42 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:18:42 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:18:42 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:18:42 user nova-compute[75356]:       <entry name="serial">87fe5c12-c611-4855-8190-6406eca25dba</entry>
Nov 29 20:18:42 user nova-compute[75356]:       <entry name="uuid">87fe5c12-c611-4855-8190-6406eca25dba</entry>
Nov 29 20:18:42 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:18:42 user nova-compute[75356]:     </system>
Nov 29 20:18:42 user nova-compute[75356]:   </sysinfo>
Nov 29 20:18:42 user nova-compute[75356]:   <os>
Nov 29 20:18:42 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:18:42 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:18:42 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:18:42 user nova-compute[75356]:   </os>
Nov 29 20:18:42 user nova-compute[75356]:   <features>
Nov 29 20:18:42 user nova-compute[75356]:     <acpi/>
Nov 29 20:18:42 user nova-compute[75356]:     <apic/>
Nov 29 20:18:42 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:18:42 user nova-compute[75356]:   </features>
Nov 29 20:18:42 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:18:42 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:18:42 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:18:42 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:18:42 user nova-compute[75356]:   </clock>
Nov 29 20:18:42 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:18:42 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:18:42 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:18:42 user nova-compute[75356]:   </cpu>
Nov 29 20:18:42 user nova-compute[75356]:   <devices>
Nov 29 20:18:42 user nova-compute[75356]:     <disk type="file" device="cdrom">
Nov 29 20:18:42 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 20:18:42 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/87fe5c12-c611-4855-8190-6406eca25dba/disk.config"/>
Nov 29 20:18:42 user nova-compute[75356]:       <target dev="hda" bus="ide"/>
Nov 29 20:18:42 user nova-compute[75356]:     </disk>
Nov 29 20:18:42 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:18:42 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:18:42 user nova-compute[75356]:       <source dev="/dev/sdb"/>
Nov 29 20:18:42 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:18:42 user nova-compute[75356]:       <serial>c9df962b-5c68-44f7-aebf-2c91f69811c7</serial>
Nov 29 20:18:42 user nova-compute[75356]:     </disk>
Nov 29 20:18:42 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:18:42 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:18:42 user nova-compute[75356]:       <source dev="/dev/sdc"/>
Nov 29 20:18:42 user nova-compute[75356]:       <target dev="vdb" bus="virtio"/>
Nov 29 20:18:42 user nova-compute[75356]:       <serial>8d224672-854d-4749-b8fb-942523caa12f</serial>
Nov 29 20:18:42 user nova-compute[75356]:     </disk>
Nov 29 20:18:42 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:18:42 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:18:42 user nova-compute[75356]:       <source dev="/dev/sdd"/>
Nov 29 20:18:42 user nova-compute[75356]:       <target dev="vdc" bus="virtio"/>
Nov 29 20:18:42 user nova-compute[75356]:       <serial>4b189071-f183-448d-8a64-fa5c0aa5c547</serial>
Nov 29 20:18:42 user nova-compute[75356]:     </disk>
Nov 29 20:18:42 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:18:42 user nova-compute[75356]:       <mac address="fa:16:3e:0e:b4:fe"/>
Nov 29 20:18:42 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:18:42 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:18:42 user nova-compute[75356]:       <target dev="tap27e5a6aa-c3"/>
Nov 29 20:18:42 user nova-compute[75356]:     </interface>
Nov 29 20:18:42 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:18:42 user nova-compute[75356]:       <mac address="fa:16:3e:41:b2:32"/>
Nov 29 20:18:42 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:18:42 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:18:42 user nova-compute[75356]:       <target dev="tap990817da-1c"/>
Nov 29 20:18:42 user nova-compute[75356]:     </interface>
Nov 29 20:18:42 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:18:42 user nova-compute[75356]:       <mac address="fa:16:3e:38:04:13"/>
Nov 29 20:18:42 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:18:42 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:18:42 user nova-compute[75356]:       <target dev="tap3135621b-74"/>
Nov 29 20:18:42 user nova-compute[75356]:     </interface>
Nov 29 20:18:42 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:18:42 user nova-compute[75356]:       <mac address="fa:16:3e:d0:1c:12"/>
Nov 29 20:18:42 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:18:42 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:18:42 user nova-compute[75356]:       <target dev="tapec8333a3-8d"/>
Nov 29 20:18:42 user nova-compute[75356]:     </interface>
Nov 29 20:18:42 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:18:42 user nova-compute[75356]:       <mac address="fa:16:3e:dd:b5:0a"/>
Nov 29 20:18:42 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:18:42 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:18:42 user nova-compute[75356]:       <target dev="tap0e166a72-2c"/>
Nov 29 20:18:42 user nova-compute[75356]:     </interface>
Nov 29 20:18:42 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:18:42 user nova-compute[75356]:       <mac address="fa:16:3e:a6:18:62"/>
Nov 29 20:18:42 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:18:42 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:18:42 user nova-compute[75356]:       <target dev="tap2e856d03-9c"/>
Nov 29 20:18:42 user nova-compute[75356]:     </interface>
Nov 29 20:18:42 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:18:42 user nova-compute[75356]:       <mac address="fa:16:3e:37:f9:ae"/>
Nov 29 20:18:42 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:18:42 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:18:42 user nova-compute[75356]:       <target dev="tap79852366-6b"/>
Nov 29 20:18:42 user nova-compute[75356]:     </interface>
Nov 29 20:18:42 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:18:42 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/87fe5c12-c611-4855-8190-6406eca25dba/console.log" append="off"/>
Nov 29 20:18:42 user nova-compute[75356]:     </serial>
Nov 29 20:18:42 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:18:42 user nova-compute[75356]:     <video>
Nov 29 20:18:42 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:18:42 user nova-compute[75356]:     </video>
Nov 29 20:18:42 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:18:42 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:18:42 user nova-compute[75356]:     </rng>
Nov 29 20:18:42 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:18:42 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:18:42 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:18:42 user nova-compute[75356]:     </memballoon>
Nov 29 20:18:42 user nova-compute[75356]:   </devices>
Nov 29 20:18:42 user nova-compute[75356]: </domain>
Nov 29 20:18:42 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1786059119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1786059119',id=12,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Nh0/p7EJswGp3VeXBY5B4OA3/el93z5xaGce4Ke5DnkmOxiLU/Ea5qDNIyc4+O48K6kNq5XnDRcAKQjSZ9woOM9ldfSQfP7ETfWoKe6dHcYQO+HWCJ1XyNkiIA72EDw==',key_name='tempest-keypair-1957815519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a951d8b7b8741a688b87fb45529db1c',ramdisk_id='',reservation_id='r-7j320fe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1407027468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1407027468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:18:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='737af0562f894f89a83f7575eaeb01d6',uuid=87fe5c12-c611-4855-8190-6406eca25dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "address": "fa:16:3e:0e:b4:fe", "network": {"id": "6123d0a4-2d12-4965-b318-00d82c21b25f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-131558133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e5a6aa-c3", "ovs_interfaceid": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converting VIF {"id": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "address": "fa:16:3e:0e:b4:fe", "network": {"id": "6123d0a4-2d12-4965-b318-00d82c21b25f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-131558133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e5a6aa-c3", "ovs_interfaceid": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:b4:fe,bridge_name='br-int',has_traffic_filtering=True,id=27e5a6aa-c30c-4d12-bbf0-1473aac563cc,network=Network(6123d0a4-2d12-4965-b318-00d82c21b25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e5a6aa-c3') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG os_vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:b4:fe,bridge_name='br-int',has_traffic_filtering=True,id=27e5a6aa-c30c-4d12-bbf0-1473aac563cc,network=Network(6123d0a4-2d12-4965-b318-00d82c21b25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e5a6aa-c3') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f24068b-fe46-527f-a9bc-32374e0de027', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27e5a6aa-c3, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27e5a6aa-c3, col_values=(('qos', UUID('a8abc9ca-9020-4883-a9cb-613db17a1eb2')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27e5a6aa-c3, col_values=(('external_ids', {'iface-id': '27e5a6aa-c30c-4d12-bbf0-1473aac563cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:b4:fe', 'vm-uuid': '87fe5c12-c611-4855-8190-6406eca25dba'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: INFO os_vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:b4:fe,bridge_name='br-int',has_traffic_filtering=True,id=27e5a6aa-c30c-4d12-bbf0-1473aac563cc,network=Network(6123d0a4-2d12-4965-b318-00d82c21b25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e5a6aa-c3')
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1786059119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1786059119',id=12,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Nh0/p7EJswGp3VeXBY5B4OA3/el93z5xaGce4Ke5DnkmOxiLU/Ea5qDNIyc4+O48K6kNq5XnDRcAKQjSZ9woOM9ldfSQfP7ETfWoKe6dHcYQO+HWCJ1XyNkiIA72EDw==',key_name='tempest-keypair-1957815519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a951d8b7b8741a688b87fb45529db1c',ramdisk_id='',reservation_id='r-7j320fe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1407027468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1407027468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:18:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='737af0562f894f89a83f7575eaeb01d6',uuid=87fe5c12-c611-4855-8190-6406eca25dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "990817da-1c01-455d-9144-c6de7cab7e11", "address": "fa:16:3e:41:b2:32", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990817da-1c", "ovs_interfaceid": "990817da-1c01-455d-9144-c6de7cab7e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converting VIF {"id": "990817da-1c01-455d-9144-c6de7cab7e11", "address": "fa:16:3e:41:b2:32", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990817da-1c", "ovs_interfaceid": "990817da-1c01-455d-9144-c6de7cab7e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:b2:32,bridge_name='br-int',has_traffic_filtering=True,id=990817da-1c01-455d-9144-c6de7cab7e11,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap990817da-1c') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG os_vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:b2:32,bridge_name='br-int',has_traffic_filtering=True,id=990817da-1c01-455d-9144-c6de7cab7e11,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap990817da-1c') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89708372-bb1a-5da9-b551-98576d044c82', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap990817da-1c, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap990817da-1c, col_values=(('qos', UUID('9edd3851-b5a9-4927-a6d9-c9d79be493f9')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap990817da-1c, col_values=(('external_ids', {'iface-id': '990817da-1c01-455d-9144-c6de7cab7e11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:b2:32', 'vm-uuid': '87fe5c12-c611-4855-8190-6406eca25dba'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: INFO os_vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:b2:32,bridge_name='br-int',has_traffic_filtering=True,id=990817da-1c01-455d-9144-c6de7cab7e11,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap990817da-1c')
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1786059119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1786059119',id=12,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Nh0/p7EJswGp3VeXBY5B4OA3/el93z5xaGce4Ke5DnkmOxiLU/Ea5qDNIyc4+O48K6kNq5XnDRcAKQjSZ9woOM9ldfSQfP7ETfWoKe6dHcYQO+HWCJ1XyNkiIA72EDw==',key_name='tempest-keypair-1957815519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a951d8b7b8741a688b87fb45529db1c',ramdisk_id='',reservation_id='r-7j320fe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1407027468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1407027468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:18:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='737af0562f894f89a83f7575eaeb01d6',uuid=87fe5c12-c611-4855-8190-6406eca25dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3135621b-7479-43f8-9ea4-c5106df4873c", "address": "fa:16:3e:38:04:13", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3135621b-74", "ovs_interfaceid": "3135621b-7479-43f8-9ea4-c5106df4873c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converting VIF {"id": "3135621b-7479-43f8-9ea4-c5106df4873c", "address": "fa:16:3e:38:04:13", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3135621b-74", "ovs_interfaceid": "3135621b-7479-43f8-9ea4-c5106df4873c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:04:13,bridge_name='br-int',has_traffic_filtering=True,id=3135621b-7479-43f8-9ea4-c5106df4873c,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3135621b-74') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG os_vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:04:13,bridge_name='br-int',has_traffic_filtering=True,id=3135621b-7479-43f8-9ea4-c5106df4873c,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3135621b-74') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe62f3b8-20ca-5907-947b-0658ee5d387b', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3135621b-74, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3135621b-74, col_values=(('qos', UUID('a2a9d38d-742a-415a-b104-697be274e91d')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3135621b-74, col_values=(('external_ids', {'iface-id': '3135621b-7479-43f8-9ea4-c5106df4873c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:04:13', 'vm-uuid': '87fe5c12-c611-4855-8190-6406eca25dba'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: INFO os_vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:04:13,bridge_name='br-int',has_traffic_filtering=True,id=3135621b-7479-43f8-9ea4-c5106df4873c,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3135621b-74')
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1786059119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1786059119',id=12,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Nh0/p7EJswGp3VeXBY5B4OA3/el93z5xaGce4Ke5DnkmOxiLU/Ea5qDNIyc4+O48K6kNq5XnDRcAKQjSZ9woOM9ldfSQfP7ETfWoKe6dHcYQO+HWCJ1XyNkiIA72EDw==',key_name='tempest-keypair-1957815519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a951d8b7b8741a688b87fb45529db1c',ramdisk_id='',reservation_id='r-7j320fe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1407027468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1407027468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:18:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='737af0562f894f89a83f7575eaeb01d6',uuid=87fe5c12-c611-4855-8190-6406eca25dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc", "address": "fa:16:3e:d0:1c:12", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec8333a3-8d", "ovs_interfaceid": "ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converting VIF {"id": "ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc", "address": "fa:16:3e:d0:1c:12", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec8333a3-8d", "ovs_interfaceid": "ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1c:12,bridge_name='br-int',has_traffic_filtering=True,id=ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec8333a3-8d') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG os_vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1c:12,bridge_name='br-int',has_traffic_filtering=True,id=ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec8333a3-8d') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f25ae14-98d1-5ad3-a8bc-71d13f57b210', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec8333a3-8d, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec8333a3-8d, col_values=(('qos', UUID('9166a37f-0826-4c3d-83de-3917a0e9246f')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec8333a3-8d, col_values=(('external_ids', {'iface-id': 'ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:1c:12', 'vm-uuid': '87fe5c12-c611-4855-8190-6406eca25dba'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: INFO os_vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1c:12,bridge_name='br-int',has_traffic_filtering=True,id=ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec8333a3-8d')
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1786059119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1786059119',id=12,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Nh0/p7EJswGp3VeXBY5B4OA3/el93z5xaGce4Ke5DnkmOxiLU/Ea5qDNIyc4+O48K6kNq5XnDRcAKQjSZ9woOM9ldfSQfP7ETfWoKe6dHcYQO+HWCJ1XyNkiIA72EDw==',key_name='tempest-keypair-1957815519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a951d8b7b8741a688b87fb45529db1c',ramdisk_id='',reservation_id='r-7j320fe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1407027468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1407027468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:18:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='737af0562f894f89a83f7575eaeb01d6',uuid=87fe5c12-c611-4855-8190-6406eca25dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "address": "fa:16:3e:dd:b5:0a", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e166a72-2c", "ovs_interfaceid": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converting VIF {"id": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "address": "fa:16:3e:dd:b5:0a", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e166a72-2c", "ovs_interfaceid": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:b5:0a,bridge_name='br-int',has_traffic_filtering=True,id=0e166a72-2c1d-4e32-9e16-69566aa2859a,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e166a72-2c') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG os_vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:b5:0a,bridge_name='br-int',has_traffic_filtering=True,id=0e166a72-2c1d-4e32-9e16-69566aa2859a,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e166a72-2c') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ca1bc54-e80d-5954-b6a3-8907962e5789', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e166a72-2c, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e166a72-2c, col_values=(('qos', UUID('07c2c1b7-84b0-4ee4-9bac-91d557df42fd')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e166a72-2c, col_values=(('external_ids', {'iface-id': '0e166a72-2c1d-4e32-9e16-69566aa2859a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:b5:0a', 'vm-uuid': '87fe5c12-c611-4855-8190-6406eca25dba'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: INFO os_vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:b5:0a,bridge_name='br-int',has_traffic_filtering=True,id=0e166a72-2c1d-4e32-9e16-69566aa2859a,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e166a72-2c')
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1786059119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1786059119',id=12,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Nh0/p7EJswGp3VeXBY5B4OA3/el93z5xaGce4Ke5DnkmOxiLU/Ea5qDNIyc4+O48K6kNq5XnDRcAKQjSZ9woOM9ldfSQfP7ETfWoKe6dHcYQO+HWCJ1XyNkiIA72EDw==',key_name='tempest-keypair-1957815519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a951d8b7b8741a688b87fb45529db1c',ramdisk_id='',reservation_id='r-7j320fe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1407027468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1407027468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:18:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='737af0562f894f89a83f7575eaeb01d6',uuid=87fe5c12-c611-4855-8190-6406eca25dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e856d03-9c9d-4484-bc17-220a97f74696", "address": "fa:16:3e:a6:18:62", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e856d03-9c", "ovs_interfaceid": "2e856d03-9c9d-4484-bc17-220a97f74696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converting VIF {"id": "2e856d03-9c9d-4484-bc17-220a97f74696", "address": "fa:16:3e:a6:18:62", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e856d03-9c", "ovs_interfaceid": "2e856d03-9c9d-4484-bc17-220a97f74696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:18:62,bridge_name='br-int',has_traffic_filtering=True,id=2e856d03-9c9d-4484-bc17-220a97f74696,network=Network(d8cceb20-7800-4f94-9044-cdc204990f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e856d03-9c') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG os_vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:18:62,bridge_name='br-int',has_traffic_filtering=True,id=2e856d03-9c9d-4484-bc17-220a97f74696,network=Network(d8cceb20-7800-4f94-9044-cdc204990f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e856d03-9c') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c02dcf64-e819-50bd-b75f-522c7b966769', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e856d03-9c, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e856d03-9c, col_values=(('qos', UUID('1699bf44-de26-40dd-9f8c-3a818c7a59ff')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e856d03-9c, col_values=(('external_ids', {'iface-id': '2e856d03-9c9d-4484-bc17-220a97f74696', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:18:62', 'vm-uuid': '87fe5c12-c611-4855-8190-6406eca25dba'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: INFO os_vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:18:62,bridge_name='br-int',has_traffic_filtering=True,id=2e856d03-9c9d-4484-bc17-220a97f74696,network=Network(d8cceb20-7800-4f94-9044-cdc204990f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e856d03-9c')
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1786059119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1786059119',id=12,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Nh0/p7EJswGp3VeXBY5B4OA3/el93z5xaGce4Ke5DnkmOxiLU/Ea5qDNIyc4+O48K6kNq5XnDRcAKQjSZ9woOM9ldfSQfP7ETfWoKe6dHcYQO+HWCJ1XyNkiIA72EDw==',key_name='tempest-keypair-1957815519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a951d8b7b8741a688b87fb45529db1c',ramdisk_id='',reservation_id='r-7j320fe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1407027468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1407027468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:18:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='737af0562f894f89a83f7575eaeb01d6',uuid=87fe5c12-c611-4855-8190-6406eca25dba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79852366-6beb-4192-bea2-ca9971d59810", "address": "fa:16:3e:37:f9:ae", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79852366-6b", "ovs_interfaceid": "79852366-6beb-4192-bea2-ca9971d59810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converting VIF {"id": "79852366-6beb-4192-bea2-ca9971d59810", "address": "fa:16:3e:37:f9:ae", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79852366-6b", "ovs_interfaceid": "79852366-6beb-4192-bea2-ca9971d59810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:f9:ae,bridge_name='br-int',has_traffic_filtering=True,id=79852366-6beb-4192-bea2-ca9971d59810,network=Network(d8cceb20-7800-4f94-9044-cdc204990f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79852366-6b') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG os_vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:f9:ae,bridge_name='br-int',has_traffic_filtering=True,id=79852366-6beb-4192-bea2-ca9971d59810,network=Network(d8cceb20-7800-4f94-9044-cdc204990f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79852366-6b') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09f24735-d591-5794-b8ab-23716027300e', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79852366-6b, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79852366-6b, col_values=(('qos', UUID('7cd46cd9-7ad7-40f6-ad3e-0b53f06f10a5')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79852366-6b, col_values=(('external_ids', {'iface-id': '79852366-6beb-4192-bea2-ca9971d59810', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:f9:ae', 'vm-uuid': '87fe5c12-c611-4855-8190-6406eca25dba'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:42 user nova-compute[75356]: INFO os_vif [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:f9:ae,bridge_name='br-int',has_traffic_filtering=True,id=79852366-6beb-4192-bea2-ca9971d59810,network=Network(d8cceb20-7800-4f94-9044-cdc204990f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79852366-6b')
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] No BDM found with device name hda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] No VIF found with MAC fa:16:3e:0e:b4:fe, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] No VIF found with MAC fa:16:3e:dd:b5:0a, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:18:42 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Using config drive
Nov 29 20:18:42 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Creating config drive at /opt/stack/data/nova/instances/87fe5c12-c611-4855-8190-6406eca25dba/disk.config
Nov 29 20:18:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/87fe5c12-c611-4855-8190-6406eca25dba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuma1kz_x {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/87fe5c12-c611-4855-8190-6406eca25dba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuma1kz_x" returned: 0 in 0.058s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:44 user nova-compute[75356]: DEBUG nova.compute.manager [req-1088d070-034d-4dc8-879e-feffc65f6ca1 req-5b7fffc3-4332-46e3-91c6-5300e60e1046 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-plugged-27e5a6aa-c30c-4d12-bbf0-1473aac563cc {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1088d070-034d-4dc8-879e-feffc65f6ca1 req-5b7fffc3-4332-46e3-91c6-5300e60e1046 service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1088d070-034d-4dc8-879e-feffc65f6ca1 req-5b7fffc3-4332-46e3-91c6-5300e60e1046 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1088d070-034d-4dc8-879e-feffc65f6ca1 req-5b7fffc3-4332-46e3-91c6-5300e60e1046 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:44 user nova-compute[75356]: DEBUG nova.compute.manager [req-1088d070-034d-4dc8-879e-feffc65f6ca1 req-5b7fffc3-4332-46e3-91c6-5300e60e1046 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-plugged-27e5a6aa-c30c-4d12-bbf0-1473aac563cc {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:18:44 user nova-compute[75356]: WARNING nova.compute.manager [req-1088d070-034d-4dc8-879e-feffc65f6ca1 req-5b7fffc3-4332-46e3-91c6-5300e60e1046 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received unexpected event network-vif-plugged-27e5a6aa-c30c-4d12-bbf0-1473aac563cc for instance with vm_state building and task_state spawning.
Nov 29 20:18:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:45 user nova-compute[75356]: DEBUG nova.compute.manager [req-1fe908c4-88a0-41b4-9437-e3c39d8dcbc4 req-a0a32e36-7bdc-406c-b975-f68ddd06426d service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-plugged-3135621b-7479-43f8-9ea4-c5106df4873c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1fe908c4-88a0-41b4-9437-e3c39d8dcbc4 req-a0a32e36-7bdc-406c-b975-f68ddd06426d service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1fe908c4-88a0-41b4-9437-e3c39d8dcbc4 req-a0a32e36-7bdc-406c-b975-f68ddd06426d service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1fe908c4-88a0-41b4-9437-e3c39d8dcbc4 req-a0a32e36-7bdc-406c-b975-f68ddd06426d service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:45 user nova-compute[75356]: DEBUG nova.compute.manager [req-1fe908c4-88a0-41b4-9437-e3c39d8dcbc4 req-a0a32e36-7bdc-406c-b975-f68ddd06426d service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-plugged-3135621b-7479-43f8-9ea4-c5106df4873c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:18:45 user nova-compute[75356]: WARNING nova.compute.manager [req-1fe908c4-88a0-41b4-9437-e3c39d8dcbc4 req-a0a32e36-7bdc-406c-b975-f68ddd06426d service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received unexpected event network-vif-plugged-3135621b-7479-43f8-9ea4-c5106df4873c for instance with vm_state building and task_state spawning.
Nov 29 20:18:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG nova.compute.manager [req-e0f8024f-a9b4-41a8-a838-edc2718119c7 req-6a601d13-1ce7-4937-86b3-cd969bebc2a1 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-plugged-0e166a72-2c1d-4e32-9e16-69566aa2859a {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e0f8024f-a9b4-41a8-a838-edc2718119c7 req-6a601d13-1ce7-4937-86b3-cd969bebc2a1 service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e0f8024f-a9b4-41a8-a838-edc2718119c7 req-6a601d13-1ce7-4937-86b3-cd969bebc2a1 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e0f8024f-a9b4-41a8-a838-edc2718119c7 req-6a601d13-1ce7-4937-86b3-cd969bebc2a1 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG nova.compute.manager [req-e0f8024f-a9b4-41a8-a838-edc2718119c7 req-6a601d13-1ce7-4937-86b3-cd969bebc2a1 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-plugged-0e166a72-2c1d-4e32-9e16-69566aa2859a {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:18:46 user nova-compute[75356]: WARNING nova.compute.manager [req-e0f8024f-a9b4-41a8-a838-edc2718119c7 req-6a601d13-1ce7-4937-86b3-cd969bebc2a1 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received unexpected event network-vif-plugged-0e166a72-2c1d-4e32-9e16-69566aa2859a for instance with vm_state building and task_state spawning.
Nov 29 20:18:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-plugged-27e5a6aa-c30c-4d12-bbf0-1473aac563cc {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-plugged-27e5a6aa-c30c-4d12-bbf0-1473aac563cc {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:18:47 user nova-compute[75356]: WARNING nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received unexpected event network-vif-plugged-27e5a6aa-c30c-4d12-bbf0-1473aac563cc for instance with vm_state building and task_state spawning.
Nov 29 20:18:47 user nova-compute[75356]: DEBUG nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-plugged-990817da-1c01-455d-9144-c6de7cab7e11 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-plugged-990817da-1c01-455d-9144-c6de7cab7e11 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:18:47 user nova-compute[75356]: WARNING nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received unexpected event network-vif-plugged-990817da-1c01-455d-9144-c6de7cab7e11 for instance with vm_state building and task_state spawning.
Nov 29 20:18:47 user nova-compute[75356]: DEBUG nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-plugged-990817da-1c01-455d-9144-c6de7cab7e11 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-plugged-990817da-1c01-455d-9144-c6de7cab7e11 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:18:47 user nova-compute[75356]: WARNING nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received unexpected event network-vif-plugged-990817da-1c01-455d-9144-c6de7cab7e11 for instance with vm_state building and task_state spawning.
Nov 29 20:18:47 user nova-compute[75356]: DEBUG nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-plugged-ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-plugged-ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:18:47 user nova-compute[75356]: WARNING nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received unexpected event network-vif-plugged-ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc for instance with vm_state building and task_state spawning.
Nov 29 20:18:47 user nova-compute[75356]: DEBUG nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-plugged-ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-plugged-ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:18:47 user nova-compute[75356]: WARNING nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received unexpected event network-vif-plugged-ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc for instance with vm_state building and task_state spawning.
Nov 29 20:18:47 user nova-compute[75356]: DEBUG nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-plugged-2e856d03-9c9d-4484-bc17-220a97f74696 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-plugged-2e856d03-9c9d-4484-bc17-220a97f74696 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:18:47 user nova-compute[75356]: WARNING nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received unexpected event network-vif-plugged-2e856d03-9c9d-4484-bc17-220a97f74696 for instance with vm_state building and task_state spawning.
Nov 29 20:18:47 user nova-compute[75356]: DEBUG nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-plugged-2e856d03-9c9d-4484-bc17-220a97f74696 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-plugged-2e856d03-9c9d-4484-bc17-220a97f74696 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:18:47 user nova-compute[75356]: WARNING nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received unexpected event network-vif-plugged-2e856d03-9c9d-4484-bc17-220a97f74696 for instance with vm_state building and task_state spawning.
Nov 29 20:18:47 user nova-compute[75356]: DEBUG nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-plugged-79852366-6beb-4192-bea2-ca9971d59810 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-plugged-79852366-6beb-4192-bea2-ca9971d59810 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:18:47 user nova-compute[75356]: WARNING nova.compute.manager [req-1433f910-855c-49e0-8f43-27b250768d32 req-eba3d5c8-0326-4a18-b9f1-b17d8e5c2da0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received unexpected event network-vif-plugged-79852366-6beb-4192-bea2-ca9971d59810 for instance with vm_state building and task_state spawning.
Nov 29 20:18:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG nova.compute.manager [req-e439e8d0-c87f-44bc-ad67-674b02e17d7e req-aa478e90-2fac-49df-ab12-79c08023f430 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-plugged-3135621b-7479-43f8-9ea4-c5106df4873c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e439e8d0-c87f-44bc-ad67-674b02e17d7e req-aa478e90-2fac-49df-ab12-79c08023f430 service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e439e8d0-c87f-44bc-ad67-674b02e17d7e req-aa478e90-2fac-49df-ab12-79c08023f430 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e439e8d0-c87f-44bc-ad67-674b02e17d7e req-aa478e90-2fac-49df-ab12-79c08023f430 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG nova.compute.manager [req-e439e8d0-c87f-44bc-ad67-674b02e17d7e req-aa478e90-2fac-49df-ab12-79c08023f430 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-plugged-3135621b-7479-43f8-9ea4-c5106df4873c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:18:47 user nova-compute[75356]: WARNING nova.compute.manager [req-e439e8d0-c87f-44bc-ad67-674b02e17d7e req-aa478e90-2fac-49df-ab12-79c08023f430 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received unexpected event network-vif-plugged-3135621b-7479-43f8-9ea4-c5106df4873c for instance with vm_state building and task_state spawning.
Nov 29 20:18:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:48 user nova-compute[75356]: DEBUG nova.compute.manager [req-71965f74-9bd6-4c0f-a675-0503e73b3c98 req-ca800f18-d344-4dc6-a74f-cfe103027fc3 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-plugged-0e166a72-2c1d-4e32-9e16-69566aa2859a {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-71965f74-9bd6-4c0f-a675-0503e73b3c98 req-ca800f18-d344-4dc6-a74f-cfe103027fc3 service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-71965f74-9bd6-4c0f-a675-0503e73b3c98 req-ca800f18-d344-4dc6-a74f-cfe103027fc3 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-71965f74-9bd6-4c0f-a675-0503e73b3c98 req-ca800f18-d344-4dc6-a74f-cfe103027fc3 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:48 user nova-compute[75356]: DEBUG nova.compute.manager [req-71965f74-9bd6-4c0f-a675-0503e73b3c98 req-ca800f18-d344-4dc6-a74f-cfe103027fc3 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-plugged-0e166a72-2c1d-4e32-9e16-69566aa2859a {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:18:48 user nova-compute[75356]: WARNING nova.compute.manager [req-71965f74-9bd6-4c0f-a675-0503e73b3c98 req-ca800f18-d344-4dc6-a74f-cfe103027fc3 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received unexpected event network-vif-plugged-0e166a72-2c1d-4e32-9e16-69566aa2859a for instance with vm_state building and task_state spawning.
Nov 29 20:18:48 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:18:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:18:48 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Instance spawned successfully.
Nov 29 20:18:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:18:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:18:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:18:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:18:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:18:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:18:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:18:48 user nova-compute[75356]: INFO nova.compute.manager [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Took 11.04 seconds to spawn the instance on the hypervisor.
Nov 29 20:18:48 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:18:49 user nova-compute[75356]: DEBUG nova.compute.manager [req-ae49c627-66b0-44a6-b91d-9d76ce48a5ac req-c9d89214-1485-4808-ab04-75062712b055 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-plugged-79852366-6beb-4192-bea2-ca9971d59810 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ae49c627-66b0-44a6-b91d-9d76ce48a5ac req-c9d89214-1485-4808-ab04-75062712b055 service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ae49c627-66b0-44a6-b91d-9d76ce48a5ac req-c9d89214-1485-4808-ab04-75062712b055 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ae49c627-66b0-44a6-b91d-9d76ce48a5ac req-c9d89214-1485-4808-ab04-75062712b055 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:49 user nova-compute[75356]: DEBUG nova.compute.manager [req-ae49c627-66b0-44a6-b91d-9d76ce48a5ac req-c9d89214-1485-4808-ab04-75062712b055 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-plugged-79852366-6beb-4192-bea2-ca9971d59810 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:18:49 user nova-compute[75356]: WARNING nova.compute.manager [req-ae49c627-66b0-44a6-b91d-9d76ce48a5ac req-c9d89214-1485-4808-ab04-75062712b055 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received unexpected event network-vif-plugged-79852366-6beb-4192-bea2-ca9971d59810 for instance with vm_state active and task_state None.
Nov 29 20:18:49 user nova-compute[75356]: INFO nova.compute.manager [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Took 37.60 seconds to build instance.
Nov 29 20:18:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ee233fc1-a881-4b78-a7b1-094e21cfdbd0 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "87fe5c12-c611-4855-8190-6406eca25dba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.699s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:49 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-9751c435-4d10-46dc-86e7-39d40e8209d3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-9751c435-4d10-46dc-86e7-39d40e8209d3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Acquiring lock "8db40390-15ae-458b-92c9-7b3bb623ca50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "8db40390-15ae-458b-92c9-7b3bb623ca50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG nova.objects.instance [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lazy-loading 'flavor' on Instance uuid 8db40390-15ae-458b-92c9-7b3bb623ca50 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "8db40390-15ae-458b-92c9-7b3bb623ca50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Acquiring lock "8db40390-15ae-458b-92c9-7b3bb623ca50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "8db40390-15ae-458b-92c9-7b3bb623ca50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:50 user nova-compute[75356]: INFO nova.compute.manager [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Attaching volume f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 to /dev/vdb
Nov 29 20:18:50 user nova-compute[75356]: DEBUG os_brick.utils [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60b4d72-24c5-4aa0-a7bd-be31b3f61c57]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c70a4ac-627f-48f8-816a-939050d1a1be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e97be7-7363-499c-bf1b-f89cfd2b60f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[86425778-0b1c-4f58-9b1c-e4b2ab5fb812]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:18:50 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1074e6-5f50-4ade-b53b-16814a1df190]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG os_brick.utils [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Updating existing volume attachment record: 73c626fa-5b10-4f69-a1b2-675336720eb6 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Updating instance_info_cache with network_info: [{"id": "21221e61-952e-4f3b-a212-dbb9cafe061d", "address": "fa:16:3e:c1:72:a4", "network": {"id": "ee89a769-4a94-475b-b835-e49cabad1f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407371162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f191c68eb9041d289e04d64dc71ddb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21221e61-95", "ovs_interfaceid": "21221e61-952e-4f3b-a212-dbb9cafe061d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-9751c435-4d10-46dc-86e7-39d40e8209d3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:50 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:18:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Acquiring lock "d8864353-ba84-4d79-a316-46a185729caa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "d8864353-ba84-4d79-a316-46a185729caa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:18:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:52 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:18:52 user nova-compute[75356]: INFO nova.compute.claims [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Claim successful on node user
Nov 29 20:18:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.635s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG nova.network.neutron [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:18:53 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:18:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG nova.policy [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e7fb9cda998444b912de256b9efa7e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f191c68eb9041d289e04d64dc71ddb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:18:53 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Creating image(s)
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8864353-ba84-4d79-a316-46a185729caa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "/opt/stack/data/nova/instances/d8864353-ba84-4d79-a316-46a185729caa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "/opt/stack/data/nova/instances/d8864353-ba84-4d79-a316-46a185729caa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.209s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG nova.network.neutron [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Successfully created port: 74095f60-9801-4b07-98bf-33541cf69058 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.199s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/d8864353-ba84-4d79-a316-46a185729caa/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/d8864353-ba84-4d79-a316-46a185729caa/disk 1073741824" returned: 0 in 0.078s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db40390-15ae-458b-92c9-7b3bb623ca50/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.230s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8864353-ba84-4d79-a316-46a185729caa/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8864353-ba84-4d79-a316-46a185729caa/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db40390-15ae-458b-92c9-7b3bb623ca50/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db40390-15ae-458b-92c9-7b3bb623ca50/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8864353-ba84-4d79-a316-46a185729caa/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Cannot resize image /opt/stack/data/nova/instances/d8864353-ba84-4d79-a316-46a185729caa/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Ensure instance console log exists: /opt/stack/data/nova/instances/d8864353-ba84-4d79-a316-46a185729caa/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG nova.network.neutron [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Successfully updated port: 74095f60-9801-4b07-98bf-33541cf69058 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db40390-15ae-458b-92c9-7b3bb623ca50/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Acquiring lock "refresh_cache-d8864353-ba84-4d79-a316-46a185729caa" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Acquired lock "refresh_cache-d8864353-ba84-4d79-a316-46a185729caa" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG nova.network.neutron [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG nova.compute.manager [req-06d97379-5d63-4726-be6a-2b16516e0fe8 req-8e25bfde-35a0-4cc6-9ba3-b61ccba7ab9e service nova] [instance: d8864353-ba84-4d79-a316-46a185729caa] Received event network-changed-74095f60-9801-4b07-98bf-33541cf69058 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG nova.compute.manager [req-06d97379-5d63-4726-be6a-2b16516e0fe8 req-8e25bfde-35a0-4cc6-9ba3-b61ccba7ab9e service nova] [instance: d8864353-ba84-4d79-a316-46a185729caa] Refreshing instance network info cache due to event network-changed-74095f60-9801-4b07-98bf-33541cf69058. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-06d97379-5d63-4726-be6a-2b16516e0fe8 req-8e25bfde-35a0-4cc6-9ba3-b61ccba7ab9e service nova] Acquiring lock "refresh_cache-d8864353-ba84-4d79-a316-46a185729caa" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG nova.network.neutron [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.network.neutron [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Updating instance_info_cache with network_info: [{"id": "74095f60-9801-4b07-98bf-33541cf69058", "address": "fa:16:3e:78:1a:e8", "network": {"id": "ee89a769-4a94-475b-b835-e49cabad1f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407371162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f191c68eb9041d289e04d64dc71ddb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74095f60-98", "ovs_interfaceid": "74095f60-9801-4b07-98bf-33541cf69058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Releasing lock "refresh_cache-d8864353-ba84-4d79-a316-46a185729caa" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.compute.manager [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Instance network_info: |[{"id": "74095f60-9801-4b07-98bf-33541cf69058", "address": "fa:16:3e:78:1a:e8", "network": {"id": "ee89a769-4a94-475b-b835-e49cabad1f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407371162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f191c68eb9041d289e04d64dc71ddb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74095f60-98", "ovs_interfaceid": "74095f60-9801-4b07-98bf-33541cf69058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-06d97379-5d63-4726-be6a-2b16516e0fe8 req-8e25bfde-35a0-4cc6-9ba3-b61ccba7ab9e service nova] Acquired lock "refresh_cache-d8864353-ba84-4d79-a316-46a185729caa" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.network.neutron [req-06d97379-5d63-4726-be6a-2b16516e0fe8 req-8e25bfde-35a0-4cc6-9ba3-b61ccba7ab9e service nova] [instance: d8864353-ba84-4d79-a316-46a185729caa] Refreshing network info cache for port 74095f60-9801-4b07-98bf-33541cf69058 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Start _get_guest_xml network_info=[{"id": "74095f60-9801-4b07-98bf-33541cf69058", "address": "fa:16:3e:78:1a:e8", "network": {"id": "ee89a769-4a94-475b-b835-e49cabad1f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407371162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f191c68eb9041d289e04d64dc71ddb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74095f60-98", "ovs_interfaceid": "74095f60-9801-4b07-98bf-33541cf69058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:18:55 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:18:55 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:18:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-171947667',display_name='tempest-ServersNegativeTestJSON-server-171947667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-171947667',id=13,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f191c68eb9041d289e04d64dc71ddb8',ramdisk_id='',reservation_id='r-82cq7a1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-851047228',owner_user_name='tempest-ServersNegativeTestJSON-851047228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:18:53Z,user_data=None,user_id='9e7fb9cda998444b912de256b9efa7e8',uuid=d8864353-ba84-4d79-a316-46a185729caa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74095f60-9801-4b07-98bf-33541cf69058", "address": "fa:16:3e:78:1a:e8", "network": {"id": "ee89a769-4a94-475b-b835-e49cabad1f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407371162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f191c68eb9041d289e04d64dc71ddb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74095f60-98", "ovs_interfaceid": "74095f60-9801-4b07-98bf-33541cf69058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Converting VIF {"id": "74095f60-9801-4b07-98bf-33541cf69058", "address": "fa:16:3e:78:1a:e8", "network": {"id": "ee89a769-4a94-475b-b835-e49cabad1f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407371162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f191c68eb9041d289e04d64dc71ddb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74095f60-98", "ovs_interfaceid": "74095f60-9801-4b07-98bf-33541cf69058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:1a:e8,bridge_name='br-int',has_traffic_filtering=True,id=74095f60-9801-4b07-98bf-33541cf69058,network=Network(ee89a769-4a94-475b-b835-e49cabad1f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74095f60-98') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.objects.instance [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lazy-loading 'pci_devices' on Instance uuid d8864353-ba84-4d79-a316-46a185729caa {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:18:55 user nova-compute[75356]:   <uuid>d8864353-ba84-4d79-a316-46a185729caa</uuid>
Nov 29 20:18:55 user nova-compute[75356]:   <name>instance-0000000d</name>
Nov 29 20:18:55 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:18:55 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:18:55 user nova-compute[75356]:   <metadata>
Nov 29 20:18:55 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:18:55 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:18:55 user nova-compute[75356]:       <nova:name>tempest-ServersNegativeTestJSON-server-171947667</nova:name>
Nov 29 20:18:55 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:18:55</nova:creationTime>
Nov 29 20:18:55 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:18:55 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:18:55 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:18:55 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:18:55 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:18:55 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:18:55 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:18:55 user nova-compute[75356]:       <nova:owner>
Nov 29 20:18:55 user nova-compute[75356]:         <nova:user uuid="9e7fb9cda998444b912de256b9efa7e8">tempest-ServersNegativeTestJSON-851047228-project-member</nova:user>
Nov 29 20:18:55 user nova-compute[75356]:         <nova:project uuid="5f191c68eb9041d289e04d64dc71ddb8">tempest-ServersNegativeTestJSON-851047228</nova:project>
Nov 29 20:18:55 user nova-compute[75356]:       </nova:owner>
Nov 29 20:18:55 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:18:55 user nova-compute[75356]:       <nova:ports>
Nov 29 20:18:55 user nova-compute[75356]:         <nova:port uuid="74095f60-9801-4b07-98bf-33541cf69058">
Nov 29 20:18:55 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 20:18:55 user nova-compute[75356]:         </nova:port>
Nov 29 20:18:55 user nova-compute[75356]:       </nova:ports>
Nov 29 20:18:55 user nova-compute[75356]:     </nova:instance>
Nov 29 20:18:55 user nova-compute[75356]:   </metadata>
Nov 29 20:18:55 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:18:55 user nova-compute[75356]:     <system>
Nov 29 20:18:55 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:18:55 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:18:55 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:18:55 user nova-compute[75356]:       <entry name="serial">d8864353-ba84-4d79-a316-46a185729caa</entry>
Nov 29 20:18:55 user nova-compute[75356]:       <entry name="uuid">d8864353-ba84-4d79-a316-46a185729caa</entry>
Nov 29 20:18:55 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:18:55 user nova-compute[75356]:     </system>
Nov 29 20:18:55 user nova-compute[75356]:   </sysinfo>
Nov 29 20:18:55 user nova-compute[75356]:   <os>
Nov 29 20:18:55 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:18:55 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:18:55 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:18:55 user nova-compute[75356]:   </os>
Nov 29 20:18:55 user nova-compute[75356]:   <features>
Nov 29 20:18:55 user nova-compute[75356]:     <acpi/>
Nov 29 20:18:55 user nova-compute[75356]:     <apic/>
Nov 29 20:18:55 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:18:55 user nova-compute[75356]:   </features>
Nov 29 20:18:55 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:18:55 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:18:55 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:18:55 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:18:55 user nova-compute[75356]:   </clock>
Nov 29 20:18:55 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:18:55 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:18:55 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:18:55 user nova-compute[75356]:   </cpu>
Nov 29 20:18:55 user nova-compute[75356]:   <devices>
Nov 29 20:18:55 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:18:55 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:18:55 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/d8864353-ba84-4d79-a316-46a185729caa/disk"/>
Nov 29 20:18:55 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:18:55 user nova-compute[75356]:     </disk>
Nov 29 20:18:55 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:18:55 user nova-compute[75356]:       <mac address="fa:16:3e:78:1a:e8"/>
Nov 29 20:18:55 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:18:55 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:18:55 user nova-compute[75356]:       <target dev="tap74095f60-98"/>
Nov 29 20:18:55 user nova-compute[75356]:     </interface>
Nov 29 20:18:55 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:18:55 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/d8864353-ba84-4d79-a316-46a185729caa/console.log" append="off"/>
Nov 29 20:18:55 user nova-compute[75356]:     </serial>
Nov 29 20:18:55 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:18:55 user nova-compute[75356]:     <video>
Nov 29 20:18:55 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:18:55 user nova-compute[75356]:     </video>
Nov 29 20:18:55 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:18:55 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:18:55 user nova-compute[75356]:     </rng>
Nov 29 20:18:55 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:18:55 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:18:55 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:18:55 user nova-compute[75356]:     </memballoon>
Nov 29 20:18:55 user nova-compute[75356]:   </devices>
Nov 29 20:18:55 user nova-compute[75356]: </domain>
Nov 29 20:18:55 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:18:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-171947667',display_name='tempest-ServersNegativeTestJSON-server-171947667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-171947667',id=13,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f191c68eb9041d289e04d64dc71ddb8',ramdisk_id='',reservation_id='r-82cq7a1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-851047228',owner_user_name='tempest-ServersNegativeTestJSON-851047228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:18:53Z,user_data=None,user_id='9e7fb9cda998444b912de256b9efa7e8',uuid=d8864353-ba84-4d79-a316-46a185729caa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74095f60-9801-4b07-98bf-33541cf69058", "address": "fa:16:3e:78:1a:e8", "network": {"id": "ee89a769-4a94-475b-b835-e49cabad1f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407371162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f191c68eb9041d289e04d64dc71ddb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74095f60-98", "ovs_interfaceid": "74095f60-9801-4b07-98bf-33541cf69058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Converting VIF {"id": "74095f60-9801-4b07-98bf-33541cf69058", "address": "fa:16:3e:78:1a:e8", "network": {"id": "ee89a769-4a94-475b-b835-e49cabad1f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407371162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f191c68eb9041d289e04d64dc71ddb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74095f60-98", "ovs_interfaceid": "74095f60-9801-4b07-98bf-33541cf69058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:1a:e8,bridge_name='br-int',has_traffic_filtering=True,id=74095f60-9801-4b07-98bf-33541cf69058,network=Network(ee89a769-4a94-475b-b835-e49cabad1f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74095f60-98') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG os_vif [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:1a:e8,bridge_name='br-int',has_traffic_filtering=True,id=74095f60-9801-4b07-98bf-33541cf69058,network=Network(ee89a769-4a94-475b-b835-e49cabad1f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74095f60-98') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4545d5d-6012-581b-9acc-78c5179fab66', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74095f60-98, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74095f60-98, col_values=(('qos', UUID('ee719fe6-263b-4da6-8899-a2de8dcf2170')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74095f60-98, col_values=(('external_ids', {'iface-id': '74095f60-9801-4b07-98bf-33541cf69058', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:1a:e8', 'vm-uuid': 'd8864353-ba84-4d79-a316-46a185729caa'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:18:55 user nova-compute[75356]: INFO os_vif [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:1a:e8,bridge_name='br-int',has_traffic_filtering=True,id=74095f60-9801-4b07-98bf-33541cf69058,network=Network(ee89a769-4a94-475b-b835-e49cabad1f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74095f60-98')
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] No VIF found with MAC fa:16:3e:78:1a:e8, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e4d92bf-f8c0-45f8-ba80-48f17fefc108/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.network.neutron [req-06d97379-5d63-4726-be6a-2b16516e0fe8 req-8e25bfde-35a0-4cc6-9ba3-b61ccba7ab9e service nova] [instance: d8864353-ba84-4d79-a316-46a185729caa] Updated VIF entry in instance network info cache for port 74095f60-9801-4b07-98bf-33541cf69058. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG nova.network.neutron [req-06d97379-5d63-4726-be6a-2b16516e0fe8 req-8e25bfde-35a0-4cc6-9ba3-b61ccba7ab9e service nova] [instance: d8864353-ba84-4d79-a316-46a185729caa] Updating instance_info_cache with network_info: [{"id": "74095f60-9801-4b07-98bf-33541cf69058", "address": "fa:16:3e:78:1a:e8", "network": {"id": "ee89a769-4a94-475b-b835-e49cabad1f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407371162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f191c68eb9041d289e04d64dc71ddb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74095f60-98", "ovs_interfaceid": "74095f60-9801-4b07-98bf-33541cf69058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e4d92bf-f8c0-45f8-ba80-48f17fefc108/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e4d92bf-f8c0-45f8-ba80-48f17fefc108/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-06d97379-5d63-4726-be6a-2b16516e0fe8 req-8e25bfde-35a0-4cc6-9ba3-b61ccba7ab9e service nova] Releasing lock "refresh_cache-d8864353-ba84-4d79-a316-46a185729caa" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:18:56 user nova-compute[75356]: DEBUG nova.compute.manager [req-3bf110dd-9175-4ddf-82af-0c8aa2206054 req-b3b72eb8-43e1-4fff-9464-1cb1c421d9e3 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Received event network-changed-56a80963-a1f2-429e-8474-1795928fd05c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:56 user nova-compute[75356]: DEBUG nova.compute.manager [req-3bf110dd-9175-4ddf-82af-0c8aa2206054 req-b3b72eb8-43e1-4fff-9464-1cb1c421d9e3 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Refreshing instance network info cache due to event network-changed-56a80963-a1f2-429e-8474-1795928fd05c. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:18:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3bf110dd-9175-4ddf-82af-0c8aa2206054 req-b3b72eb8-43e1-4fff-9464-1cb1c421d9e3 service nova] Acquiring lock "refresh_cache-0b59517a-c467-432a-a73a-d1460c1574e7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:18:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3bf110dd-9175-4ddf-82af-0c8aa2206054 req-b3b72eb8-43e1-4fff-9464-1cb1c421d9e3 service nova] Acquired lock "refresh_cache-0b59517a-c467-432a-a73a-d1460c1574e7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:18:56 user nova-compute[75356]: DEBUG nova.network.neutron [req-3bf110dd-9175-4ddf-82af-0c8aa2206054 req-b3b72eb8-43e1-4fff-9464-1cb1c421d9e3 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Refreshing network info cache for port 56a80963-a1f2-429e-8474-1795928fd05c {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:18:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e4d92bf-f8c0-45f8-ba80-48f17fefc108/disk --force-share --output=json" returned: 0 in 0.735s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:57 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:18:57 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:18:57 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=6801MB free_disk=25.399093627929688GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG nova.compute.manager [req-005c52b4-4404-485a-a165-2386a0f509c7 req-62427d14-f8c2-4947-80a9-2b4cf2ddbc6c service nova] [instance: d8864353-ba84-4d79-a316-46a185729caa] Received event network-vif-plugged-74095f60-9801-4b07-98bf-33541cf69058 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-005c52b4-4404-485a-a165-2386a0f509c7 req-62427d14-f8c2-4947-80a9-2b4cf2ddbc6c service nova] Acquiring lock "d8864353-ba84-4d79-a316-46a185729caa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-005c52b4-4404-485a-a165-2386a0f509c7 req-62427d14-f8c2-4947-80a9-2b4cf2ddbc6c service nova] Lock "d8864353-ba84-4d79-a316-46a185729caa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-005c52b4-4404-485a-a165-2386a0f509c7 req-62427d14-f8c2-4947-80a9-2b4cf2ddbc6c service nova] Lock "d8864353-ba84-4d79-a316-46a185729caa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG nova.compute.manager [req-005c52b4-4404-485a-a165-2386a0f509c7 req-62427d14-f8c2-4947-80a9-2b4cf2ddbc6c service nova] [instance: d8864353-ba84-4d79-a316-46a185729caa] No waiting events found dispatching network-vif-plugged-74095f60-9801-4b07-98bf-33541cf69058 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:18:57 user nova-compute[75356]: WARNING nova.compute.manager [req-005c52b4-4404-485a-a165-2386a0f509c7 req-62427d14-f8c2-4947-80a9-2b4cf2ddbc6c service nova] [instance: d8864353-ba84-4d79-a316-46a185729caa] Received unexpected event network-vif-plugged-74095f60-9801-4b07-98bf-33541cf69058 for instance with vm_state building and task_state spawning.
Nov 29 20:18:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 8db40390-15ae-458b-92c9-7b3bb623ca50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 9751c435-4d10-46dc-86e7-39d40e8209d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0b59517a-c467-432a-a73a-d1460c1574e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 96cbbbdb-e1cc-49da-9a9f-5b83031b235b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 972e22c1-bd85-4507-9166-ace3fce8e698 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ee4a5666-bfea-47bf-bd21-d24685967a3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance fb7280bd-7153-4868-b1c9-35cc77e96277 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance f09171b0-1615-49ee-8c66-8b9c4f0af591 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 1e4d92bf-f8c0-45f8-ba80-48f17fefc108 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 87fe5c12-c611-4855-8190-6406eca25dba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance d8864353-ba84-4d79-a316-46a185729caa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG nova.network.neutron [req-3bf110dd-9175-4ddf-82af-0c8aa2206054 req-b3b72eb8-43e1-4fff-9464-1cb1c421d9e3 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Updated VIF entry in instance network info cache for port 56a80963-a1f2-429e-8474-1795928fd05c. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG nova.network.neutron [req-3bf110dd-9175-4ddf-82af-0c8aa2206054 req-b3b72eb8-43e1-4fff-9464-1cb1c421d9e3 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Updating instance_info_cache with network_info: [{"id": "56a80963-a1f2-429e-8474-1795928fd05c", "address": "fa:16:3e:74:bd:99", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a80963-a1", "ovs_interfaceid": "56a80963-a1f2-429e-8474-1795928fd05c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3bf110dd-9175-4ddf-82af-0c8aa2206054 req-b3b72eb8-43e1-4fff-9464-1cb1c421d9e3 service nova] Releasing lock "refresh_cache-0b59517a-c467-432a-a73a-d1460c1574e7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:18:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.648s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:58 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:18:58 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:18:58 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:18:58 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:18:58 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:18:58 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:18:58 user nova-compute[75356]: DEBUG nova.compute.manager [req-0ef3696c-3aaa-403b-a3fa-56ed47ca99ae req-658de757-55ff-487c-9212-4b3530c395d7 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received event network-changed-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:58 user nova-compute[75356]: DEBUG nova.compute.manager [req-0ef3696c-3aaa-403b-a3fa-56ed47ca99ae req-658de757-55ff-487c-9212-4b3530c395d7 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Refreshing instance network info cache due to event network-changed-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:18:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0ef3696c-3aaa-403b-a3fa-56ed47ca99ae req-658de757-55ff-487c-9212-4b3530c395d7 service nova] Acquiring lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:18:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0ef3696c-3aaa-403b-a3fa-56ed47ca99ae req-658de757-55ff-487c-9212-4b3530c395d7 service nova] Acquired lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:18:58 user nova-compute[75356]: DEBUG nova.network.neutron [req-0ef3696c-3aaa-403b-a3fa-56ed47ca99ae req-658de757-55ff-487c-9212-4b3530c395d7 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Refreshing network info cache for port d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:18:58 user nova-compute[75356]: DEBUG nova.network.neutron [req-0ef3696c-3aaa-403b-a3fa-56ed47ca99ae req-658de757-55ff-487c-9212-4b3530c395d7 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Updated VIF entry in instance network info cache for port d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:18:58 user nova-compute[75356]: DEBUG nova.network.neutron [req-0ef3696c-3aaa-403b-a3fa-56ed47ca99ae req-658de757-55ff-487c-9212-4b3530c395d7 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Updating instance_info_cache with network_info: [{"id": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "address": "fa:16:3e:6b:b2:4e", "network": {"id": "27a8d395-36c8-4f27-89cf-f5019ccbf9a2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45448e5cb4e84c14b1114846a6ccbdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ec4756-3f", "ovs_interfaceid": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:18:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0ef3696c-3aaa-403b-a3fa-56ed47ca99ae req-658de757-55ff-487c-9212-4b3530c395d7 service nova] Releasing lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG nova.compute.manager [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:18:59 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: d8864353-ba84-4d79-a316-46a185729caa] Instance spawned successfully.
Nov 29 20:18:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-c5f721b9-5307-47d8-b959-e20f96fd1d39 req-e88318fd-e28c-4d07-b952-620f009ada6e service nova] [instance: d8864353-ba84-4d79-a316-46a185729caa] Received event network-vif-plugged-74095f60-9801-4b07-98bf-33541cf69058 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c5f721b9-5307-47d8-b959-e20f96fd1d39 req-e88318fd-e28c-4d07-b952-620f009ada6e service nova] Acquiring lock "d8864353-ba84-4d79-a316-46a185729caa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c5f721b9-5307-47d8-b959-e20f96fd1d39 req-e88318fd-e28c-4d07-b952-620f009ada6e service nova] Lock "d8864353-ba84-4d79-a316-46a185729caa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c5f721b9-5307-47d8-b959-e20f96fd1d39 req-e88318fd-e28c-4d07-b952-620f009ada6e service nova] Lock "d8864353-ba84-4d79-a316-46a185729caa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-c5f721b9-5307-47d8-b959-e20f96fd1d39 req-e88318fd-e28c-4d07-b952-620f009ada6e service nova] [instance: d8864353-ba84-4d79-a316-46a185729caa] No waiting events found dispatching network-vif-plugged-74095f60-9801-4b07-98bf-33541cf69058 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:18:59 user nova-compute[75356]: WARNING nova.compute.manager [req-c5f721b9-5307-47d8-b959-e20f96fd1d39 req-e88318fd-e28c-4d07-b952-620f009ada6e service nova] [instance: d8864353-ba84-4d79-a316-46a185729caa] Received unexpected event network-vif-plugged-74095f60-9801-4b07-98bf-33541cf69058 for instance with vm_state building and task_state spawning.
Nov 29 20:18:59 user nova-compute[75356]: INFO nova.compute.manager [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Took 5.97 seconds to spawn the instance on the hypervisor.
Nov 29 20:18:59 user nova-compute[75356]: DEBUG nova.compute.manager [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG nova.compute.manager [None req-1021bc5c-64b8-49a9-902b-7ffcf403f393 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:18:59 user nova-compute[75356]: INFO nova.compute.manager [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Took 6.98 seconds to build instance.
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60d973b-8fa8-4d91-93df-a83b7968d22e tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "d8864353-ba84-4d79-a316-46a185729caa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.147s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:18:59 user nova-compute[75356]: INFO nova.compute.manager [None req-1021bc5c-64b8-49a9-902b-7ffcf403f393 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] instance snapshotting
Nov 29 20:18:59 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-1021bc5c-64b8-49a9-902b-7ffcf403f393 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Beginning live snapshot process
Nov 29 20:18:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uDyWqnbR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:18:59 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:18:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:18:59 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:18:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.016s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:18:59 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b33f37-b8f2-4f87-9ff1-c140bba92be0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:18:59 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0323bf51-4215-4539-bd4a-2ec0e26ea158]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065] added
Nov 29 20:18:59 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f258b06-86a1-4639-bc33-7abb9c85e4e6]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[305c6106-bb83-4536-97e3-17d2596beb97]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uDyWqnbR {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uDyWqnbR" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1694b2fa-1716-4592-a158-13f494a626c7]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uDyWqnbR'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1021bc5c-64b8-49a9-902b-7ffcf403f393 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json -f qcow2 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a792c0-1a9c-40a2-b542-8e2e48f2c615]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[15908831-d2d4-4549-8561-73e254c0df29]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:18:59 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:18:59 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:18:59 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:18:59 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:18:59 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:18:59 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7dd18ad-b97b-4d85-9975-ef81ae90ff81]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065, portal: 172.16.0.220,3260]
Nov 29 20:18:59 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065, portal: 172.16.0.220,3260] successful.
Nov 29 20:18:59 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97fbaf7-6317-488b-845e-cee17e32b4da]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1021bc5c-64b8-49a9-902b-7ffcf403f393 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1021bc5c-64b8-49a9-902b-7ffcf403f393 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json -f qcow2 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[470de5b9-6660-4d37-b046-9e1a5387e563]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:18:59 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:18:59 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:18:59 user nova-compute[75356]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 (non-flash)
Nov 29 20:18:59 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:18:59 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:18:59 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:18:59 user nova-compute[75356]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 (non-flash)
Nov 29 20:18:59 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aaf549d-7a3c-4c27-8124-ee0507d5e3d6]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:18:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uDyWqnbR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:19:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1021bc5c-64b8-49a9-902b-7ffcf403f393 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1021bc5c-64b8-49a9-902b-7ffcf403f393 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1021bc5c-64b8-49a9-902b-7ffcf403f393 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.197s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1021bc5c-64b8-49a9-902b-7ffcf403f393 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp991iwcq0/0b1813dd258245d88b75d936aca73950.delta 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1021bc5c-64b8-49a9-902b-7ffcf403f393 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp991iwcq0/0b1813dd258245d88b75d936aca73950.delta 1073741824" returned: 0 in 0.057s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:00 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-1021bc5c-64b8-49a9-902b-7ffcf403f393 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 20:19:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-1021bc5c-64b8-49a9-902b-7ffcf403f393 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75356) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 29 20:19:00 user nova-compute[75356]: INFO nova.virt.libvirt.host [None req-1021bc5c-64b8-49a9-902b-7ffcf403f393 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] UEFI support detected
Nov 29 20:19:00 user nova-compute[75356]: DEBUG nova.compute.manager [req-86f4afba-17ed-4777-98b2-1d410b34fd5a req-ed0bc439-272f-41f9-bc32-c52464ed4e33 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received event network-changed-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:19:00 user nova-compute[75356]: DEBUG nova.compute.manager [req-86f4afba-17ed-4777-98b2-1d410b34fd5a req-ed0bc439-272f-41f9-bc32-c52464ed4e33 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Refreshing instance network info cache due to event network-changed-bf5b9476-92db-4a94-bcdd-485ba68a4d1e. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:19:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-86f4afba-17ed-4777-98b2-1d410b34fd5a req-ed0bc439-272f-41f9-bc32-c52464ed4e33 service nova] Acquiring lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:19:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-86f4afba-17ed-4777-98b2-1d410b34fd5a req-ed0bc439-272f-41f9-bc32-c52464ed4e33 service nova] Acquired lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:19:00 user nova-compute[75356]: DEBUG nova.network.neutron [req-86f4afba-17ed-4777-98b2-1d410b34fd5a req-ed0bc439-272f-41f9-bc32-c52464ed4e33 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Refreshing network info cache for port bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:19:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:19:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26433616539316635', 'path': '/dev/sde'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:19:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433616539316635', 'path': '/dev/sde'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:19:00 user nova-compute[75356]: DEBUG nova.objects.instance [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lazy-loading 'flavor' on Instance uuid 8db40390-15ae-458b-92c9-7b3bb623ca50 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:19:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:19:00 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:19:00 user nova-compute[75356]:   <source dev="/dev/sde"/>
Nov 29 20:19:00 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:19:00 user nova-compute[75356]:   <serial>f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065</serial>
Nov 29 20:19:00 user nova-compute[75356]: </disk>
Nov 29 20:19:00 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:19:01 user nova-compute[75356]: DEBUG nova.network.neutron [req-86f4afba-17ed-4777-98b2-1d410b34fd5a req-ed0bc439-272f-41f9-bc32-c52464ed4e33 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Updated VIF entry in instance network info cache for port bf5b9476-92db-4a94-bcdd-485ba68a4d1e. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:19:01 user nova-compute[75356]: DEBUG nova.network.neutron [req-86f4afba-17ed-4777-98b2-1d410b34fd5a req-ed0bc439-272f-41f9-bc32-c52464ed4e33 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Updating instance_info_cache with network_info: [{"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:19:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-1021bc5c-64b8-49a9-902b-7ffcf403f393 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:19:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-86f4afba-17ed-4777-98b2-1d410b34fd5a req-ed0bc439-272f-41f9-bc32-c52464ed4e33 service nova] Releasing lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:19:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:19:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:19:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] No VIF found with MAC fa:16:3e:4f:06:83, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:19:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-1021bc5c-64b8-49a9-902b-7ffcf403f393 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:19:01 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-1021bc5c-64b8-49a9-902b-7ffcf403f393 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 20:19:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3a5505e5-4b0e-405d-9d6e-8c65febbb482 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "8db40390-15ae-458b-92c9-7b3bb623ca50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:01 user nova-compute[75356]: DEBUG nova.privsep.utils [None req-1021bc5c-64b8-49a9-902b-7ffcf403f393 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75356) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 20:19:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1021bc5c-64b8-49a9-902b-7ffcf403f393 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp991iwcq0/0b1813dd258245d88b75d936aca73950.delta /opt/stack/data/nova/instances/snapshots/tmp991iwcq0/0b1813dd258245d88b75d936aca73950 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1021bc5c-64b8-49a9-902b-7ffcf403f393 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp991iwcq0/0b1813dd258245d88b75d936aca73950.delta /opt/stack/data/nova/instances/snapshots/tmp991iwcq0/0b1813dd258245d88b75d936aca73950" returned: 0 in 0.413s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:02 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-1021bc5c-64b8-49a9-902b-7ffcf403f393 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Snapshot extracted, beginning image upload
Nov 29 20:19:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Acquiring lock "8db40390-15ae-458b-92c9-7b3bb623ca50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "8db40390-15ae-458b-92c9-7b3bb623ca50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Acquiring lock "8db40390-15ae-458b-92c9-7b3bb623ca50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "8db40390-15ae-458b-92c9-7b3bb623ca50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "8db40390-15ae-458b-92c9-7b3bb623ca50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:02 user nova-compute[75356]: INFO nova.compute.manager [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Terminating instance
Nov 29 20:19:02 user nova-compute[75356]: DEBUG nova.compute.manager [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:19:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG nova.compute.manager [req-588e410b-e765-4360-9b5f-aff8e786d62b req-57b4ef33-fd01-4d0f-b6bf-bc85cd0d7490 service nova] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Received event network-vif-unplugged-624866cb-b225-4a69-a62b-56d89ce17653 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-588e410b-e765-4360-9b5f-aff8e786d62b req-57b4ef33-fd01-4d0f-b6bf-bc85cd0d7490 service nova] Acquiring lock "8db40390-15ae-458b-92c9-7b3bb623ca50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-588e410b-e765-4360-9b5f-aff8e786d62b req-57b4ef33-fd01-4d0f-b6bf-bc85cd0d7490 service nova] Lock "8db40390-15ae-458b-92c9-7b3bb623ca50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-588e410b-e765-4360-9b5f-aff8e786d62b req-57b4ef33-fd01-4d0f-b6bf-bc85cd0d7490 service nova] Lock "8db40390-15ae-458b-92c9-7b3bb623ca50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG nova.compute.manager [req-588e410b-e765-4360-9b5f-aff8e786d62b req-57b4ef33-fd01-4d0f-b6bf-bc85cd0d7490 service nova] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] No waiting events found dispatching network-vif-unplugged-624866cb-b225-4a69-a62b-56d89ce17653 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG nova.compute.manager [req-588e410b-e765-4360-9b5f-aff8e786d62b req-57b4ef33-fd01-4d0f-b6bf-bc85cd0d7490 service nova] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Received event network-vif-unplugged-624866cb-b225-4a69-a62b-56d89ce17653 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:03 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Instance destroyed successfully.
Nov 29 20:19:03 user nova-compute[75356]: DEBUG nova.objects.instance [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lazy-loading 'resources' on Instance uuid 8db40390-15ae-458b-92c9-7b3bb623ca50 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:16:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2092928798',display_name='tempest-DeleteServersTestJSON-server-2092928798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2092928798',id=1,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:17:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='459348467eb445f2966cd9c21f69fc73',ramdisk_id='',reservation_id='r-bdc9006k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-32256473',owner_user_name='tempest-DeleteServersTestJSON-32256473-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:17:10Z,user_data=None,user_id='56b1575653a64d519496e59953e2abc4',uuid=8db40390-15ae-458b-92c9-7b3bb623ca50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "624866cb-b225-4a69-a62b-56d89ce17653", "address": "fa:16:3e:4f:06:83", "network": {"id": "7965cbec-9ba2-4bf6-b812-d82f8ebcd64a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-125869777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459348467eb445f2966cd9c21f69fc73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624866cb-b2", "ovs_interfaceid": "624866cb-b225-4a69-a62b-56d89ce17653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Converting VIF {"id": "624866cb-b225-4a69-a62b-56d89ce17653", "address": "fa:16:3e:4f:06:83", "network": {"id": "7965cbec-9ba2-4bf6-b812-d82f8ebcd64a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-125869777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459348467eb445f2966cd9c21f69fc73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624866cb-b2", "ovs_interfaceid": "624866cb-b225-4a69-a62b-56d89ce17653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:06:83,bridge_name='br-int',has_traffic_filtering=True,id=624866cb-b225-4a69-a62b-56d89ce17653,network=Network(7965cbec-9ba2-4bf6-b812-d82f8ebcd64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624866cb-b2') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG os_vif [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:06:83,bridge_name='br-int',has_traffic_filtering=True,id=624866cb-b225-4a69-a62b-56d89ce17653,network=Network(7965cbec-9ba2-4bf6-b812-d82f8ebcd64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624866cb-b2') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap624866cb-b2, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=865f7a78-d458-4f31-b650-c93e6cdf4c1e) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:03 user nova-compute[75356]: INFO os_vif [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:06:83,bridge_name='br-int',has_traffic_filtering=True,id=624866cb-b225-4a69-a62b-56d89ce17653,network=Network(7965cbec-9ba2-4bf6-b812-d82f8ebcd64a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624866cb-b2')
Nov 29 20:19:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uDyWqnbR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:19:03 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:19:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c86b45-2554-40bb-81ff-5d2085398095]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:19:03 user nova-compute[75356]: No targets found.
Nov 29 20:19:03 user nova-compute[75356]: iSNS:
Nov 29 20:19:03 user nova-compute[75356]: No targets found.
Nov 29 20:19:03 user nova-compute[75356]: STATIC:
Nov 29 20:19:03 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547
Nov 29 20:19:03 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:03 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:03 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f
Nov 29 20:19:03 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:03 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:03 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7
Nov 29 20:19:03 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:03 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:03 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065
Nov 29 20:19:03 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:03 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:03 user nova-compute[75356]: FIRMWARE:
Nov 29 20:19:03 user nova-compute[75356]: No targets found.
Nov 29 20:19:03 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:19:03 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:19:03 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed1e724-90b7-47c7-9fe9-6d29c10a993c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[365eb33c-e83f-4054-a857-6d331756d051]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:03 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:03 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:03 user nova-compute[75356]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 (non-flash)
Nov 29 20:19:03 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:03 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:03 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:03 user nova-compute[75356]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 (non-flash)
Nov 29 20:19:03 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8308395ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065'): ({'sde'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Removing single pathed devices sde {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b8265c-36e2-43fe-88e5-d1c5a552c0ed]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[09424d27-63ca-4397-a931-9fe98fb058d5]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Flushing IO for device /dev/sde {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd363f4-0cb4-4c07-9fff-685e6e9e66ae]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b90e6a-93cc-4343-a184-9ec61a7c8e24]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] SCSI volumes sde have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[642544ce-91f7-48f6-9067-a11155b22abb]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:04 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f28f0d-3eac-4499-aedc-b0c04feafd9b]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065, portal: 172.16.0.220,3260]
Nov 29 20:19:04 user nova-compute[75356]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065, portal: 172.16.0.220,3260] successful.
Nov 29 20:19:04 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2cc8f7c-6aa9-47f0-8e0f-3a0a6b929065 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:04 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffc3081-ec12-4737-9a61-38bf9763e26b]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:19:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] <== disconnect_volume: return (338ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:19:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:19:04 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Deleting instance files /opt/stack/data/nova/instances/8db40390-15ae-458b-92c9-7b3bb623ca50_del
Nov 29 20:19:04 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Deletion of /opt/stack/data/nova/instances/8db40390-15ae-458b-92c9-7b3bb623ca50_del complete
Nov 29 20:19:04 user nova-compute[75356]: INFO nova.compute.manager [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 29 20:19:04 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:19:04 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:19:04 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:19:04 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:19:04 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Took 0.52 seconds to deallocate network for instance.
Nov 29 20:19:04 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-1021bc5c-64b8-49a9-902b-7ffcf403f393 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Snapshot image upload complete
Nov 29 20:19:04 user nova-compute[75356]: INFO nova.compute.manager [None req-1021bc5c-64b8-49a9-902b-7ffcf403f393 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Took 5.42 seconds to snapshot the instance on the hypervisor.
Nov 29 20:19:05 user nova-compute[75356]: DEBUG nova.compute.manager [req-13bbe880-4d32-4565-9dd6-0ac0778d9a66 req-9a09cad5-b74d-4956-ba95-357a35403e79 service nova] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Received event network-vif-plugged-624866cb-b225-4a69-a62b-56d89ce17653 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:19:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-13bbe880-4d32-4565-9dd6-0ac0778d9a66 req-9a09cad5-b74d-4956-ba95-357a35403e79 service nova] Acquiring lock "8db40390-15ae-458b-92c9-7b3bb623ca50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-13bbe880-4d32-4565-9dd6-0ac0778d9a66 req-9a09cad5-b74d-4956-ba95-357a35403e79 service nova] Lock "8db40390-15ae-458b-92c9-7b3bb623ca50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-13bbe880-4d32-4565-9dd6-0ac0778d9a66 req-9a09cad5-b74d-4956-ba95-357a35403e79 service nova] Lock "8db40390-15ae-458b-92c9-7b3bb623ca50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:05 user nova-compute[75356]: DEBUG nova.compute.manager [req-13bbe880-4d32-4565-9dd6-0ac0778d9a66 req-9a09cad5-b74d-4956-ba95-357a35403e79 service nova] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] No waiting events found dispatching network-vif-plugged-624866cb-b225-4a69-a62b-56d89ce17653 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:19:05 user nova-compute[75356]: WARNING nova.compute.manager [req-13bbe880-4d32-4565-9dd6-0ac0778d9a66 req-9a09cad5-b74d-4956-ba95-357a35403e79 service nova] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Received unexpected event network-vif-plugged-624866cb-b225-4a69-a62b-56d89ce17653 for instance with vm_state active and task_state deleting.
Nov 29 20:19:05 user nova-compute[75356]: DEBUG nova.compute.manager [req-13bbe880-4d32-4565-9dd6-0ac0778d9a66 req-9a09cad5-b74d-4956-ba95-357a35403e79 service nova] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Received event network-vif-deleted-624866cb-b225-4a69-a62b-56d89ce17653 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:19:05 user nova-compute[75356]: INFO nova.compute.manager [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] [instance: 8db40390-15ae-458b-92c9-7b3bb623ca50] Took 0.89 seconds to detach 1 volumes for instance.
Nov 29 20:19:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:06 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:19:06 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:19:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.501s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:06 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Deleted allocations for instance 8db40390-15ae-458b-92c9-7b3bb623ca50
Nov 29 20:19:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bdc7a6eb-b260-4981-8ab2-8bc873dba159 tempest-DeleteServersTestJSON-32256473 tempest-DeleteServersTestJSON-32256473-project-member] Lock "8db40390-15ae-458b-92c9-7b3bb623ca50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.451s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:12 user nova-compute[75356]: DEBUG nova.compute.manager [req-e3fa6cb4-44a4-4a16-bbc1-6d866b761ff6 req-0734135f-2bf7-4f2b-802c-8e809c5e3ba0 service nova] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Received event network-changed-cfb6a771-e8ce-43da-aebb-742cb2afdbcb {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:19:12 user nova-compute[75356]: DEBUG nova.compute.manager [req-e3fa6cb4-44a4-4a16-bbc1-6d866b761ff6 req-0734135f-2bf7-4f2b-802c-8e809c5e3ba0 service nova] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Refreshing instance network info cache due to event network-changed-cfb6a771-e8ce-43da-aebb-742cb2afdbcb. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:19:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e3fa6cb4-44a4-4a16-bbc1-6d866b761ff6 req-0734135f-2bf7-4f2b-802c-8e809c5e3ba0 service nova] Acquiring lock "refresh_cache-972e22c1-bd85-4507-9166-ace3fce8e698" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:19:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e3fa6cb4-44a4-4a16-bbc1-6d866b761ff6 req-0734135f-2bf7-4f2b-802c-8e809c5e3ba0 service nova] Acquired lock "refresh_cache-972e22c1-bd85-4507-9166-ace3fce8e698" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:19:12 user nova-compute[75356]: DEBUG nova.network.neutron [req-e3fa6cb4-44a4-4a16-bbc1-6d866b761ff6 req-0734135f-2bf7-4f2b-802c-8e809c5e3ba0 service nova] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Refreshing network info cache for port cfb6a771-e8ce-43da-aebb-742cb2afdbcb {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:19:12 user nova-compute[75356]: DEBUG nova.network.neutron [req-e3fa6cb4-44a4-4a16-bbc1-6d866b761ff6 req-0734135f-2bf7-4f2b-802c-8e809c5e3ba0 service nova] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Updated VIF entry in instance network info cache for port cfb6a771-e8ce-43da-aebb-742cb2afdbcb. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:19:12 user nova-compute[75356]: DEBUG nova.network.neutron [req-e3fa6cb4-44a4-4a16-bbc1-6d866b761ff6 req-0734135f-2bf7-4f2b-802c-8e809c5e3ba0 service nova] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Updating instance_info_cache with network_info: [{"id": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "address": "fa:16:3e:3b:bc:00", "network": {"id": "4e1439ac-1b43-4407-997e-6ac5b6a0066f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2125172073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2e9eb99ca1b4dddb0075e78847b980b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb6a771-e8", "ovs_interfaceid": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:19:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e3fa6cb4-44a4-4a16-bbc1-6d866b761ff6 req-0734135f-2bf7-4f2b-802c-8e809c5e3ba0 service nova] Releasing lock "refresh_cache-972e22c1-bd85-4507-9166-ace3fce8e698" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:19:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "972e22c1-bd85-4507-9166-ace3fce8e698" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "972e22c1-bd85-4507-9166-ace3fce8e698" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:14 user nova-compute[75356]: DEBUG nova.objects.instance [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lazy-loading 'flavor' on Instance uuid 972e22c1-bd85-4507-9166-ace3fce8e698 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:19:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "972e22c1-bd85-4507-9166-ace3fce8e698" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "972e22c1-bd85-4507-9166-ace3fce8e698" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "972e22c1-bd85-4507-9166-ace3fce8e698" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:14 user nova-compute[75356]: INFO nova.compute.manager [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Attaching volume 80960645-eeae-46ba-99ef-09ed5d8f499c to /dev/vdb
Nov 29 20:19:14 user nova-compute[75356]: DEBUG os_brick.utils [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:19:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[695828bc-d235-410a-b962-1e7abe0393a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c76082-72d7-4c35-ac6d-03578d8b8b9f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[518537ae-b8e8-4903-ac32-4e401a3769bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abe5d2a-e7d6-481e-9091-5539944b387d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:19:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:19:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:19:15 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:19:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf83a5c-411d-4093-8933-45dbc0c84088]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:19:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:19:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:19:15 user nova-compute[75356]: DEBUG os_brick.utils [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:19:15 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Updating existing volume attachment record: 172e1242-313a-4a16-af82-9b3a0f9c4431 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:19:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-a635d96b-d73e-4826-9493-cc4fd09c1218 req-f3653183-7f56-406a-826b-33f4c5f4bfc5 service nova] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Received event network-changed-b400acb7-2f4f-45da-80f9-069c8cc27f45 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:19:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-a635d96b-d73e-4826-9493-cc4fd09c1218 req-f3653183-7f56-406a-826b-33f4c5f4bfc5 service nova] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Refreshing instance network info cache due to event network-changed-b400acb7-2f4f-45da-80f9-069c8cc27f45. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:19:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a635d96b-d73e-4826-9493-cc4fd09c1218 req-f3653183-7f56-406a-826b-33f4c5f4bfc5 service nova] Acquiring lock "refresh_cache-ee4a5666-bfea-47bf-bd21-d24685967a3e" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:19:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a635d96b-d73e-4826-9493-cc4fd09c1218 req-f3653183-7f56-406a-826b-33f4c5f4bfc5 service nova] Acquired lock "refresh_cache-ee4a5666-bfea-47bf-bd21-d24685967a3e" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:19:19 user nova-compute[75356]: DEBUG nova.network.neutron [req-a635d96b-d73e-4826-9493-cc4fd09c1218 req-f3653183-7f56-406a-826b-33f4c5f4bfc5 service nova] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Refreshing network info cache for port b400acb7-2f4f-45da-80f9-069c8cc27f45 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:19:19 user nova-compute[75356]: DEBUG nova.network.neutron [req-a635d96b-d73e-4826-9493-cc4fd09c1218 req-f3653183-7f56-406a-826b-33f4c5f4bfc5 service nova] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Updated VIF entry in instance network info cache for port b400acb7-2f4f-45da-80f9-069c8cc27f45. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:19:19 user nova-compute[75356]: DEBUG nova.network.neutron [req-a635d96b-d73e-4826-9493-cc4fd09c1218 req-f3653183-7f56-406a-826b-33f4c5f4bfc5 service nova] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Updating instance_info_cache with network_info: [{"id": "b400acb7-2f4f-45da-80f9-069c8cc27f45", "address": "fa:16:3e:87:5a:bf", "network": {"id": "6712a3cd-234a-421e-9d18-5d1e28708025", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-371973715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ffd2755d0a4059aef77a33d42c29d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb400acb7-2f", "ovs_interfaceid": "b400acb7-2f4f-45da-80f9-069c8cc27f45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:19:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a635d96b-d73e-4826-9493-cc4fd09c1218 req-f3653183-7f56-406a-826b-33f4c5f4bfc5 service nova] Releasing lock "refresh_cache-ee4a5666-bfea-47bf-bd21-d24685967a3e" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:19:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-4eda9fa2-d048-4ebc-8bf6-6325a5ebf83e req-efabecc8-a561-4a56-9737-3547339111c6 service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Received event network-changed-577e6509-523f-46e2-9994-9d1eb9ff0c13 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:19:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-4eda9fa2-d048-4ebc-8bf6-6325a5ebf83e req-efabecc8-a561-4a56-9737-3547339111c6 service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Refreshing instance network info cache due to event network-changed-577e6509-523f-46e2-9994-9d1eb9ff0c13. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:19:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4eda9fa2-d048-4ebc-8bf6-6325a5ebf83e req-efabecc8-a561-4a56-9737-3547339111c6 service nova] Acquiring lock "refresh_cache-3d1a8bb2-82f9-4a3f-aeff-a5472477d651" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:19:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4eda9fa2-d048-4ebc-8bf6-6325a5ebf83e req-efabecc8-a561-4a56-9737-3547339111c6 service nova] Acquired lock "refresh_cache-3d1a8bb2-82f9-4a3f-aeff-a5472477d651" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:19:20 user nova-compute[75356]: DEBUG nova.network.neutron [req-4eda9fa2-d048-4ebc-8bf6-6325a5ebf83e req-efabecc8-a561-4a56-9737-3547339111c6 service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Refreshing network info cache for port 577e6509-523f-46e2-9994-9d1eb9ff0c13 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:19:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Acquiring lock "interface-3d1a8bb2-82f9-4a3f-aeff-a5472477d651-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "interface-3d1a8bb2-82f9-4a3f-aeff-a5472477d651-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:21 user nova-compute[75356]: DEBUG nova.objects.instance [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lazy-loading 'flavor' on Instance uuid 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG nova.network.neutron [req-4eda9fa2-d048-4ebc-8bf6-6325a5ebf83e req-efabecc8-a561-4a56-9737-3547339111c6 service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Updated VIF entry in instance network info cache for port 577e6509-523f-46e2-9994-9d1eb9ff0c13. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG nova.network.neutron [req-4eda9fa2-d048-4ebc-8bf6-6325a5ebf83e req-efabecc8-a561-4a56-9737-3547339111c6 service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Updating instance_info_cache with network_info: [{"id": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "address": "fa:16:3e:34:be:70", "network": {"id": "fe921eef-0c3b-459b-b302-b879394d578b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-572349767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577e6509-52", "ovs_interfaceid": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4eda9fa2-d048-4ebc-8bf6-6325a5ebf83e req-efabecc8-a561-4a56-9737-3547339111c6 service nova] Releasing lock "refresh_cache-3d1a8bb2-82f9-4a3f-aeff-a5472477d651" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Acquiring lock "ee4a5666-bfea-47bf-bd21-d24685967a3e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "ee4a5666-bfea-47bf-bd21-d24685967a3e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG nova.objects.instance [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lazy-loading 'pci_requests' on Instance uuid 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG nova.objects.instance [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lazy-loading 'flavor' on Instance uuid ee4a5666-bfea-47bf-bd21-d24685967a3e {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG nova.objects.base [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Object Instance<3d1a8bb2-82f9-4a3f-aeff-a5472477d651> lazy-loaded attributes: flavor,pci_requests {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG nova.network.neutron [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "ee4a5666-bfea-47bf-bd21-d24685967a3e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG nova.policy [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5b4a48f9bfd406cae779bfc3dc5e302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076d6fb1d7e1485f847881bd7fe665f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Acquiring lock "ee4a5666-bfea-47bf-bd21-d24685967a3e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "ee4a5666-bfea-47bf-bd21-d24685967a3e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:22 user nova-compute[75356]: INFO nova.compute.manager [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Attaching volume 99b9fce4-7c65-4fb3-8c39-f436fffa84b7 to /dev/sdc
Nov 29 20:19:22 user nova-compute[75356]: DEBUG os_brick.utils [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[584d6d58-8803-4914-bc8e-dfb2713e73db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9163c829-5afd-4a73-add2-4da05af9f905]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[153863e2-77e0-421a-b38d-15d3760bc9e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48b463b-eb79-4b26-a522-512166f85768]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:19:22 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:19:22 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[06485e1c-e2cb-4d51-abbb-ad4cc0db7d97]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG os_brick.utils [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:19:22 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Updating existing volume attachment record: 5c50e928-3ad6-435e-ba8b-45876dea3bf6 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG nova.network.neutron [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Successfully created port: f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG nova.compute.manager [req-236e98a2-ef70-4bed-afa9-11de74ee093b req-5422c2f1-8df0-44a1-869d-b8a5984de762 service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Received event network-changed-14000a37-7834-4054-8a54-331e7d5d9d7b {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG nova.compute.manager [req-236e98a2-ef70-4bed-afa9-11de74ee093b req-5422c2f1-8df0-44a1-869d-b8a5984de762 service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Refreshing instance network info cache due to event network-changed-14000a37-7834-4054-8a54-331e7d5d9d7b. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-236e98a2-ef70-4bed-afa9-11de74ee093b req-5422c2f1-8df0-44a1-869d-b8a5984de762 service nova] Acquiring lock "refresh_cache-fb7280bd-7153-4868-b1c9-35cc77e96277" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-236e98a2-ef70-4bed-afa9-11de74ee093b req-5422c2f1-8df0-44a1-869d-b8a5984de762 service nova] Acquired lock "refresh_cache-fb7280bd-7153-4868-b1c9-35cc77e96277" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG nova.network.neutron [req-236e98a2-ef70-4bed-afa9-11de74ee093b req-5422c2f1-8df0-44a1-869d-b8a5984de762 service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Refreshing network info cache for port 14000a37-7834-4054-8a54-331e7d5d9d7b {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Acquiring lock "fb7280bd-7153-4868-b1c9-35cc77e96277" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GyfBojbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:19:23 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:19:23 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:19:23 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG nova.objects.instance [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lazy-loading 'flavor' on Instance uuid fb7280bd-7153-4868-b1c9-35cc77e96277 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef85bb2-d2b9-414c-a4aa-8bf7bbd2d6a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:19:23 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4933fddf-4e73-4a85-930f-5a0c4ea8ad29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c] added
Nov 29 20:19:23 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[692a2ed4-9572-446f-b0cb-00955e7d48a5]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb941ef5-225b-4b6a-9961-8ad3500cd656]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GyfBojbJ {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GyfBojbJ" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[527c64d9-d82f-4804-966c-5d9f0e3b05fb]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GyfBojbJ'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d985abdd-78d9-4594-8cdd-f60a798a945c]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9474e14c-c63f-4215-ad95-4390f9acf07b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:23 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:23 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:23 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:23 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:23 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:23 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Acquiring lock "fb7280bd-7153-4868-b1c9-35cc77e96277" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:23 user nova-compute[75356]: INFO nova.compute.manager [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Attaching volume d655d5aa-afbe-448d-9068-36b17ef93b78 to /dev/vdb
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[390222f2-8e23-47f9-8765-f3ccf0d7e4c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c, portal: 172.16.0.220,3260]
Nov 29 20:19:23 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c, portal: 172.16.0.220,3260] successful.
Nov 29 20:19:23 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f181de69-353e-46be-9827-2c4e0b162ed7]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.utils [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5396c2-9c96-4ae8-9a46-2bc1de3e8fb7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:23 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:23 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:23 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:23 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:23 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:23 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:23 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:23 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3c77bd-3f39-4b7a-a7e7-a95756ecd06e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[81095157-7ddd-41fb-8fd2-c6588e4106c2]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GyfBojbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3b5223-4685-4220-89e2-500ac946683c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37ed218-d969-4687-956b-91afa611a0b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[966b501a-1467-42e6-897b-50bdb49d0f84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:19:23 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f1b20c-7983-4842-9628-a911f5176089]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG os_brick.utils [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Updating existing volume attachment record: 45e8117f-0251-4349-98a2-05bdbed99a1e {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG nova.network.neutron [req-236e98a2-ef70-4bed-afa9-11de74ee093b req-5422c2f1-8df0-44a1-869d-b8a5984de762 service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Updated VIF entry in instance network info cache for port 14000a37-7834-4054-8a54-331e7d5d9d7b. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG nova.network.neutron [req-236e98a2-ef70-4bed-afa9-11de74ee093b req-5422c2f1-8df0-44a1-869d-b8a5984de762 service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Updating instance_info_cache with network_info: [{"id": "14000a37-7834-4054-8a54-331e7d5d9d7b", "address": "fa:16:3e:36:54:40", "network": {"id": "c577b91d-6b91-44ff-b28f-40bc465b16b5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2092872784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4965cd9c0823424d9e7dd283d7f7b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14000a37-78", "ovs_interfaceid": "14000a37-7834-4054-8a54-331e7d5d9d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-236e98a2-ef70-4bed-afa9-11de74ee093b req-5422c2f1-8df0-44a1-869d-b8a5984de762 service nova] Releasing lock "refresh_cache-fb7280bd-7153-4868-b1c9-35cc77e96277" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:19:23 user nova-compute[75356]: DEBUG nova.network.neutron [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Successfully updated port: f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:19:24 user nova-compute[75356]: DEBUG nova.compute.manager [req-96174405-5271-48d7-9f72-ceaa91d5395e req-5c565a71-5856-44b5-9dce-8c0cb2ab3944 service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Received event network-changed-f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:19:24 user nova-compute[75356]: DEBUG nova.compute.manager [req-96174405-5271-48d7-9f72-ceaa91d5395e req-5c565a71-5856-44b5-9dce-8c0cb2ab3944 service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Refreshing instance network info cache due to event network-changed-f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:19:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-96174405-5271-48d7-9f72-ceaa91d5395e req-5c565a71-5856-44b5-9dce-8c0cb2ab3944 service nova] Acquiring lock "refresh_cache-3d1a8bb2-82f9-4a3f-aeff-a5472477d651" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:19:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-96174405-5271-48d7-9f72-ceaa91d5395e req-5c565a71-5856-44b5-9dce-8c0cb2ab3944 service nova] Acquired lock "refresh_cache-3d1a8bb2-82f9-4a3f-aeff-a5472477d651" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:19:24 user nova-compute[75356]: DEBUG nova.network.neutron [req-96174405-5271-48d7-9f72-ceaa91d5395e req-5c565a71-5856-44b5-9dce-8c0cb2ab3944 service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Refreshing network info cache for port f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:19:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Acquiring lock "refresh_cache-3d1a8bb2-82f9-4a3f-aeff-a5472477d651" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:19:24 user nova-compute[75356]: DEBUG nova.network.neutron [req-96174405-5271-48d7-9f72-ceaa91d5395e req-5c565a71-5856-44b5-9dce-8c0cb2ab3944 service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Added VIF to instance network info cache for port f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3488}}
Nov 29 20:19:24 user nova-compute[75356]: DEBUG nova.network.neutron [req-96174405-5271-48d7-9f72-ceaa91d5395e req-5c565a71-5856-44b5-9dce-8c0cb2ab3944 service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Updating instance_info_cache with network_info: [{"id": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "address": "fa:16:3e:34:be:70", "network": {"id": "fe921eef-0c3b-459b-b302-b879394d578b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-572349767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577e6509-52", "ovs_interfaceid": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "address": "fa:16:3e:29:9d:4c", "network": {"id": "f2704b81-951a-4297-9c57-421301a5a26d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-239219297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52c2f0a-7f", "ovs_interfaceid": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:19:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-96174405-5271-48d7-9f72-ceaa91d5395e req-5c565a71-5856-44b5-9dce-8c0cb2ab3944 service nova] Releasing lock "refresh_cache-3d1a8bb2-82f9-4a3f-aeff-a5472477d651" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:19:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Acquired lock "refresh_cache-3d1a8bb2-82f9-4a3f-aeff-a5472477d651" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:19:24 user nova-compute[75356]: DEBUG nova.network.neutron [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:19:24 user nova-compute[75356]: WARNING nova.network.neutron [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] f2704b81-951a-4297-9c57-421301a5a26d already exists in list: networks containing: ['f2704b81-951a-4297-9c57-421301a5a26d']. ignoring it
Nov 29 20:19:24 user nova-compute[75356]: WARNING nova.network.neutron [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4 already exists in list: port_ids containing: ['f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4']. ignoring it
Nov 29 20:19:24 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:19:24 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23965323631356434', 'path': '/dev/sde'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:19:24 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965323631356434', 'path': '/dev/sde'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:19:24 user nova-compute[75356]: DEBUG nova.objects.instance [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lazy-loading 'flavor' on Instance uuid 972e22c1-bd85-4507-9166-ace3fce8e698 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:19:24 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:19:24 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:19:24 user nova-compute[75356]:   <source dev="/dev/sde"/>
Nov 29 20:19:24 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:19:24 user nova-compute[75356]:   <serial>80960645-eeae-46ba-99ef-09ed5d8f499c</serial>
Nov 29 20:19:24 user nova-compute[75356]: </disk>
Nov 29 20:19:24 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG nova.network.neutron [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Updating instance_info_cache with network_info: [{"id": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "address": "fa:16:3e:34:be:70", "network": {"id": "fe921eef-0c3b-459b-b302-b879394d578b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-572349767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577e6509-52", "ovs_interfaceid": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "address": "fa:16:3e:29:9d:4c", "network": {"id": "f2704b81-951a-4297-9c57-421301a5a26d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-239219297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52c2f0a-7f", "ovs_interfaceid": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Releasing lock "refresh_cache-3d1a8bb2-82f9-4a3f-aeff-a5472477d651" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2087794140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2087794140',id=8,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMcSB5W90J44Qo16Oh0Cpy3jhi4X0540/9A+XafSyfNEzKrqoj4TuajJuNFlGXhbGXb/O9kxaBhSAt46g/kgqUtmOKqWshX+iOmBJWeort/VCkacPfcnj7JuOcU0rQEdQ==',key_name='tempest-keypair-504121784',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:17:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='076d6fb1d7e1485f847881bd7fe665f3',ramdisk_id='',reservation_id='r-8hmccieq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-75465737',owner_user_name='tempest-TaggedAttachmentsTest-75465737-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:17:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5b4a48f9bfd406cae779bfc3dc5e302',uuid=3d1a8bb2-82f9-4a3f-aeff-a5472477d651,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "address": "fa:16:3e:29:9d:4c", "network": {"id": "f2704b81-951a-4297-9c57-421301a5a26d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-239219297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52c2f0a-7f", "ovs_interfaceid": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Converting VIF {"id": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "address": "fa:16:3e:29:9d:4c", "network": {"id": "f2704b81-951a-4297-9c57-421301a5a26d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-239219297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52c2f0a-7f", "ovs_interfaceid": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:9d:4c,bridge_name='br-int',has_traffic_filtering=True,id=f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4,network=Network(f2704b81-951a-4297-9c57-421301a5a26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52c2f0a-7f') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG os_vif [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:9d:4c,bridge_name='br-int',has_traffic_filtering=True,id=f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4,network=Network(f2704b81-951a-4297-9c57-421301a5a26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52c2f0a-7f') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f93f688-4274-599e-8de7-73a24a2a8f72', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf52c2f0a-7f, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf52c2f0a-7f, col_values=(('qos', UUID('a8b6e908-d873-4d62-8db8-7b92437b65be')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf52c2f0a-7f, col_values=(('external_ids', {'iface-id': 'f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:9d:4c', 'vm-uuid': '3d1a8bb2-82f9-4a3f-aeff-a5472477d651'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:25 user nova-compute[75356]: INFO os_vif [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:9d:4c,bridge_name='br-int',has_traffic_filtering=True,id=f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4,network=Network(f2704b81-951a-4297-9c57-421301a5a26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52c2f0a-7f')
Nov 29 20:19:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2087794140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2087794140',id=8,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMcSB5W90J44Qo16Oh0Cpy3jhi4X0540/9A+XafSyfNEzKrqoj4TuajJuNFlGXhbGXb/O9kxaBhSAt46g/kgqUtmOKqWshX+iOmBJWeort/VCkacPfcnj7JuOcU0rQEdQ==',key_name='tempest-keypair-504121784',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:17:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='076d6fb1d7e1485f847881bd7fe665f3',ramdisk_id='',reservation_id='r-8hmccieq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-75465737',owner_user_name='tempest-TaggedAttachmentsTest-75465737-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:17:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5b4a48f9bfd406cae779bfc3dc5e302',uuid=3d1a8bb2-82f9-4a3f-aeff-a5472477d651,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "address": "fa:16:3e:29:9d:4c", "network": {"id": "f2704b81-951a-4297-9c57-421301a5a26d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-239219297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52c2f0a-7f", "ovs_interfaceid": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Converting VIF {"id": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "address": "fa:16:3e:29:9d:4c", "network": {"id": "f2704b81-951a-4297-9c57-421301a5a26d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-239219297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52c2f0a-7f", "ovs_interfaceid": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:9d:4c,bridge_name='br-int',has_traffic_filtering=True,id=f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4,network=Network(f2704b81-951a-4297-9c57-421301a5a26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52c2f0a-7f') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] attach device xml: <interface type="ethernet">
Nov 29 20:19:25 user nova-compute[75356]:   <mac address="fa:16:3e:29:9d:4c"/>
Nov 29 20:19:25 user nova-compute[75356]:   <model type="virtio"/>
Nov 29 20:19:25 user nova-compute[75356]:   <mtu size="1442"/>
Nov 29 20:19:25 user nova-compute[75356]:   <target dev="tapf52c2f0a-7f"/>
Nov 29 20:19:25 user nova-compute[75356]: </interface>
Nov 29 20:19:25 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] No VIF found with MAC fa:16:3e:3b:bc:00, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e50313b3-feae-4dbb-a59c-a41163cda5ba tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "972e22c1-bd85-4507-9166-ace3fce8e698" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.747s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-f5ab70a3-f14c-4d4d-b381-47e1d4f4ca01 req-2539aa2d-8188-4b5a-a383-c80bd2563a0b service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Received event network-vif-plugged-f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f5ab70a3-f14c-4d4d-b381-47e1d4f4ca01 req-2539aa2d-8188-4b5a-a383-c80bd2563a0b service nova] Acquiring lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f5ab70a3-f14c-4d4d-b381-47e1d4f4ca01 req-2539aa2d-8188-4b5a-a383-c80bd2563a0b service nova] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f5ab70a3-f14c-4d4d-b381-47e1d4f4ca01 req-2539aa2d-8188-4b5a-a383-c80bd2563a0b service nova] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-f5ab70a3-f14c-4d4d-b381-47e1d4f4ca01 req-2539aa2d-8188-4b5a-a383-c80bd2563a0b service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] No waiting events found dispatching network-vif-plugged-f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:19:25 user nova-compute[75356]: WARNING nova.compute.manager [req-f5ab70a3-f14c-4d4d-b381-47e1d4f4ca01 req-2539aa2d-8188-4b5a-a383-c80bd2563a0b service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Received unexpected event network-vif-plugged-f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4 for instance with vm_state active and task_state None.
Nov 29 20:19:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] No BDM found with device name hda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] No VIF found with MAC fa:16:3e:34:be:70, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:19:25 user nova-compute[75356]:   <nova:package version="0.0.0"/>
Nov 29 20:19:25 user nova-compute[75356]:   <nova:name>tempest-device-tagging-server-2087794140</nova:name>
Nov 29 20:19:25 user nova-compute[75356]:   <nova:creationTime>2023-11-29 20:19:25</nova:creationTime>
Nov 29 20:19:25 user nova-compute[75356]:   <nova:flavor name="m1.tiny">
Nov 29 20:19:25 user nova-compute[75356]:     <nova:memory>512</nova:memory>
Nov 29 20:19:25 user nova-compute[75356]:     <nova:disk>1</nova:disk>
Nov 29 20:19:25 user nova-compute[75356]:     <nova:swap>0</nova:swap>
Nov 29 20:19:25 user nova-compute[75356]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:19:25 user nova-compute[75356]:     <nova:vcpus>1</nova:vcpus>
Nov 29 20:19:25 user nova-compute[75356]:   </nova:flavor>
Nov 29 20:19:25 user nova-compute[75356]:   <nova:owner>
Nov 29 20:19:25 user nova-compute[75356]:     <nova:user uuid="e5b4a48f9bfd406cae779bfc3dc5e302">tempest-TaggedAttachmentsTest-75465737-project-member</nova:user>
Nov 29 20:19:25 user nova-compute[75356]:     <nova:project uuid="076d6fb1d7e1485f847881bd7fe665f3">tempest-TaggedAttachmentsTest-75465737</nova:project>
Nov 29 20:19:25 user nova-compute[75356]:   </nova:owner>
Nov 29 20:19:25 user nova-compute[75356]:   <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:19:25 user nova-compute[75356]:   <nova:ports>
Nov 29 20:19:25 user nova-compute[75356]:     <nova:port uuid="577e6509-523f-46e2-9994-9d1eb9ff0c13">
Nov 29 20:19:25 user nova-compute[75356]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 20:19:25 user nova-compute[75356]:     </nova:port>
Nov 29 20:19:25 user nova-compute[75356]:     <nova:port uuid="f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4">
Nov 29 20:19:25 user nova-compute[75356]:       <nova:ip type="fixed" address="10.10.10.83" ipVersion="4"/>
Nov 29 20:19:25 user nova-compute[75356]:     </nova:port>
Nov 29 20:19:25 user nova-compute[75356]:   </nova:ports>
Nov 29 20:19:25 user nova-compute[75356]: </nova:instance>
Nov 29 20:19:25 user nova-compute[75356]:  {{(pid=75356) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f851461e-4e6f-48f7-b176-c70dc0513b10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "interface-3d1a8bb2-82f9-4a3f-aeff-a5472477d651-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.981s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Acquiring lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG nova.objects.instance [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lazy-loading 'flavor' on Instance uuid 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Acquiring lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:26 user nova-compute[75356]: INFO nova.compute.manager [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Attaching volume 97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 to /dev/vdb
Nov 29 20:19:26 user nova-compute[75356]: DEBUG os_brick.utils [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a5acd6-d876-498b-b405-5c445fb6e70c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b37e041-06d2-4165-aeb3-98188212e9e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17a465e-9619-49bf-9cdc-c1acd2b490c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7305ff1c-e76c-4358-9ed7-463b6ec50c72]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:19:26 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:19:26 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c54e90-c00a-4054-8475-e36ac361fd9d]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG os_brick.utils [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:19:26 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Updating existing volume attachment record: 65d47b3e-048b-4e98-bf0c-a0079c99c772 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:19:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-4e2a3ee9-e63a-48a5-8c0c-ff3214e88247 req-25e1f990-3f16-4b5d-b377-f8874da6c3d5 service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Received event network-vif-plugged-f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:19:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4e2a3ee9-e63a-48a5-8c0c-ff3214e88247 req-25e1f990-3f16-4b5d-b377-f8874da6c3d5 service nova] Acquiring lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4e2a3ee9-e63a-48a5-8c0c-ff3214e88247 req-25e1f990-3f16-4b5d-b377-f8874da6c3d5 service nova] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4e2a3ee9-e63a-48a5-8c0c-ff3214e88247 req-25e1f990-3f16-4b5d-b377-f8874da6c3d5 service nova] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-4e2a3ee9-e63a-48a5-8c0c-ff3214e88247 req-25e1f990-3f16-4b5d-b377-f8874da6c3d5 service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] No waiting events found dispatching network-vif-plugged-f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:19:27 user nova-compute[75356]: WARNING nova.compute.manager [req-4e2a3ee9-e63a-48a5-8c0c-ff3214e88247 req-25e1f990-3f16-4b5d-b377-f8874da6c3d5 service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Received unexpected event network-vif-plugged-f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4 for instance with vm_state active and task_state None.
Nov 29 20:19:29 user nova-compute[75356]: DEBUG nova.compute.manager [req-42e0084c-b532-4a7a-b744-da0f12b904ab req-620394c1-0a08-4a8c-a67d-3503f4b3d914 service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Received event network-changed-924ed0c8-9079-4837-b3bb-4ec2e2c6e359 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:19:29 user nova-compute[75356]: DEBUG nova.compute.manager [req-42e0084c-b532-4a7a-b744-da0f12b904ab req-620394c1-0a08-4a8c-a67d-3503f4b3d914 service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Refreshing instance network info cache due to event network-changed-924ed0c8-9079-4837-b3bb-4ec2e2c6e359. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:19:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-42e0084c-b532-4a7a-b744-da0f12b904ab req-620394c1-0a08-4a8c-a67d-3503f4b3d914 service nova] Acquiring lock "refresh_cache-f09171b0-1615-49ee-8c66-8b9c4f0af591" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:19:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-42e0084c-b532-4a7a-b744-da0f12b904ab req-620394c1-0a08-4a8c-a67d-3503f4b3d914 service nova] Acquired lock "refresh_cache-f09171b0-1615-49ee-8c66-8b9c4f0af591" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:19:29 user nova-compute[75356]: DEBUG nova.network.neutron [req-42e0084c-b532-4a7a-b744-da0f12b904ab req-620394c1-0a08-4a8c-a67d-3503f4b3d914 service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Refreshing network info cache for port 924ed0c8-9079-4837-b3bb-4ec2e2c6e359 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:19:30 user nova-compute[75356]: DEBUG nova.network.neutron [req-42e0084c-b532-4a7a-b744-da0f12b904ab req-620394c1-0a08-4a8c-a67d-3503f4b3d914 service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Updated VIF entry in instance network info cache for port 924ed0c8-9079-4837-b3bb-4ec2e2c6e359. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:19:30 user nova-compute[75356]: DEBUG nova.network.neutron [req-42e0084c-b532-4a7a-b744-da0f12b904ab req-620394c1-0a08-4a8c-a67d-3503f4b3d914 service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Updating instance_info_cache with network_info: [{"id": "924ed0c8-9079-4837-b3bb-4ec2e2c6e359", "address": "fa:16:3e:bb:ea:02", "network": {"id": "945008af-d620-4459-95c8-9aa9515d0718", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1884938817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de78788d21744bcb173947de904ed69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924ed0c8-90", "ovs_interfaceid": "924ed0c8-9079-4837-b3bb-4ec2e2c6e359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:19:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-42e0084c-b532-4a7a-b744-da0f12b904ab req-620394c1-0a08-4a8c-a67d-3503f4b3d914 service nova] Releasing lock "refresh_cache-f09171b0-1615-49ee-8c66-8b9c4f0af591" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:19:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xSjKBYvE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:19:31 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:19:31 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:19:31 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[43651436-fe1f-4d9e-85dc-b0146c9707ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:19:31 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16fa3a0-476f-482b-b011-09b86fbdf0d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7] added
Nov 29 20:19:31 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e76ea2-574d-4ed6-98ce-ba3aca68567d]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5547e7-98f8-4d88-81b5-afd536e241a1]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xSjKBYvE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xSjKBYvE" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[69aa52b3-8189-426d-a4ce-6ac29335a1c7]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xSjKBYvE'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a082a2-974c-4235-bf81-96328f946a90]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9950cfa5-8fe4-413c-a7bc-529b8c7a2a43]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:31 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:31 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:31 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:31 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:31 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:31 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:31 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:31 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Acquiring lock "f09171b0-1615-49ee-8c66-8b9c4f0af591" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Lock "f09171b0-1615-49ee-8c66-8b9c4f0af591" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d6e113-ebca-4c82-b4dd-323f1420d13b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7, portal: 172.16.0.220,3260]
Nov 29 20:19:31 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7, portal: 172.16.0.220,3260] successful.
Nov 29 20:19:31 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG nova.objects.instance [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Lazy-loading 'flavor' on Instance uuid f09171b0-1615-49ee-8c66-8b9c4f0af591 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8847673-0ed3-4e14-b47a-41772aa79922]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a479a94-4e04-44e0-a5eb-a4fd44e61f14]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:31 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:31 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:31 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:31 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:31 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:31 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:31 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:31 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:31 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:31 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec69acb-1661-4cb9-ada8-2d24b4f17a8e]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xSjKBYvE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Lock "f09171b0-1615-49ee-8c66-8b9c4f0af591" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Acquiring lock "f09171b0-1615-49ee-8c66-8b9c4f0af591" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Lock "f09171b0-1615-49ee-8c66-8b9c4f0af591" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:31 user nova-compute[75356]: INFO nova.compute.manager [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Attaching volume a02e47c0-aa41-47fb-acc4-0e4abe47acd9 to /dev/vdb
Nov 29 20:19:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.utils [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a243cd-3be3-4b63-92f9-62bb3cd58d16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab27fad-7b3f-41cf-9c11-dbcd0c7055f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d527c93e-5a61-44d4-90b5-a4b1df491e74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9952c4f8-e8f5-48ef-b0f3-5f7edeaa83e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "972e22c1-bd85-4507-9166-ace3fce8e698" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "972e22c1-bd85-4507-9166-ace3fce8e698" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:19:31 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:19:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b702eb5a-44e7-4d81-86ce-0e79eec0d3e6]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG os_brick.utils [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:19:31 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Updating existing volume attachment record: 114a4722-0ce6-4f04-9135-95d935fb6fcf {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:19:31 user nova-compute[75356]: INFO nova.compute.manager [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Detaching volume 80960645-eeae-46ba-99ef-09ed5d8f499c
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26464333530353634', 'path': '/dev/sdf'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464333530353634', 'path': '/dev/sdf'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG nova.objects.instance [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lazy-loading 'flavor' on Instance uuid ee4a5666-bfea-47bf-bd21-d24685967a3e {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:19:32 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:19:32 user nova-compute[75356]:   <source dev="/dev/sdf"/>
Nov 29 20:19:32 user nova-compute[75356]:   <target dev="sdc" bus="scsi"/>
Nov 29 20:19:32 user nova-compute[75356]:   <serial>99b9fce4-7c65-4fb3-8c39-f436fffa84b7</serial>
Nov 29 20:19:32 user nova-compute[75356]:   <address type="drive" controller="0" unit="2"/>
Nov 29 20:19:32 user nova-compute[75356]: </disk>
Nov 29 20:19:32 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixCdmtaE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:19:32 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:19:32 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:19:32 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c6c9c1-20b2-4362-944a-c991091827ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:19:32 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbac299f-1f57-4f33-9f19-2206bba9877c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78] added
Nov 29 20:19:32 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9eb78be-6430-4e87-893b-dece9c16047c]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee158a8-e922-4028-bafa-9939c5573bbe]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ixCdmtaE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ixCdmtaE" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[369f89da-5358-4c1b-a9fd-8744ad982299]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ixCdmtaE'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6ab6fc-48cc-4cb1-b5a4-4fd5c85cdec6]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e657eb4-b45b-4102-bd9e-315d7f821b5a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:32 user nova-compute[75356]: INFO nova.virt.block_device [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Attempting to driver detach volume 80960645-eeae-46ba-99ef-09ed5d8f499c from mountpoint /dev/vdb
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:32 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:32 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:32 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:32 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:32 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:32 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:32 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:32 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:32 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:32 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Attempting to detach device vdb from instance 972e22c1-bd85-4507-9166-ace3fce8e698 from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:19:32 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:19:32 user nova-compute[75356]:   <source dev="/dev/sde"/>
Nov 29 20:19:32 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:19:32 user nova-compute[75356]:   <serial>80960645-eeae-46ba-99ef-09ed5d8f499c</serial>
Nov 29 20:19:32 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:19:32 user nova-compute[75356]: </disk>
Nov 29 20:19:32 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:19:32 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Successfully detached device vdb from instance 972e22c1-bd85-4507-9166-ace3fce8e698 from the persistent domain config.
Nov 29 20:19:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 972e22c1-bd85-4507-9166-ace3fce8e698 from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:19:32 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:19:32 user nova-compute[75356]:   <source dev="/dev/sde"/>
Nov 29 20:19:32 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:19:32 user nova-compute[75356]:   <serial>80960645-eeae-46ba-99ef-09ed5d8f499c</serial>
Nov 29 20:19:32 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:19:32 user nova-compute[75356]: </disk>
Nov 29 20:19:32 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f54a25-0c23-47a0-974b-fc4788e7a229]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78, portal: 172.16.0.220,3260]
Nov 29 20:19:32 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78, portal: 172.16.0.220,3260] successful.
Nov 29 20:19:32 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] No BDM found with device name sda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] No VIF found with MAC fa:16:3e:87:5a:bf, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b677c0-aa3a-4895-8ec5-167c676858a2]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abbb65b-6d35-4aca-b1fd-0f63d7a29790]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:32 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:32 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:32 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:32 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:32 user nova-compute[75356]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:19:32 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:32 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:32 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:32 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:32 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:32 user nova-compute[75356]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:19:32 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b789b30-4aa0-46c6-8ab7-0c0b71704984]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:19:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixCdmtaE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:19:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-9bf8de27-c46a-461a-b120-edb670104755 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "ee4a5666-bfea-47bf-bd21-d24685967a3e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.689s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 972e22c1-bd85-4507-9166-ace3fce8e698 {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:19:33 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:19:33 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26238633231373634', 'path': '/dev/sdg'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:19:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238633231373634', 'path': '/dev/sdg'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:19:34 user nova-compute[75356]: DEBUG nova.objects.instance [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lazy-loading 'flavor' on Instance uuid fb7280bd-7153-4868-b1c9-35cc77e96277 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:19:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:19:34 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:19:34 user nova-compute[75356]:   <source dev="/dev/sdg"/>
Nov 29 20:19:34 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:19:34 user nova-compute[75356]:   <serial>d655d5aa-afbe-448d-9068-36b17ef93b78</serial>
Nov 29 20:19:34 user nova-compute[75356]: </disk>
Nov 29 20:19:34 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:19:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Acquiring lock "ee4a5666-bfea-47bf-bd21-d24685967a3e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "ee4a5666-bfea-47bf-bd21-d24685967a3e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:34 user nova-compute[75356]: INFO nova.compute.manager [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Detaching volume 99b9fce4-7c65-4fb3-8c39-f436fffa84b7
Nov 29 20:19:34 user nova-compute[75356]: INFO nova.virt.block_device [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Attempting to driver detach volume 99b9fce4-7c65-4fb3-8c39-f436fffa84b7 from mountpoint /dev/sdc
Nov 29 20:19:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Attempting to detach device sdc from instance ee4a5666-bfea-47bf-bd21-d24685967a3e from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:19:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:19:34 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:19:34 user nova-compute[75356]:   <source dev="/dev/sdf"/>
Nov 29 20:19:34 user nova-compute[75356]:   <target dev="sdc" bus="scsi"/>
Nov 29 20:19:34 user nova-compute[75356]:   <serial>99b9fce4-7c65-4fb3-8c39-f436fffa84b7</serial>
Nov 29 20:19:34 user nova-compute[75356]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 29 20:19:34 user nova-compute[75356]: </disk>
Nov 29 20:19:34 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:19:34 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Successfully detached device sdc from instance ee4a5666-bfea-47bf-bd21-d24685967a3e from the persistent domain config.
Nov 29 20:19:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance ee4a5666-bfea-47bf-bd21-d24685967a3e from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:19:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:19:34 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:19:34 user nova-compute[75356]:   <source dev="/dev/sdf"/>
Nov 29 20:19:34 user nova-compute[75356]:   <target dev="sdc" bus="scsi"/>
Nov 29 20:19:34 user nova-compute[75356]:   <serial>99b9fce4-7c65-4fb3-8c39-f436fffa84b7</serial>
Nov 29 20:19:34 user nova-compute[75356]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 29 20:19:34 user nova-compute[75356]: </disk>
Nov 29 20:19:34 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:19:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:19:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:19:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] No VIF found with MAC fa:16:3e:36:54:40, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:19:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-55c588e6-a6f3-4da6-a4cd-8861e5eca2c2 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.993s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance ee4a5666-bfea-47bf-bd21-d24685967a3e {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:19:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:19:34 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMDEStaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:19:35 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:19:35 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:19:35 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde47779-131a-4451-8cc0-b61d88c5aada]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:19:35 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e300ce-16cf-4bb9-9d87-afdf5fd4fd68]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6] added
Nov 29 20:19:35 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e701bde-aebf-478c-aefd-636aaf8ffad7]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb2402c-2252-4aea-adb0-50658e6ed0cb]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xMDEStaw {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xMDEStaw" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a06d61-61db-430c-ab1f-2a0d14d915ba]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xMDEStaw'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ce9b06-f25a-459d-9ae0-6bc52e4447bd]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e612ee-389f-4c76-8f6a-cf764f0014bc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:35 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:35 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:35 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:35 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:35 user nova-compute[75356]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:19:35 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:35 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:35 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:35 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:35 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:35 user nova-compute[75356]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:19:35 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d9bf00-f7ca-491f-9a54-d05d1a29ed25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6, portal: 172.16.0.220,3260]
Nov 29 20:19:35 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6, portal: 172.16.0.220,3260] successful.
Nov 29 20:19:35 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af83e31-39ed-4626-9f29-24d4698cced0]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b69844c-5c4d-4f70-b081-d564044cdd3b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:35 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:35 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:35 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:35 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:35 user nova-compute[75356]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:19:35 user nova-compute[75356]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)
Nov 29 20:19:35 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:35 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:35 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:35 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:35 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:35 user nova-compute[75356]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:19:35 user nova-compute[75356]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)
Nov 29 20:19:35 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[58623800-fe8a-442e-bdde-129e22158abb]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: None {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Acquiring lock "fb7280bd-7153-4868-b1c9-35cc77e96277" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.utils [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fed481-32e2-4a8d-a096-ebffa44ab404]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eac414b-c7a8-41c2-acd8-79d4ba2136b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d64fc3-5307-4c12-91e2-90c4142b93e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ab51ae-d506-40a3-8852-428661a56e49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:19:35 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:19:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f91013-f372-4355-ba21-adda1c25f718]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:19:35 user nova-compute[75356]: DEBUG os_brick.utils [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:19:35 user nova-compute[75356]: INFO nova.compute.manager [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Swapping volume d655d5aa-afbe-448d-9068-36b17ef93b78 for 165059ac-dd9e-4e8f-8362-ce615a19b4e5
Nov 29 20:19:36 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:19:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMDEStaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:19:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:19:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23732353135623635', 'path': '/dev/sdh'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:19:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732353135623635', 'path': '/dev/sdh'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:19:36 user nova-compute[75356]: DEBUG nova.objects.instance [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lazy-loading 'flavor' on Instance uuid 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:19:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:19:36 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:19:36 user nova-compute[75356]:   <source dev="/dev/sdh"/>
Nov 29 20:19:36 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:19:36 user nova-compute[75356]:   <serial>97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6</serial>
Nov 29 20:19:36 user nova-compute[75356]: </disk>
Nov 29 20:19:36 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:19:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:19:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] No BDM found with device name hda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:19:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] No VIF found with MAC fa:16:3e:34:be:70, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:19:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a60c337e-5645-449e-8255-2fa771ff58e7 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.758s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Acquiring lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:38 user nova-compute[75356]: INFO nova.compute.manager [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Detaching volume 97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6
Nov 29 20:19:39 user nova-compute[75356]: INFO nova.virt.block_device [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Attempting to driver detach volume 97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 from mountpoint /dev/vdb
Nov 29 20:19:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Attempting to detach device vdb from instance 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:19:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:19:39 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:19:39 user nova-compute[75356]:   <source dev="/dev/sdh"/>
Nov 29 20:19:39 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:19:39 user nova-compute[75356]:   <serial>97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6</serial>
Nov 29 20:19:39 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 20:19:39 user nova-compute[75356]: </disk>
Nov 29 20:19:39 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:19:39 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Successfully detached device vdb from instance 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 from the persistent domain config.
Nov 29 20:19:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:19:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:19:39 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:19:39 user nova-compute[75356]:   <source dev="/dev/sdh"/>
Nov 29 20:19:39 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:19:39 user nova-compute[75356]:   <serial>97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6</serial>
Nov 29 20:19:39 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 20:19:39 user nova-compute[75356]: </disk>
Nov 29 20:19:39 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:19:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCBLADmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:19:40 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:19:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:19:40 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:19:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:19:40 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[59500e00-d849-4a49-ad4f-2c1ef7191e83]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:19:40 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71be40d-9832-4cae-a99d-c3b7e8c9d484]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9] added
Nov 29 20:19:40 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2902b8c2-0865-4121-a3f6-8ace2ce48de4]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53922cd-6537-42c6-ad0c-f54090ab8f80]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gCBLADmW {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gCBLADmW" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9465a0f9-dcee-4167-8a83-520c2436ad5b]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gCBLADmW'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[78220691-4ad6-416c-96a6-1fd557ca75d5]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee46673-826d-47d8-bd70-69e6e83ec36b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)
Nov 29 20:19:40 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)
Nov 29 20:19:40 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4c9739-8478-4399-85f5-c827a78d284c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9, portal: 172.16.0.220,3260]
Nov 29 20:19:40 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9, portal: 172.16.0.220,3260] successful.
Nov 29 20:19:40 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1022cdb-f01d-4f5b-b65c-e500d24e77cb]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[418f068f-1753-469f-8720-662c5d2940f3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)
Nov 29 20:19:40 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:19:40 user nova-compute[75356]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)
Nov 29 20:19:40 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:19:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a7625e-0b03-4d5a-b1bf-27bc60eccab9]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:41 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:19:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCBLADmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:19:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:19:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26232346437353434', 'path': '/dev/sdi'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:19:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232346437353434', 'path': '/dev/sdi'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:19:42 user nova-compute[75356]: DEBUG nova.objects.instance [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Lazy-loading 'flavor' on Instance uuid f09171b0-1615-49ee-8c66-8b9c4f0af591 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:19:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] attach device xml: <disk type="block" device="disk">
Nov 29 20:19:42 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:19:42 user nova-compute[75356]:   <source dev="/dev/sdi"/>
Nov 29 20:19:42 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:19:42 user nova-compute[75356]:   <serial>a02e47c0-aa41-47fb-acc4-0e4abe47acd9</serial>
Nov 29 20:19:42 user nova-compute[75356]: </disk>
Nov 29 20:19:42 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:19:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:19:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:19:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] No VIF found with MAC fa:16:3e:bb:ea:02, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:19:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-532a9de6-07b7-48a1-a8ff-4b76d642ca1b tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Lock "f09171b0-1615-49ee-8c66-8b9c4f0af591" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.991s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Acquiring lock "1e4d92bf-f8c0-45f8-ba80-48f17fefc108" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Lock "1e4d92bf-f8c0-45f8-ba80-48f17fefc108" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Acquiring lock "1e4d92bf-f8c0-45f8-ba80-48f17fefc108-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Lock "1e4d92bf-f8c0-45f8-ba80-48f17fefc108-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Lock "1e4d92bf-f8c0-45f8-ba80-48f17fefc108-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:42 user nova-compute[75356]: INFO nova.compute.manager [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Terminating instance
Nov 29 20:19:42 user nova-compute[75356]: DEBUG nova.compute.manager [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:19:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-dbb7a00b-2aa4-40f3-80e8-e066310cab37 req-424b6339-508d-48a1-aab5-c7ab79ee0453 service nova] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Received event network-vif-unplugged-d3cff2c2-9659-48c0-843b-09fb5dd4e2b4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:19:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-dbb7a00b-2aa4-40f3-80e8-e066310cab37 req-424b6339-508d-48a1-aab5-c7ab79ee0453 service nova] Acquiring lock "1e4d92bf-f8c0-45f8-ba80-48f17fefc108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-dbb7a00b-2aa4-40f3-80e8-e066310cab37 req-424b6339-508d-48a1-aab5-c7ab79ee0453 service nova] Lock "1e4d92bf-f8c0-45f8-ba80-48f17fefc108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-dbb7a00b-2aa4-40f3-80e8-e066310cab37 req-424b6339-508d-48a1-aab5-c7ab79ee0453 service nova] Lock "1e4d92bf-f8c0-45f8-ba80-48f17fefc108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-dbb7a00b-2aa4-40f3-80e8-e066310cab37 req-424b6339-508d-48a1-aab5-c7ab79ee0453 service nova] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] No waiting events found dispatching network-vif-unplugged-d3cff2c2-9659-48c0-843b-09fb5dd4e2b4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:19:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-dbb7a00b-2aa4-40f3-80e8-e066310cab37 req-424b6339-508d-48a1-aab5-c7ab79ee0453 service nova] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Received event network-vif-unplugged-d3cff2c2-9659-48c0-843b-09fb5dd4e2b4 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:19:43 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Instance destroyed successfully.
Nov 29 20:19:43 user nova-compute[75356]: DEBUG nova.objects.instance [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Lazy-loading 'resources' on Instance uuid 1e4d92bf-f8c0-45f8-ba80-48f17fefc108 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:19:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1608374642',display_name='tempest-VolumesNegativeTest-instance-1608374642',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1608374642',id=11,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:18:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b5552f4e7a54f9b98156f157ec4231c',ramdisk_id='',reservation_id='r-k8gzgxf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-98419257',owner_user_name='tempest-VolumesNegativeTest-98419257-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:18:02Z,user_data=None,user_id='726978311bd5459494b2e85e1efe833e',uuid=1e4d92bf-f8c0-45f8-ba80-48f17fefc108,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3cff2c2-9659-48c0-843b-09fb5dd4e2b4", "address": "fa:16:3e:76:1e:55", "network": {"id": "c9ca57f1-f027-4505-9561-7d70df8ae387", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85354408285b41f9a373abccf0e04f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3cff2c2-96", "ovs_interfaceid": "d3cff2c2-9659-48c0-843b-09fb5dd4e2b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:19:43 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Converting VIF {"id": "d3cff2c2-9659-48c0-843b-09fb5dd4e2b4", "address": "fa:16:3e:76:1e:55", "network": {"id": "c9ca57f1-f027-4505-9561-7d70df8ae387", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85354408285b41f9a373abccf0e04f50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3cff2c2-96", "ovs_interfaceid": "d3cff2c2-9659-48c0-843b-09fb5dd4e2b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:19:43 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:1e:55,bridge_name='br-int',has_traffic_filtering=True,id=d3cff2c2-9659-48c0-843b-09fb5dd4e2b4,network=Network(c9ca57f1-f027-4505-9561-7d70df8ae387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3cff2c2-96') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:19:43 user nova-compute[75356]: DEBUG os_vif [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:1e:55,bridge_name='br-int',has_traffic_filtering=True,id=d3cff2c2-9659-48c0-843b-09fb5dd4e2b4,network=Network(c9ca57f1-f027-4505-9561-7d70df8ae387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3cff2c2-96') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:19:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3cff2c2-96, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:19:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:19:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ef224e2-bf3e-48c4-b862-c6fc391dde12) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:19:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:43 user nova-compute[75356]: INFO os_vif [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:1e:55,bridge_name='br-int',has_traffic_filtering=True,id=d3cff2c2-9659-48c0-843b-09fb5dd4e2b4,network=Network(c9ca57f1-f027-4505-9561-7d70df8ae387),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3cff2c2-96')
Nov 29 20:19:43 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Deleting instance files /opt/stack/data/nova/instances/1e4d92bf-f8c0-45f8-ba80-48f17fefc108_del
Nov 29 20:19:43 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Deletion of /opt/stack/data/nova/instances/1e4d92bf-f8c0-45f8-ba80-48f17fefc108_del complete
Nov 29 20:19:43 user nova-compute[75356]: INFO nova.compute.manager [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 29 20:19:43 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:19:43 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:19:43 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:19:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-230d7527-8e98-437d-a53b-b67303d4d2f7 tempest-VolumesAssistedSnapshotsTest-1310631546 tempest-VolumesAssistedSnapshotsTest-1310631546-project] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] volume_snapshot_create: create_info: {'snapshot_id': '1932115a-6104-4368-8f5f-97a67657f1c8', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75356) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-230d7527-8e98-437d-a53b-b67303d4d2f7 tempest-VolumesAssistedSnapshotsTest-1310631546 tempest-VolumesAssistedSnapshotsTest-1310631546-project] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] snap xml: <domainsnapshot>
Nov 29 20:19:44 user nova-compute[75356]:   <disks>
Nov 29 20:19:44 user nova-compute[75356]:     <disk name="/dev/sdi" snapshot="external" type="file">
Nov 29 20:19:44 user nova-compute[75356]:       <source file="/dev/new_file"/>
Nov 29 20:19:44 user nova-compute[75356]:     </disk>
Nov 29 20:19:44 user nova-compute[75356]:     <disk name="vda" snapshot="no"/>
Nov 29 20:19:44 user nova-compute[75356]:   </disks>
Nov 29 20:19:44 user nova-compute[75356]: </domainsnapshot>
Nov 29 20:19:44 user nova-compute[75356]:  {{(pid=75356) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG nova.objects.instance [None req-230d7527-8e98-437d-a53b-b67303d4d2f7 tempest-VolumesAssistedSnapshotsTest-1310631546 tempest-VolumesAssistedSnapshotsTest-1310631546-project] Lazy-loading 'system_metadata' on Instance uuid f09171b0-1615-49ee-8c66-8b9c4f0af591 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG nova.compute.manager [req-01989832-fbf0-4b9b-a4b0-49e069a58d9a req-64f8702d-6f11-41fd-87b0-7c7b217e9201 service nova] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Received event network-vif-deleted-d3cff2c2-9659-48c0-843b-09fb5dd4e2b4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:19:44 user nova-compute[75356]: INFO nova.compute.manager [req-01989832-fbf0-4b9b-a4b0-49e069a58d9a req-64f8702d-6f11-41fd-87b0-7c7b217e9201 service nova] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Neutron deleted interface d3cff2c2-9659-48c0-843b-09fb5dd4e2b4; detaching it from the instance and deleting it from the info cache
Nov 29 20:19:44 user nova-compute[75356]: DEBUG nova.network.neutron [req-01989832-fbf0-4b9b-a4b0-49e069a58d9a req-64f8702d-6f11-41fd-87b0-7c7b217e9201 service nova] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:19:44 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Took 0.47 seconds to deallocate network for instance.
Nov 29 20:19:44 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-230d7527-8e98-437d-a53b-b67303d4d2f7 tempest-VolumesAssistedSnapshotsTest-1310631546 tempest-VolumesAssistedSnapshotsTest-1310631546-project] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 20:19:44 user nova-compute[75356]: DEBUG nova.compute.manager [req-01989832-fbf0-4b9b-a4b0-49e069a58d9a req-64f8702d-6f11-41fd-87b0-7c7b217e9201 service nova] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Detach interface failed, port_id=d3cff2c2-9659-48c0-843b-09fb5dd4e2b4, reason: Instance 1e4d92bf-f8c0-45f8-ba80-48f17fefc108 could not be found. {{(pid=75356) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [None req-230d7527-8e98-437d-a53b-b67303d4d2f7 tempest-VolumesAssistedSnapshotsTest-1310631546 tempest-VolumesAssistedSnapshotsTest-1310631546-project] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Traceback (most recent call last):
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]     rv = execute(f, *args, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]     six.reraise(c, e, tb)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]     raise value
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]     rv = meth(*args, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] 
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [None req-230d7527-8e98-437d-a53b-b67303d4d2f7 tempest-VolumesAssistedSnapshotsTest-1310631546 tempest-VolumesAssistedSnapshotsTest-1310631546-project] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Traceback (most recent call last):
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]     self._volume_snapshot_create(context, instance, guest,
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]     rv = execute(f, *args, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]     six.reraise(c, e, tb)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]     raise value
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]     rv = meth(*args, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] 
Nov 29 20:19:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8241e4d2-3273-4f40-985c-d2edea4fecde tempest-VolumesAssistedSnapshotsTest-1310631546 tempest-VolumesAssistedSnapshotsTest-1310631546-project] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] volume_snapshot_delete: delete_info: {'volume_id': 'a02e47c0-aa41-47fb-acc4-0e4abe47acd9'} {{(pid=75356) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [None req-8241e4d2-3273-4f40-985c-d2edea4fecde tempest-VolumesAssistedSnapshotsTest-1310631546 tempest-VolumesAssistedSnapshotsTest-1310631546-project] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Traceback (most recent call last):
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591]     if delete_info['type'] != 'qcow2':
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] KeyError: 'type'
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] 
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [None req-230d7527-8e98-437d-a53b-b67303d4d2f7 tempest-VolumesAssistedSnapshotsTest-1310631546 tempest-VolumesAssistedSnapshotsTest-1310631546-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 1932115a-6104-4368-8f5f-97a67657f1c8 could not be found.
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     raise value
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver 
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver 
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 1932115a-6104-4368-8f5f-97a67657f1c8 could not be found. (HTTP 404) (Request-ID: req-9e32144b-da99-4353-af6f-3ba49ca79ebc)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver 
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver 
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 1932115a-6104-4368-8f5f-97a67657f1c8 could not be found.
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver 
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server [None req-230d7527-8e98-437d-a53b-b67303d4d2f7 tempest-VolumesAssistedSnapshotsTest-1310631546 tempest-VolumesAssistedSnapshotsTest-1310631546-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     raise value
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server 
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver [None req-8241e4d2-3273-4f40-985c-d2edea4fecde tempest-VolumesAssistedSnapshotsTest-1310631546 tempest-VolumesAssistedSnapshotsTest-1310631546-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver 
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver 
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-8ee9a034-6581-47fb-ad40-489868a6988a)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver 
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver 
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 29 20:19:44 user nova-compute[75356]: ERROR nova.virt.libvirt.driver 
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server [None req-8241e4d2-3273-4f40-985c-d2edea4fecde tempest-VolumesAssistedSnapshotsTest-1310631546 tempest-VolumesAssistedSnapshotsTest-1310631546-project] Exception during message handling: KeyError: 'type'
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 29 20:19:44 user nova-compute[75356]: ERROR oslo_messaging.rpc.server 
Nov 29 20:19:44 user nova-compute[75356]: DEBUG nova.compute.manager [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FNPrHceC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fb7280bd-7153-4868-b1c9-35cc77e96277', 'attached_at': '', 'detached_at': '', 'volume_id': '165059ac-dd9e-4e8f-8362-ce615a19b4e5', 'serial': '165059ac-dd9e-4e8f-8362-ce615a19b4e5'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixCdmtaE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'fb7280bd-7153-4868-b1c9-35cc77e96277', 'attached_at': '', 'detached_at': '', 'volume_id': 'd655d5aa-afbe-448d-9068-36b17ef93b78', 'serial'} {{(pid=75356) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FNPrHceC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:19:44 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:19:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:19:44 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:19:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:19:44 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6155c538-d3a9-4174-9024-f4035977065d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:19:44 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb15ffd5-baff-484e-87f7-c704ce20d443]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5] added
Nov 29 20:19:44 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[122b42c6-6c3d-4cb5-a3aa-0969e9742a3f]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[895f79f8-5f12-4dde-81d4-add785e7bba5]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FNPrHceC {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FNPrHceC" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[af15712b-2489-4387-b268-9368529b2f45]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FNPrHceC'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63a79b2-dea2-4adc-963b-7bd0ce413df4]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d4c42d-c3d1-4002-98c2-f5f4e48dea30]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8678ef07-5ff8-450c-8172-0d92f08dd9e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5, portal: 172.16.0.220,3260]
Nov 29 20:19:44 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5, portal: 172.16.0.220,3260] successful.
Nov 29 20:19:44 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8e4c79-ec89-4801-89ee-aa6171d169cd]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.115s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dea6c3-7c1e-4751-bf66-9aca1bdca50d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)
Nov 29 20:19:44 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.421s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Acquiring lock "f09171b0-1615-49ee-8c66-8b9c4f0af591" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Lock "f09171b0-1615-49ee-8c66-8b9c4f0af591" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cdc169-5129-4776-854f-4e63a661dfbf]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.524s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FNPrHceC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:19:44 user nova-compute[75356]: INFO nova.compute.manager [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Detaching volume a02e47c0-aa41-47fb-acc4-0e4abe47acd9
Nov 29 20:19:44 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Deleted allocations for instance 1e4d92bf-f8c0-45f8-ba80-48f17fefc108
Nov 29 20:19:44 user nova-compute[75356]: INFO nova.virt.block_device [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Attempting to driver detach volume a02e47c0-aa41-47fb-acc4-0e4abe47acd9 from mountpoint /dev/vdb
Nov 29 20:19:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Attempting to detach device vdb from instance f09171b0-1615-49ee-8c66-8b9c4f0af591 from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] detach device xml: <disk type="block" device="disk">
Nov 29 20:19:44 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:19:44 user nova-compute[75356]:   <source dev="/dev/sdi"/>
Nov 29 20:19:44 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:19:44 user nova-compute[75356]:   <serial>a02e47c0-aa41-47fb-acc4-0e4abe47acd9</serial>
Nov 29 20:19:44 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:19:44 user nova-compute[75356]: </disk>
Nov 29 20:19:44 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:19:44 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Successfully detached device vdb from instance f09171b0-1615-49ee-8c66-8b9c4f0af591 from the persistent domain config.
Nov 29 20:19:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f09171b0-1615-49ee-8c66-8b9c4f0af591 from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] detach device xml: <disk type="block" device="disk">
Nov 29 20:19:44 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:19:44 user nova-compute[75356]:   <source dev="/dev/sdi"/>
Nov 29 20:19:44 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:19:44 user nova-compute[75356]:   <serial>a02e47c0-aa41-47fb-acc4-0e4abe47acd9</serial>
Nov 29 20:19:44 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:19:44 user nova-compute[75356]: </disk>
Nov 29 20:19:44 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:19:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3932dae9-1767-409c-8798-6f1d45ff0873 tempest-VolumesNegativeTest-98419257 tempest-VolumesNegativeTest-98419257-project-member] Lock "1e4d92bf-f8c0-45f8-ba80-48f17fefc108" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.957s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:45 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f09171b0-1615-49ee-8c66-8b9c4f0af591 {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:19:45 user nova-compute[75356]: DEBUG nova.compute.manager [req-68cbb8e9-5234-4797-85d7-a7f497ca3fa8 req-f9b9be56-b212-40a9-afa9-fcb59cab4d1f service nova] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Received event network-vif-plugged-d3cff2c2-9659-48c0-843b-09fb5dd4e2b4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:19:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-68cbb8e9-5234-4797-85d7-a7f497ca3fa8 req-f9b9be56-b212-40a9-afa9-fcb59cab4d1f service nova] Acquiring lock "1e4d92bf-f8c0-45f8-ba80-48f17fefc108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-68cbb8e9-5234-4797-85d7-a7f497ca3fa8 req-f9b9be56-b212-40a9-afa9-fcb59cab4d1f service nova] Lock "1e4d92bf-f8c0-45f8-ba80-48f17fefc108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-68cbb8e9-5234-4797-85d7-a7f497ca3fa8 req-f9b9be56-b212-40a9-afa9-fcb59cab4d1f service nova] Lock "1e4d92bf-f8c0-45f8-ba80-48f17fefc108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:45 user nova-compute[75356]: DEBUG nova.compute.manager [req-68cbb8e9-5234-4797-85d7-a7f497ca3fa8 req-f9b9be56-b212-40a9-afa9-fcb59cab4d1f service nova] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] No waiting events found dispatching network-vif-plugged-d3cff2c2-9659-48c0-843b-09fb5dd4e2b4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:19:45 user nova-compute[75356]: WARNING nova.compute.manager [req-68cbb8e9-5234-4797-85d7-a7f497ca3fa8 req-f9b9be56-b212-40a9-afa9-fcb59cab4d1f service nova] [instance: 1e4d92bf-f8c0-45f8-ba80-48f17fefc108] Received unexpected event network-vif-plugged-d3cff2c2-9659-48c0-843b-09fb5dd4e2b4 for instance with vm_state deleted and task_state None.
Nov 29 20:19:45 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.458s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:19:45 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] <== connect_volume: return (1460ms) {'type': 'block', 'scsi_wwn': '26634363264653438', 'path': '/dev/sdj'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:19:45 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634363264653438', 'path': '/dev/sdj'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:19:45 user nova-compute[75356]: DEBUG nova.objects.instance [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Lazy-loading 'flavor' on Instance uuid fb7280bd-7153-4868-b1c9-35cc77e96277 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:19:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:19:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] COPY block job progress, current cursor: 163577856 final cursor: 1073741824 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:19:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:47 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] COPY block job progress, current cursor: 296747008 final cursor: 1073741824 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:19:47 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] COPY block job progress, current cursor: 479199232 final cursor: 1073741824 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:19:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] COPY block job progress, current cursor: 611319808 final cursor: 1073741824 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:19:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] COPY block job progress, current cursor: 806354944 final cursor: 1073741824 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] COPY block job progress, current cursor: 991952896 final cursor: 1073741824 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixCdmtaE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:19:49 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:19:49 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[871707f2-d005-4dfe-ab2b-3a83795dd587]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:19:49 user nova-compute[75356]: No targets found.
Nov 29 20:19:49 user nova-compute[75356]: iSNS:
Nov 29 20:19:49 user nova-compute[75356]: No targets found.
Nov 29 20:19:49 user nova-compute[75356]: STATIC:
Nov 29 20:19:49 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c
Nov 29 20:19:49 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:49 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:49 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547
Nov 29 20:19:49 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:49 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:49 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5
Nov 29 20:19:49 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:49 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:49 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f
Nov 29 20:19:49 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:49 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:49 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78
Nov 29 20:19:49 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:49 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:49 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7
Nov 29 20:19:49 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:49 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:49 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9
Nov 29 20:19:49 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:49 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:49 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7
Nov 29 20:19:49 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:49 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:49 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6
Nov 29 20:19:49 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:49 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:49 user nova-compute[75356]: FIRMWARE:
Nov 29 20:19:49 user nova-compute[75356]: No targets found.
Nov 29 20:19:49 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:19:49 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:19:49 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[215536cf-17fd-46ee-a8bf-81e929de199e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c12075-39cf-47ba-bae5-331a8cf3d051]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)
Nov 29 20:19:49 user nova-compute[75356]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)
Nov 29 20:19:49 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:49 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:49 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:49 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:49 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:49 user nova-compute[75356]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:19:49 user nova-compute[75356]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)
Nov 29 20:19:49 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)
Nov 29 20:19:49 user nova-compute[75356]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)
Nov 29 20:19:49 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:49 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:49 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:49 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:49 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:49 user nova-compute[75356]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:19:49 user nova-compute[75356]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)
Nov 29 20:19:49 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e454b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78'): ({'sdg'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Removing single pathed devices sdg {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd51cfc-448b-475e-8e19-10521a27c76b]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33efe48-acd4-499f-a384-2f1bfea98b3b]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Flushing IO for device /dev/sdg {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f0015d-0ebe-4a50-b022-84079469104c]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.038s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cba46a2-9f63-436b-88d1-c79b19afc0a5]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] SCSI volumes sdg have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4af36b-57db-4946-be81-9e350fd3cfe2]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c0b384-ee8f-46c3-a20f-2ef0c0e409ee]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78, portal: 172.16.0.220,3260]
Nov 29 20:19:50 user nova-compute[75356]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78, portal: 172.16.0.220,3260] successful.
Nov 29 20:19:50 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0449363-f3eb-4876-9090-cd2cbf07bd5e]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] <== disconnect_volume: return (333ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG nova.compute.manager [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FNPrHceC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'fb7280bd-7153-4868-b1c9-35cc77e96277', 'attached_at': '', 'detached_at': '', 'volume_id': '165059ac-dd9e-4e8f-8362-ce615a19b4e5', 'serial'} {{(pid=75356) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG nova.compute.manager [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] swap_volume: removing Cinder connection for volume d655d5aa-afbe-448d-9068-36b17ef93b78 {{(pid=75356) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG nova.compute.manager [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] swap_volume: Updating volume d655d5aa-afbe-448d-9068-36b17ef93b78 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "FNPrHceC", "auth_password": "yh0I2Yub7sHecO", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "165059ac-dd9e-4e8f-8362-ce615a19b4e5"}, "status": "reserved", "instance": "fb7280bd-7153-4868-b1c9-35cc77e96277", "attached_at": "", "detached_at": "", "volume_id": "165059ac-dd9e-4e8f-8362-ce615a19b4e5", "serial": "165059ac-dd9e-4e8f-8362-ce615a19b4e5"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '165059ac-dd9e-4e8f-8362-ce615a19b4e5', 'no_device': None, 'attachment_id': '72f999d5-9206-4ad0-8381-b7fae914e23e'} {{(pid=75356) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-60cb71a7-03f9-4634-9cb1-00b70eaf01b0 tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.643s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Acquiring lock "fb7280bd-7153-4868-b1c9-35cc77e96277" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG os_brick.utils [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b672a128-9ebd-46c2-84db-4953e1a9beff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f84cc57-4d4f-427f-82fc-8f50c66c8ba8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf9bfb7-3d64-409c-8dc7-4d2c8f72bf05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbecc18-fd44-479e-b2c3-e43228fb13da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:19:52 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb40b27-19cb-48ab-a51b-6ae215c0e671]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG os_brick.utils [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:52 user nova-compute[75356]: INFO nova.compute.manager [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Swapping volume 165059ac-dd9e-4e8f-8362-ce615a19b4e5 for d655d5aa-afbe-448d-9068-36b17ef93b78
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:53 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 972e22c1-bd85-4507-9166-ace3fce8e698 is timed out.
Nov 29 20:19:53 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Successfully detached device vdb from instance 972e22c1-bd85-4507-9166-ace3fce8e698 from the live domain config.
Nov 29 20:19:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GyfBojbJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:19:53 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:19:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ffb230-bfcc-493a-af7d-588bc3957f27]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:19:53 user nova-compute[75356]: No targets found.
Nov 29 20:19:53 user nova-compute[75356]: iSNS:
Nov 29 20:19:53 user nova-compute[75356]: No targets found.
Nov 29 20:19:53 user nova-compute[75356]: STATIC:
Nov 29 20:19:53 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c
Nov 29 20:19:53 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:53 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:53 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547
Nov 29 20:19:53 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:53 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:53 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5
Nov 29 20:19:53 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:53 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:53 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f
Nov 29 20:19:53 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:53 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:53 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7
Nov 29 20:19:53 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:53 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:53 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9
Nov 29 20:19:53 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:53 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:53 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7
Nov 29 20:19:53 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:53 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:53 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6
Nov 29 20:19:53 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:53 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:53 user nova-compute[75356]: FIRMWARE:
Nov 29 20:19:53 user nova-compute[75356]: No targets found.
Nov 29 20:19:53 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:19:53 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:19:53 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd12708-329b-4a23-b30e-ddda2013a056]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4f5660-151f-42a4-8acd-962354b39f06]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)
Nov 29 20:19:53 user nova-compute[75356]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)
Nov 29 20:19:53 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:53 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:53 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:53 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:53 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:53 user nova-compute[75356]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)
Nov 29 20:19:53 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)
Nov 29 20:19:53 user nova-compute[75356]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)
Nov 29 20:19:53 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:53 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:53 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:53 user nova-compute[75356]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c (non-flash)
Nov 29 20:19:53 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:53 user nova-compute[75356]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)
Nov 29 20:19:53 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830818d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c'): ({'sde'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Removing single pathed devices sde {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d505ca1b-3970-4c47-a2ca-b2c2ea904af2]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f972d53-569b-4c9e-8365-53cd1fbbc86b]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Flushing IO for device /dev/sde {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[017e00cd-2552-4246-9ebc-79054122e792]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fa98d3-3427-4163-832f-798e9b4c6b39]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] SCSI volumes sde have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c2ac53-9939-45ea-977d-bac2079b1df4]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab8c7be-14ae-4d16-aab1-4e61d51fda68]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c, portal: 172.16.0.220,3260]
Nov 29 20:19:53 user nova-compute[75356]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c, portal: 172.16.0.220,3260] successful.
Nov 29 20:19:53 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80960645-eeae-46ba-99ef-09ed5d8f499c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[198d8fd6-757a-4fa4-9ba6-cebb96f13127]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] <== disconnect_volume: return (376ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8864353-ba84-4d79-a316-46a185729caa/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8864353-ba84-4d79-a316-46a185729caa/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8864353-ba84-4d79-a316-46a185729caa/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8864353-ba84-4d79-a316-46a185729caa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:54 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:19:54 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:19:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=6973MB free_disk=25.364784240722656GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG nova.objects.instance [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lazy-loading 'flavor' on Instance uuid 972e22c1-bd85-4507-9166-ace3fce8e698 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:19:54 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance ee4a5666-bfea-47bf-bd21-d24685967a3e is timed out.
Nov 29 20:19:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e5f79ed7-473c-49d0-917b-e1134acbb1b5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "972e22c1-bd85-4507-9166-ace3fce8e698" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.009s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:54 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Successfully detached device sdc from instance ee4a5666-bfea-47bf-bd21-d24685967a3e from the live domain config.
Nov 29 20:19:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xSjKBYvE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:19:54 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:19:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 9751c435-4d10-46dc-86e7-39d40e8209d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0b59517a-c467-432a-a73a-d1460c1574e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 96cbbbdb-e1cc-49da-9a9f-5b83031b235b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 972e22c1-bd85-4507-9166-ace3fce8e698 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ee4a5666-bfea-47bf-bd21-d24685967a3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance fb7280bd-7153-4868-b1c9-35cc77e96277 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance f09171b0-1615-49ee-8c66-8b9c4f0af591 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 87fe5c12-c611-4855-8190-6406eca25dba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance d8864353-ba84-4d79-a316-46a185729caa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfb1744-7fba-4ab7-b884-aa49ac753d9a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:19:54 user nova-compute[75356]: No targets found.
Nov 29 20:19:54 user nova-compute[75356]: iSNS:
Nov 29 20:19:54 user nova-compute[75356]: No targets found.
Nov 29 20:19:54 user nova-compute[75356]: STATIC:
Nov 29 20:19:54 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547
Nov 29 20:19:54 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:54 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:54 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5
Nov 29 20:19:54 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:54 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:54 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f
Nov 29 20:19:54 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:54 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:54 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7
Nov 29 20:19:54 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:54 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:54 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9
Nov 29 20:19:54 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:54 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:54 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7
Nov 29 20:19:54 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:54 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:54 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6
Nov 29 20:19:54 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:54 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:54 user nova-compute[75356]: FIRMWARE:
Nov 29 20:19:54 user nova-compute[75356]: No targets found.
Nov 29 20:19:54 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:19:54 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:19:54 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fe3f2c-e712-45ca-82e5-2e2a4660a0ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e34881a-7fad-404c-a724-8c645740c9c2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)
Nov 29 20:19:54 user nova-compute[75356]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)
Nov 29 20:19:54 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:54 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:54 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:54 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:54 user nova-compute[75356]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)
Nov 29 20:19:54 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)
Nov 29 20:19:54 user nova-compute[75356]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)
Nov 29 20:19:54 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:54 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:54 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:54 user nova-compute[75356]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 (non-flash)
Nov 29 20:19:54 user nova-compute[75356]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)
Nov 29 20:19:54 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8308395ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7'): ({'sdf'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Removing single pathed devices sdf {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.037s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b11f53-a698-40c2-92f0-131ad20a3f65]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[774c6b57-9276-4584-98da-6927fff77912]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Flushing IO for device /dev/sdf {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bff46b-ad36-4cae-aede-25f134cc5407]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b07dbec-3c28-4016-a3e1-d0aea757aff5]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] SCSI volumes sdf have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab6c41a-2fbc-462d-af12-e6bc9f5c4b75]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[beff76c6-cc8e-4f40-8a73-47d384c9f4f5]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7, portal: 172.16.0.220,3260]
Nov 29 20:19:55 user nova-compute[75356]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7, portal: 172.16.0.220,3260] successful.
Nov 29 20:19:55 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b9fce4-7c65-4fb3-8c39-f436fffa84b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[02700e8b-987a-416d-b284-72878e895176]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] <== disconnect_volume: return (389ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:19:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.661s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:56 user nova-compute[75356]: DEBUG nova.objects.instance [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lazy-loading 'flavor' on Instance uuid ee4a5666-bfea-47bf-bd21-d24685967a3e {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:19:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da3c8665-186c-4091-87e2-5bbcf250addb tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "ee4a5666-bfea-47bf-bd21-d24685967a3e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.786s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:56 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:19:56 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:19:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-0b59517a-c467-432a-a73a-d1460c1574e7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:19:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-0b59517a-c467-432a-a73a-d1460c1574e7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:19:56 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:19:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:56 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Updating instance_info_cache with network_info: [{"id": "56a80963-a1f2-429e-8474-1795928fd05c", "address": "fa:16:3e:74:bd:99", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a80963-a1", "ovs_interfaceid": "56a80963-a1f2-429e-8474-1795928fd05c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:19:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-0b59517a-c467-432a-a73a-d1460c1574e7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:19:56 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:19:56 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:19:56 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:19:56 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:19:56 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:19:56 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:19:56 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:19:56 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:19:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Acquiring lock "ee4a5666-bfea-47bf-bd21-d24685967a3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "ee4a5666-bfea-47bf-bd21-d24685967a3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Acquiring lock "ee4a5666-bfea-47bf-bd21-d24685967a3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "ee4a5666-bfea-47bf-bd21-d24685967a3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "ee4a5666-bfea-47bf-bd21-d24685967a3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:57 user nova-compute[75356]: INFO nova.compute.manager [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Terminating instance
Nov 29 20:19:57 user nova-compute[75356]: DEBUG nova.compute.manager [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:19:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:57 user nova-compute[75356]: DEBUG nova.compute.manager [req-4f32e28b-2cd4-46c0-be24-d09f2d9f2659 req-5dc697b6-6dbb-415f-bea7-be5f89eb49dd service nova] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Received event network-vif-unplugged-b400acb7-2f4f-45da-80f9-069c8cc27f45 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:19:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4f32e28b-2cd4-46c0-be24-d09f2d9f2659 req-5dc697b6-6dbb-415f-bea7-be5f89eb49dd service nova] Acquiring lock "ee4a5666-bfea-47bf-bd21-d24685967a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4f32e28b-2cd4-46c0-be24-d09f2d9f2659 req-5dc697b6-6dbb-415f-bea7-be5f89eb49dd service nova] Lock "ee4a5666-bfea-47bf-bd21-d24685967a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4f32e28b-2cd4-46c0-be24-d09f2d9f2659 req-5dc697b6-6dbb-415f-bea7-be5f89eb49dd service nova] Lock "ee4a5666-bfea-47bf-bd21-d24685967a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:57 user nova-compute[75356]: DEBUG nova.compute.manager [req-4f32e28b-2cd4-46c0-be24-d09f2d9f2659 req-5dc697b6-6dbb-415f-bea7-be5f89eb49dd service nova] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] No waiting events found dispatching network-vif-unplugged-b400acb7-2f4f-45da-80f9-069c8cc27f45 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:19:57 user nova-compute[75356]: DEBUG nova.compute.manager [req-4f32e28b-2cd4-46c0-be24-d09f2d9f2659 req-5dc697b6-6dbb-415f-bea7-be5f89eb49dd service nova] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Received event network-vif-unplugged-b400acb7-2f4f-45da-80f9-069c8cc27f45 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:19:58 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Instance destroyed successfully.
Nov 29 20:19:58 user nova-compute[75356]: DEBUG nova.objects.instance [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lazy-loading 'resources' on Instance uuid ee4a5666-bfea-47bf-bd21-d24685967a3e {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:19:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:17:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-258501228',display_name='tempest-AttachSCSIVolumeTestJSON-server-258501228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-258501228',id=7,image_ref='d60f5b9d-5836-45d5-a727-2af5402148d9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBABTFvJmVZEqNIYLENnYf5SjeZAVZykkBfrEigmhsx7Hx6GI9666iHudVkf8kmZwQgprOLiXO4idW2ldOm6y1DVez9txK3UPgMTwQqKsR1oHnsXAloPNaaL17B5OGWFlg==',key_name='tempest-keypair-1468309686',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:17:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5ffd2755d0a4059aef77a33d42c29d5',ramdisk_id='',reservation_id='r-dp0g4r0k',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d60f5b9d-5836-45d5-a727-2af5402148d9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1102272910',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1102272910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:17:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8507e047b776409da86c2613319c75bf',uuid=ee4a5666-bfea-47bf-bd21-d24685967a3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b400acb7-2f4f-45da-80f9-069c8cc27f45", "address": "fa:16:3e:87:5a:bf", "network": {"id": "6712a3cd-234a-421e-9d18-5d1e28708025", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-371973715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ffd2755d0a4059aef77a33d42c29d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb400acb7-2f", "ovs_interfaceid": "b400acb7-2f4f-45da-80f9-069c8cc27f45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:19:58 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Converting VIF {"id": "b400acb7-2f4f-45da-80f9-069c8cc27f45", "address": "fa:16:3e:87:5a:bf", "network": {"id": "6712a3cd-234a-421e-9d18-5d1e28708025", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-371973715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5ffd2755d0a4059aef77a33d42c29d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb400acb7-2f", "ovs_interfaceid": "b400acb7-2f4f-45da-80f9-069c8cc27f45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:19:58 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:5a:bf,bridge_name='br-int',has_traffic_filtering=True,id=b400acb7-2f4f-45da-80f9-069c8cc27f45,network=Network(6712a3cd-234a-421e-9d18-5d1e28708025),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb400acb7-2f') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:19:58 user nova-compute[75356]: DEBUG os_vif [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:5a:bf,bridge_name='br-int',has_traffic_filtering=True,id=b400acb7-2f4f-45da-80f9-069c8cc27f45,network=Network(6712a3cd-234a-421e-9d18-5d1e28708025),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb400acb7-2f') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:19:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb400acb7-2f, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:19:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e36bfd0-1636-41b6-b59b-e7e6f9263610) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:19:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:19:58 user nova-compute[75356]: INFO os_vif [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:5a:bf,bridge_name='br-int',has_traffic_filtering=True,id=b400acb7-2f4f-45da-80f9-069c8cc27f45,network=Network(6712a3cd-234a-421e-9d18-5d1e28708025),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb400acb7-2f')
Nov 29 20:19:58 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Deleting instance files /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e_del
Nov 29 20:19:58 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Deletion of /opt/stack/data/nova/instances/ee4a5666-bfea-47bf-bd21-d24685967a3e_del complete
Nov 29 20:19:58 user nova-compute[75356]: INFO nova.compute.manager [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 20:19:58 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:19:58 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:19:58 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-115a1a2e-0d41-48d8-9468-bcaa366b8f61 req-3cd8bf20-56a4-426d-bc55-9e235c44a983 service nova] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Received event network-vif-plugged-b400acb7-2f4f-45da-80f9-069c8cc27f45 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-115a1a2e-0d41-48d8-9468-bcaa366b8f61 req-3cd8bf20-56a4-426d-bc55-9e235c44a983 service nova] Acquiring lock "ee4a5666-bfea-47bf-bd21-d24685967a3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-115a1a2e-0d41-48d8-9468-bcaa366b8f61 req-3cd8bf20-56a4-426d-bc55-9e235c44a983 service nova] Lock "ee4a5666-bfea-47bf-bd21-d24685967a3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-115a1a2e-0d41-48d8-9468-bcaa366b8f61 req-3cd8bf20-56a4-426d-bc55-9e235c44a983 service nova] Lock "ee4a5666-bfea-47bf-bd21-d24685967a3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-115a1a2e-0d41-48d8-9468-bcaa366b8f61 req-3cd8bf20-56a4-426d-bc55-9e235c44a983 service nova] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] No waiting events found dispatching network-vif-plugged-b400acb7-2f4f-45da-80f9-069c8cc27f45 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:19:59 user nova-compute[75356]: WARNING nova.compute.manager [req-115a1a2e-0d41-48d8-9468-bcaa366b8f61 req-3cd8bf20-56a4-426d-bc55-9e235c44a983 service nova] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Received unexpected event network-vif-plugged-b400acb7-2f4f-45da-80f9-069c8cc27f45 for instance with vm_state active and task_state deleting.
Nov 29 20:19:59 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 is timed out.
Nov 29 20:19:59 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Successfully detached device vdb from instance 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 from the live domain config.
Nov 29 20:19:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMDEStaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:19:59 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:19:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e33aa06-c534-4752-9db9-3d91784752ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:19:59 user nova-compute[75356]: No targets found.
Nov 29 20:19:59 user nova-compute[75356]: iSNS:
Nov 29 20:19:59 user nova-compute[75356]: No targets found.
Nov 29 20:19:59 user nova-compute[75356]: STATIC:
Nov 29 20:19:59 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547
Nov 29 20:19:59 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:59 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:59 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5
Nov 29 20:19:59 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:59 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:59 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f
Nov 29 20:19:59 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:59 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:59 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9
Nov 29 20:19:59 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:59 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:59 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7
Nov 29 20:19:59 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:59 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:59 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6
Nov 29 20:19:59 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:19:59 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:19:59 user nova-compute[75356]: FIRMWARE:
Nov 29 20:19:59 user nova-compute[75356]: No targets found.
Nov 29 20:19:59 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:19:59 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:19:59 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[911e0bfb-0ecb-4af9-820d-e998c0dce642]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9171e058-ad40-4913-975a-f7e7afa830db]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)
Nov 29 20:19:59 user nova-compute[75356]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)
Nov 29 20:19:59 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:59 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:59 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:59 user nova-compute[75356]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)
Nov 29 20:19:59 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)
Nov 29 20:19:59 user nova-compute[75356]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)
Nov 29 20:19:59 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:19:59 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:19:59 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:19:59 user nova-compute[75356]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 (non-flash)
Nov 29 20:19:59 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e443acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6'): ({'sdh'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Removing single pathed devices sdh {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[338ae7af-2fe3-4161-8dca-a081dc605fab]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5261357-f82b-4206-9bc0-c0c65a742b4f]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Flushing IO for device /dev/sdh {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff043307-8b78-4c85-a3a3-51548e953797]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.037s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[090708d5-6fd5-40c2-bba3-fc939ecc8bf9]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] SCSI volumes sdh have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:19:59 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Took 1.74 seconds to deallocate network for instance.
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[50537eeb-5430-400a-9098-8e891d2b6735]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:19:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6566baa-626d-4353-87a3-09306ced48dc]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6, portal: 172.16.0.220,3260]
Nov 29 20:20:00 user nova-compute[75356]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6, portal: 172.16.0.220,3260] successful.
Nov 29 20:20:00 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97c82146-b0c6-4c5b-82ac-0e50bfa2fbc6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[852364a1-9088-49fa-a172-567ddbb0abe1]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:20:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] <== disconnect_volume: return (339ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:20:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:20:00 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:20:00 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:20:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:00 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Deleted allocations for instance ee4a5666-bfea-47bf-bd21-d24685967a3e
Nov 29 20:20:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cf52d933-e046-4dcb-a540-ab35d497b882 tempest-AttachSCSIVolumeTestJSON-1102272910 tempest-AttachSCSIVolumeTestJSON-1102272910-project-member] Lock "ee4a5666-bfea-47bf-bd21-d24685967a3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.146s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:00 user nova-compute[75356]: DEBUG nova.objects.instance [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lazy-loading 'flavor' on Instance uuid 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:20:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6755e638-1abc-49ac-a7b9-391c05056378 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.978s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixCdmtaE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fb7280bd-7153-4868-b1c9-35cc77e96277', 'attached_at': '', 'detached_at': '', 'volume_id': 'd655d5aa-afbe-448d-9068-36b17ef93b78', 'serial': 'd655d5aa-afbe-448d-9068-36b17ef93b78'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FNPrHceC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '165059ac-dd9e-4e8f-8362-ce615a19b4e5'}, 'status': 'reserved', 'instance': 'fb7280bd-7153-4868-b1c9-35cc77e96277', 'attached_at': '', 'detached_at': '', 'volume_id': '165059ac-dd9e-4e8f-8362-ce615a19b4e5', 'serial'} {{(pid=75356) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixCdmtaE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:20:01 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:20:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:20:01 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:20:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:20:01 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8b991c-17b2-4bbe-9cbb-2ef623f5018b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:20:01 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d075ef4-0e93-4209-8ed2-217ab366b59c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78] added
Nov 29 20:20:01 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f021efd-7cd6-483c-a2a3-326c7e4a9987]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4b9058-4264-494e-9a31-35d2d8e01cb7]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ixCdmtaE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ixCdmtaE" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[74785f9d-7a3b-4ce0-8da5-af65f16ff1f8]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ixCdmtaE'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[97854f07-5383-404d-885c-3d9df23b41ba]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d71138-ad9d-41ad-a8b9-287157c5b4b3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)
Nov 29 20:20:01 user nova-compute[75356]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)
Nov 29 20:20:01 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:20:01 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:20:01 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:20:01 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)
Nov 29 20:20:01 user nova-compute[75356]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)
Nov 29 20:20:01 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:20:01 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:20:01 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:20:01 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7186b3-f84e-48ef-bac3-b5228d489451]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78, portal: 172.16.0.220,3260]
Nov 29 20:20:01 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78, portal: 172.16.0.220,3260] successful.
Nov 29 20:20:01 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[26125515-274c-421e-9e2a-8b6ffefb8d49]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[684a2db9-816a-4da3-821b-1d597f4dbcdf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)
Nov 29 20:20:01 user nova-compute[75356]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)
Nov 29 20:20:01 user nova-compute[75356]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:20:01 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:20:01 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:20:01 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:20:01 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)
Nov 29 20:20:01 user nova-compute[75356]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)
Nov 29 20:20:01 user nova-compute[75356]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:20:01 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:20:01 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:20:01 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:20:01 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] HCTL ('36', '-', '-', 0) found on session 12 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[080655df-b625-4a0c-a42e-8a5e3826514b]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixCdmtaE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Acquiring lock "interface-3d1a8bb2-82f9-4a3f-aeff-a5472477d651-f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "interface-3d1a8bb2-82f9-4a3f-aeff-a5472477d651-f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG nova.objects.instance [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lazy-loading 'flavor' on Instance uuid 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2087794140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2087794140',id=8,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMcSB5W90J44Qo16Oh0Cpy3jhi4X0540/9A+XafSyfNEzKrqoj4TuajJuNFlGXhbGXb/O9kxaBhSAt46g/kgqUtmOKqWshX+iOmBJWeort/VCkacPfcnj7JuOcU0rQEdQ==',key_name='tempest-keypair-504121784',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:17:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='076d6fb1d7e1485f847881bd7fe665f3',ramdisk_id='',reservation_id='r-8hmccieq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-75465737',owner_user_name='tempest-TaggedAttachmentsTest-75465737-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:17:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5b4a48f9bfd406cae779bfc3dc5e302',uuid=3d1a8bb2-82f9-4a3f-aeff-a5472477d651,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "address": "fa:16:3e:29:9d:4c", "network": {"id": "f2704b81-951a-4297-9c57-421301a5a26d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-239219297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52c2f0a-7f", "ovs_interfaceid": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Converting VIF {"id": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "address": "fa:16:3e:29:9d:4c", "network": {"id": "f2704b81-951a-4297-9c57-421301a5a26d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-239219297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52c2f0a-7f", "ovs_interfaceid": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:9d:4c,bridge_name='br-int',has_traffic_filtering=True,id=f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4,network=Network(f2704b81-951a-4297-9c57-421301a5a26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52c2f0a-7f') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:29:9d:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tapf52c2f0a-7f"/></interface> {{(pid=75356) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:29:9d:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tapf52c2f0a-7f"/></interface> {{(pid=75356) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Attempting to detach device tapf52c2f0a-7f from instance 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] detach device xml: <interface type="ethernet">
Nov 29 20:20:01 user nova-compute[75356]:   <mac address="fa:16:3e:29:9d:4c"/>
Nov 29 20:20:01 user nova-compute[75356]:   <model type="virtio"/>
Nov 29 20:20:01 user nova-compute[75356]:   <mtu size="1442"/>
Nov 29 20:20:01 user nova-compute[75356]:   <target dev="tapf52c2f0a-7f"/>
Nov 29 20:20:01 user nova-compute[75356]: </interface>
Nov 29 20:20:01 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:29:9d:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tapf52c2f0a-7f"/></interface> {{(pid=75356) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:29:9d:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tapf52c2f0a-7f"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 29 20:20:01 user nova-compute[75356]:   <name>instance-00000008</name>
Nov 29 20:20:01 user nova-compute[75356]:   <uuid>3d1a8bb2-82f9-4a3f-aeff-a5472477d651</uuid>
Nov 29 20:20:01 user nova-compute[75356]:   <metadata>
Nov 29 20:20:01 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:20:01 user nova-compute[75356]:   <nova:package version="0.0.0"/>
Nov 29 20:20:01 user nova-compute[75356]:   <nova:name>tempest-device-tagging-server-2087794140</nova:name>
Nov 29 20:20:01 user nova-compute[75356]:   <nova:creationTime>2023-11-29 20:19:25</nova:creationTime>
Nov 29 20:20:01 user nova-compute[75356]:   <nova:flavor name="m1.tiny">
Nov 29 20:20:01 user nova-compute[75356]:     <nova:memory>512</nova:memory>
Nov 29 20:20:01 user nova-compute[75356]:     <nova:disk>1</nova:disk>
Nov 29 20:20:01 user nova-compute[75356]:     <nova:swap>0</nova:swap>
Nov 29 20:20:01 user nova-compute[75356]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:20:01 user nova-compute[75356]:     <nova:vcpus>1</nova:vcpus>
Nov 29 20:20:01 user nova-compute[75356]:   </nova:flavor>
Nov 29 20:20:01 user nova-compute[75356]:   <nova:owner>
Nov 29 20:20:01 user nova-compute[75356]:     <nova:user uuid="e5b4a48f9bfd406cae779bfc3dc5e302">tempest-TaggedAttachmentsTest-75465737-project-member</nova:user>
Nov 29 20:20:01 user nova-compute[75356]:     <nova:project uuid="076d6fb1d7e1485f847881bd7fe665f3">tempest-TaggedAttachmentsTest-75465737</nova:project>
Nov 29 20:20:01 user nova-compute[75356]:   </nova:owner>
Nov 29 20:20:01 user nova-compute[75356]:   <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:20:01 user nova-compute[75356]:   <nova:ports>
Nov 29 20:20:01 user nova-compute[75356]:     <nova:port uuid="577e6509-523f-46e2-9994-9d1eb9ff0c13">
Nov 29 20:20:01 user nova-compute[75356]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 20:20:01 user nova-compute[75356]:     </nova:port>
Nov 29 20:20:01 user nova-compute[75356]:     <nova:port uuid="f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4">
Nov 29 20:20:01 user nova-compute[75356]:       <nova:ip type="fixed" address="10.10.10.83" ipVersion="4"/>
Nov 29 20:20:01 user nova-compute[75356]:     </nova:port>
Nov 29 20:20:01 user nova-compute[75356]:   </nova:ports>
Nov 29 20:20:01 user nova-compute[75356]: </nova:instance>
Nov 29 20:20:01 user nova-compute[75356]:   </metadata>
Nov 29 20:20:01 user nova-compute[75356]:   <memory unit='KiB'>524288</memory>
Nov 29 20:20:01 user nova-compute[75356]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 20:20:01 user nova-compute[75356]:   <vcpu placement='static'>1</vcpu>
Nov 29 20:20:01 user nova-compute[75356]:   <resource>
Nov 29 20:20:01 user nova-compute[75356]:     <partition>/machine</partition>
Nov 29 20:20:01 user nova-compute[75356]:   </resource>
Nov 29 20:20:01 user nova-compute[75356]:   <sysinfo type='smbios'>
Nov 29 20:20:01 user nova-compute[75356]:     <system>
Nov 29 20:20:01 user nova-compute[75356]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 20:20:01 user nova-compute[75356]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 20:20:01 user nova-compute[75356]:       <entry name='version'>0.0.0</entry>
Nov 29 20:20:01 user nova-compute[75356]:       <entry name='serial'>3d1a8bb2-82f9-4a3f-aeff-a5472477d651</entry>
Nov 29 20:20:01 user nova-compute[75356]:       <entry name='uuid'>3d1a8bb2-82f9-4a3f-aeff-a5472477d651</entry>
Nov 29 20:20:01 user nova-compute[75356]:       <entry name='family'>Virtual Machine</entry>
Nov 29 20:20:01 user nova-compute[75356]:     </system>
Nov 29 20:20:01 user nova-compute[75356]:   </sysinfo>
Nov 29 20:20:01 user nova-compute[75356]:   <os>
Nov 29 20:20:01 user nova-compute[75356]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 20:20:01 user nova-compute[75356]:     <boot dev='hd'/>
Nov 29 20:20:01 user nova-compute[75356]:     <smbios mode='sysinfo'/>
Nov 29 20:20:01 user nova-compute[75356]:   </os>
Nov 29 20:20:01 user nova-compute[75356]:   <features>
Nov 29 20:20:01 user nova-compute[75356]:     <acpi/>
Nov 29 20:20:01 user nova-compute[75356]:     <apic/>
Nov 29 20:20:01 user nova-compute[75356]:     <vmcoreinfo state='on'/>
Nov 29 20:20:01 user nova-compute[75356]:   </features>
Nov 29 20:20:01 user nova-compute[75356]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 20:20:01 user nova-compute[75356]:     <model fallback='forbid'>Nehalem</model>
Nov 29 20:20:01 user nova-compute[75356]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 20:20:01 user nova-compute[75356]:     <feature policy='require' name='vme'/>
Nov 29 20:20:01 user nova-compute[75356]:     <feature policy='require' name='x2apic'/>
Nov 29 20:20:01 user nova-compute[75356]:     <feature policy='require' name='hypervisor'/>
Nov 29 20:20:01 user nova-compute[75356]:   </cpu>
Nov 29 20:20:01 user nova-compute[75356]:   <clock offset='utc'>
Nov 29 20:20:01 user nova-compute[75356]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 20:20:01 user nova-compute[75356]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 20:20:01 user nova-compute[75356]:     <timer name='hpet' present='no'/>
Nov 29 20:20:01 user nova-compute[75356]:   </clock>
Nov 29 20:20:01 user nova-compute[75356]:   <on_poweroff>destroy</on_poweroff>
Nov 29 20:20:01 user nova-compute[75356]:   <on_reboot>restart</on_reboot>
Nov 29 20:20:01 user nova-compute[75356]:   <on_crash>destroy</on_crash>
Nov 29 20:20:01 user nova-compute[75356]:   <devices>
Nov 29 20:20:01 user nova-compute[75356]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 20:20:01 user nova-compute[75356]:     <disk type='file' device='disk'>
Nov 29 20:20:01 user nova-compute[75356]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 20:20:01 user nova-compute[75356]:       <source file='/opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk' index='2'/>
Nov 29 20:20:01 user nova-compute[75356]:       <backingStore type='file' index='3'>
Nov 29 20:20:01 user nova-compute[75356]:         <format type='raw'/>
Nov 29 20:20:01 user nova-compute[75356]:         <source file='/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9'/>
Nov 29 20:20:01 user nova-compute[75356]:         <backingStore/>
Nov 29 20:20:01 user nova-compute[75356]:       </backingStore>
Nov 29 20:20:01 user nova-compute[75356]:       <target dev='vda' bus='virtio'/>
Nov 29 20:20:01 user nova-compute[75356]:       <alias name='virtio-disk0'/>
Nov 29 20:20:01 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 20:20:01 user nova-compute[75356]:     </disk>
Nov 29 20:20:01 user nova-compute[75356]:     <disk type='file' device='cdrom'>
Nov 29 20:20:01 user nova-compute[75356]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 20:20:01 user nova-compute[75356]:       <source file='/opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk.config' index='1'/>
Nov 29 20:20:01 user nova-compute[75356]:       <backingStore/>
Nov 29 20:20:01 user nova-compute[75356]:       <target dev='hda' bus='ide'/>
Nov 29 20:20:01 user nova-compute[75356]:       <readonly/>
Nov 29 20:20:01 user nova-compute[75356]:       <alias name='ide0-0-0'/>
Nov 29 20:20:01 user nova-compute[75356]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 20:20:01 user nova-compute[75356]:     </disk>
Nov 29 20:20:01 user nova-compute[75356]:     <controller type='usb' index='0' model='none'>
Nov 29 20:20:01 user nova-compute[75356]:       <alias name='usb'/>
Nov 29 20:20:01 user nova-compute[75356]:     </controller>
Nov 29 20:20:01 user nova-compute[75356]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 20:20:01 user nova-compute[75356]:       <alias name='pci.0'/>
Nov 29 20:20:01 user nova-compute[75356]:     </controller>
Nov 29 20:20:01 user nova-compute[75356]:     <controller type='ide' index='0'>
Nov 29 20:20:01 user nova-compute[75356]:       <alias name='ide'/>
Nov 29 20:20:01 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 20:20:01 user nova-compute[75356]:     </controller>
Nov 29 20:20:01 user nova-compute[75356]:     <interface type='ethernet'>
Nov 29 20:20:01 user nova-compute[75356]:       <mac address='fa:16:3e:34:be:70'/>
Nov 29 20:20:01 user nova-compute[75356]:       <target dev='tap577e6509-52'/>
Nov 29 20:20:01 user nova-compute[75356]:       <model type='virtio'/>
Nov 29 20:20:01 user nova-compute[75356]:       <mtu size='1442'/>
Nov 29 20:20:01 user nova-compute[75356]:       <alias name='net0'/>
Nov 29 20:20:01 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 20:20:01 user nova-compute[75356]:     </interface>
Nov 29 20:20:01 user nova-compute[75356]:     <interface type='ethernet'>
Nov 29 20:20:01 user nova-compute[75356]:       <mac address='fa:16:3e:29:9d:4c'/>
Nov 29 20:20:01 user nova-compute[75356]:       <target dev='tapf52c2f0a-7f'/>
Nov 29 20:20:01 user nova-compute[75356]:       <model type='virtio'/>
Nov 29 20:20:01 user nova-compute[75356]:       <mtu size='1442'/>
Nov 29 20:20:01 user nova-compute[75356]:       <alias name='net1'/>
Nov 29 20:20:01 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 29 20:20:01 user nova-compute[75356]:     </interface>
Nov 29 20:20:01 user nova-compute[75356]:     <serial type='pty'>
Nov 29 20:20:01 user nova-compute[75356]:       <source path='/dev/pts/6'/>
Nov 29 20:20:01 user nova-compute[75356]:       <log file='/opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/console.log' append='off'/>
Nov 29 20:20:01 user nova-compute[75356]:       <target type='isa-serial' port='0'>
Nov 29 20:20:01 user nova-compute[75356]:         <model name='isa-serial'/>
Nov 29 20:20:01 user nova-compute[75356]:       </target>
Nov 29 20:20:01 user nova-compute[75356]:       <alias name='serial0'/>
Nov 29 20:20:01 user nova-compute[75356]:     </serial>
Nov 29 20:20:01 user nova-compute[75356]:     <console type='pty' tty='/dev/pts/6'>
Nov 29 20:20:01 user nova-compute[75356]:       <source path='/dev/pts/6'/>
Nov 29 20:20:01 user nova-compute[75356]:       <log file='/opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/console.log' append='off'/>
Nov 29 20:20:01 user nova-compute[75356]:       <target type='serial' port='0'/>
Nov 29 20:20:01 user nova-compute[75356]:       <alias name='serial0'/>
Nov 29 20:20:01 user nova-compute[75356]:     </console>
Nov 29 20:20:01 user nova-compute[75356]:     <input type='mouse' bus='ps2'>
Nov 29 20:20:01 user nova-compute[75356]:       <alias name='input0'/>
Nov 29 20:20:01 user nova-compute[75356]:     </input>
Nov 29 20:20:01 user nova-compute[75356]:     <input type='keyboard' bus='ps2'>
Nov 29 20:20:01 user nova-compute[75356]:       <alias name='input1'/>
Nov 29 20:20:01 user nova-compute[75356]:     </input>
Nov 29 20:20:01 user nova-compute[75356]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 29 20:20:01 user nova-compute[75356]:       <listen type='address' address='0.0.0.0'/>
Nov 29 20:20:01 user nova-compute[75356]:     </graphics>
Nov 29 20:20:01 user nova-compute[75356]:     <audio id='1' type='none'/>
Nov 29 20:20:01 user nova-compute[75356]:     <video>
Nov 29 20:20:01 user nova-compute[75356]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 20:20:01 user nova-compute[75356]:       <alias name='video0'/>
Nov 29 20:20:01 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 20:20:01 user nova-compute[75356]:     </video>
Nov 29 20:20:01 user nova-compute[75356]:     <memballoon model='virtio'>
Nov 29 20:20:01 user nova-compute[75356]:       <stats period='10'/>
Nov 29 20:20:01 user nova-compute[75356]:       <alias name='balloon0'/>
Nov 29 20:20:01 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 20:20:01 user nova-compute[75356]:     </memballoon>
Nov 29 20:20:01 user nova-compute[75356]:     <rng model='virtio'>
Nov 29 20:20:01 user nova-compute[75356]:       <backend model='random'>/dev/urandom</backend>
Nov 29 20:20:01 user nova-compute[75356]:       <alias name='rng0'/>
Nov 29 20:20:01 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 20:20:01 user nova-compute[75356]:     </rng>
Nov 29 20:20:01 user nova-compute[75356]:   </devices>
Nov 29 20:20:01 user nova-compute[75356]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 20:20:01 user nova-compute[75356]:     <label>libvirt-3d1a8bb2-82f9-4a3f-aeff-a5472477d651</label>
Nov 29 20:20:01 user nova-compute[75356]:     <imagelabel>libvirt-3d1a8bb2-82f9-4a3f-aeff-a5472477d651</imagelabel>
Nov 29 20:20:01 user nova-compute[75356]:   </seclabel>
Nov 29 20:20:01 user nova-compute[75356]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 20:20:01 user nova-compute[75356]:     <label>+64055:+108</label>
Nov 29 20:20:01 user nova-compute[75356]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 20:20:01 user nova-compute[75356]:   </seclabel>
Nov 29 20:20:01 user nova-compute[75356]: </domain>
Nov 29 20:20:01 user nova-compute[75356]:  {{(pid=75356) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 20:20:01 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Successfully detached device tapf52c2f0a-7f from instance 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 from the persistent domain config.
Nov 29 20:20:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] (1/8): Attempting to detach device tapf52c2f0a-7f with device alias net1 from instance 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] detach device xml: <interface type="ethernet">
Nov 29 20:20:01 user nova-compute[75356]:   <mac address="fa:16:3e:29:9d:4c"/>
Nov 29 20:20:01 user nova-compute[75356]:   <model type="virtio"/>
Nov 29 20:20:01 user nova-compute[75356]:   <mtu size="1442"/>
Nov 29 20:20:01 user nova-compute[75356]:   <target dev="tapf52c2f0a-7f"/>
Nov 29 20:20:01 user nova-compute[75356]: </interface>
Nov 29 20:20:01 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG nova.compute.manager [req-1c2a59b4-3db4-4874-98f0-efea9563fce2 req-16de37e9-5338-41a7-93d8-7b704304fe5e service nova] [instance: ee4a5666-bfea-47bf-bd21-d24685967a3e] Received event network-vif-deleted-b400acb7-2f4f-45da-80f9-069c8cc27f45 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Start waiting for the detach event from libvirt for device tapf52c2f0a-7f with device alias net1 for instance 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-250df8dc-5caa-40a7-a1c4-5fe37f82df67 req-5919800c-460e-491d-b2f8-023348010d73 service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Received event network-vif-unplugged-f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-250df8dc-5caa-40a7-a1c4-5fe37f82df67 req-5919800c-460e-491d-b2f8-023348010d73 service nova] Acquiring lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-250df8dc-5caa-40a7-a1c4-5fe37f82df67 req-5919800c-460e-491d-b2f8-023348010d73 service nova] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-250df8dc-5caa-40a7-a1c4-5fe37f82df67 req-5919800c-460e-491d-b2f8-023348010d73 service nova] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-250df8dc-5caa-40a7-a1c4-5fe37f82df67 req-5919800c-460e-491d-b2f8-023348010d73 service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] No waiting events found dispatching network-vif-unplugged-f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:20:02 user nova-compute[75356]: WARNING nova.compute.manager [req-250df8dc-5caa-40a7-a1c4-5fe37f82df67 req-5919800c-460e-491d-b2f8-023348010d73 service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Received unexpected event network-vif-unplugged-f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4 for instance with vm_state active and task_state None.
Nov 29 20:20:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:20:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26238633231373634', 'path': '/dev/sde'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:20:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238633231373634', 'path': '/dev/sde'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:20:02 user nova-compute[75356]: DEBUG nova.objects.instance [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Lazy-loading 'flavor' on Instance uuid fb7280bd-7153-4868-b1c9-35cc77e96277 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:20:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:20:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] COPY block job progress, current cursor: 160432128 final cursor: 1073741824 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:20:03 user nova-compute[75356]: DEBUG nova.compute.manager [req-38deabe6-689c-49ca-b2b4-f772cb59eb07 req-0a00d637-d2f7-4c29-ac6f-5c22fbbca0a0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-changed-27e5a6aa-c30c-4d12-bbf0-1473aac563cc {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:03 user nova-compute[75356]: DEBUG nova.compute.manager [req-38deabe6-689c-49ca-b2b4-f772cb59eb07 req-0a00d637-d2f7-4c29-ac6f-5c22fbbca0a0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Refreshing instance network info cache due to event network-changed-27e5a6aa-c30c-4d12-bbf0-1473aac563cc. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:20:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-38deabe6-689c-49ca-b2b4-f772cb59eb07 req-0a00d637-d2f7-4c29-ac6f-5c22fbbca0a0 service nova] Acquiring lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:20:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-38deabe6-689c-49ca-b2b4-f772cb59eb07 req-0a00d637-d2f7-4c29-ac6f-5c22fbbca0a0 service nova] Acquired lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:20:03 user nova-compute[75356]: DEBUG nova.network.neutron [req-38deabe6-689c-49ca-b2b4-f772cb59eb07 req-0a00d637-d2f7-4c29-ac6f-5c22fbbca0a0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Refreshing network info cache for port 27e5a6aa-c30c-4d12-bbf0-1473aac563cc {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:20:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] COPY block job progress, current cursor: 287309824 final cursor: 1073741824 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:20:04 user nova-compute[75356]: DEBUG nova.compute.manager [req-776103cc-edf4-45ea-a811-c39e3584d52f req-ed00834f-aa6b-4719-85d0-9706c8005575 service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Received event network-vif-plugged-f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-776103cc-edf4-45ea-a811-c39e3584d52f req-ed00834f-aa6b-4719-85d0-9706c8005575 service nova] Acquiring lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-776103cc-edf4-45ea-a811-c39e3584d52f req-ed00834f-aa6b-4719-85d0-9706c8005575 service nova] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-776103cc-edf4-45ea-a811-c39e3584d52f req-ed00834f-aa6b-4719-85d0-9706c8005575 service nova] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:04 user nova-compute[75356]: DEBUG nova.compute.manager [req-776103cc-edf4-45ea-a811-c39e3584d52f req-ed00834f-aa6b-4719-85d0-9706c8005575 service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] No waiting events found dispatching network-vif-plugged-f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:20:04 user nova-compute[75356]: WARNING nova.compute.manager [req-776103cc-edf4-45ea-a811-c39e3584d52f req-ed00834f-aa6b-4719-85d0-9706c8005575 service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Received unexpected event network-vif-plugged-f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4 for instance with vm_state active and task_state None.
Nov 29 20:20:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] COPY block job progress, current cursor: 466616320 final cursor: 1073741824 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:20:04 user nova-compute[75356]: DEBUG nova.network.neutron [req-38deabe6-689c-49ca-b2b4-f772cb59eb07 req-0a00d637-d2f7-4c29-ac6f-5c22fbbca0a0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Updated VIF entry in instance network info cache for port 27e5a6aa-c30c-4d12-bbf0-1473aac563cc. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:20:04 user nova-compute[75356]: DEBUG nova.network.neutron [req-38deabe6-689c-49ca-b2b4-f772cb59eb07 req-0a00d637-d2f7-4c29-ac6f-5c22fbbca0a0 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Updating instance_info_cache with network_info: [{"id": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "address": "fa:16:3e:0e:b4:fe", "network": {"id": "6123d0a4-2d12-4965-b318-00d82c21b25f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-131558133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e5a6aa-c3", "ovs_interfaceid": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "990817da-1c01-455d-9144-c6de7cab7e11", "address": "fa:16:3e:41:b2:32", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990817da-1c", "ovs_interfaceid": "990817da-1c01-455d-9144-c6de7cab7e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3135621b-7479-43f8-9ea4-c5106df4873c", "address": "fa:16:3e:38:04:13", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3135621b-74", "ovs_interfaceid": "3135621b-7479-43f8-9ea4-c5106df4873c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc", "address": "fa:16:3e:d0:1c:12", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec8333a3-8d", "ovs_interfaceid": "ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "address": "fa:16:3e:dd:b5:0a", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e166a72-2c", "ovs_interfaceid": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e856d03-9c9d-4484-bc17-220a97f74696", "address": "fa:16:3e:a6:18:62", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e856d03-9c", "ovs_interfaceid": "2e856d03-9c9d-4484-bc17-220a97f74696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "79852366-6beb-4192-bea2-ca9971d59810", "address": "fa:16:3e:37:f9:ae", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79852366-6b", "ovs_interfaceid": "79852366-6beb-4192-bea2-ca9971d59810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:20:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-38deabe6-689c-49ca-b2b4-f772cb59eb07 req-0a00d637-d2f7-4c29-ac6f-5c22fbbca0a0 service nova] Releasing lock "refresh_cache-87fe5c12-c611-4855-8190-6406eca25dba" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:20:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] COPY block job progress, current cursor: 639631360 final cursor: 1073741824 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:20:05 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f09171b0-1615-49ee-8c66-8b9c4f0af591 is timed out.
Nov 29 20:20:05 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Successfully detached device vdb from instance f09171b0-1615-49ee-8c66-8b9c4f0af591 from the live domain config.
Nov 29 20:20:05 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gCBLADmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:20:05 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:20:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a63cd2a-95b2-4c90-adb8-d28a3d53bfed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:20:05 user nova-compute[75356]: No targets found.
Nov 29 20:20:05 user nova-compute[75356]: iSNS:
Nov 29 20:20:05 user nova-compute[75356]: No targets found.
Nov 29 20:20:05 user nova-compute[75356]: STATIC:
Nov 29 20:20:05 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547
Nov 29 20:20:05 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:20:05 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:20:05 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5
Nov 29 20:20:05 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:20:05 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:20:05 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f
Nov 29 20:20:05 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:20:05 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:20:05 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78
Nov 29 20:20:05 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:20:05 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:20:05 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9
Nov 29 20:20:05 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:20:05 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:20:05 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7
Nov 29 20:20:05 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:20:05 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:20:05 user nova-compute[75356]: FIRMWARE:
Nov 29 20:20:05 user nova-compute[75356]: No targets found.
Nov 29 20:20:05 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:20:05 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:20:05 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bae809-79b9-4494-aa97-073f7d70b753]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a72ffad-4d59-4957-9f31-e02a7d8f05aa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)
Nov 29 20:20:05 user nova-compute[75356]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)
Nov 29 20:20:05 user nova-compute[75356]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:20:05 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:20:05 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:20:05 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:20:05 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 (non-flash)
Nov 29 20:20:05 user nova-compute[75356]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)
Nov 29 20:20:05 user nova-compute[75356]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:20:05 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:20:05 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:20:05 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:20:05 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f83081c0820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9'): ({'sdi'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Removing single pathed devices sdi {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4655ffa2-cbb7-4ddd-814d-7adbc7dc363b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[613d16e5-408b-4190-b115-923abaf62816]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Flushing IO for device /dev/sdi {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[99970fa5-8e59-428d-898c-74e78523633f]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] COPY block job progress, current cursor: 770703360 final cursor: 1073741824 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.044s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14eb626-122d-41a6-9904-3433edb68c80]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] SCSI volumes sdi have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fbd95b-de51-489e-a187-bbe1f63e40af]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fcee36-15e0-4633-a55d-c17db247ed22]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9, portal: 172.16.0.220,3260]
Nov 29 20:20:05 user nova-compute[75356]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9, portal: 172.16.0.220,3260] successful.
Nov 29 20:20:05 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a02e47c0-aa41-47fb-acc4-0e4abe47acd9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f360ed-bc14-4b9c-bb0a-44e17362bd1d]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.468s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] <== disconnect_volume: return (469ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:20:05 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] COPY block job progress, current cursor: 948961280 final cursor: 1073741824 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "87fe5c12-c611-4855-8190-6406eca25dba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:06 user nova-compute[75356]: INFO nova.compute.manager [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Terminating instance
Nov 29 20:20:06 user nova-compute[75356]: DEBUG nova.compute.manager [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] COPY block job progress, current cursor: 1067450368 final cursor: 1073741824 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-e2cd75ee-7c96-49a0-9d70-e03887a50ebe req-d4229b44-f662-4fbd-8899-d4dc8741b9a4 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-unplugged-27e5a6aa-c30c-4d12-bbf0-1473aac563cc {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e2cd75ee-7c96-49a0-9d70-e03887a50ebe req-d4229b44-f662-4fbd-8899-d4dc8741b9a4 service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e2cd75ee-7c96-49a0-9d70-e03887a50ebe req-d4229b44-f662-4fbd-8899-d4dc8741b9a4 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e2cd75ee-7c96-49a0-9d70-e03887a50ebe req-d4229b44-f662-4fbd-8899-d4dc8741b9a4 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-e2cd75ee-7c96-49a0-9d70-e03887a50ebe req-d4229b44-f662-4fbd-8899-d4dc8741b9a4 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-unplugged-27e5a6aa-c30c-4d12-bbf0-1473aac563cc {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-e2cd75ee-7c96-49a0-9d70-e03887a50ebe req-d4229b44-f662-4fbd-8899-d4dc8741b9a4 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-unplugged-27e5a6aa-c30c-4d12-bbf0-1473aac563cc for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG nova.objects.instance [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Lazy-loading 'flavor' on Instance uuid f09171b0-1615-49ee-8c66-8b9c4f0af591 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b2c9c414-524e-4662-b7f9-bd45e6260fa7 tempest-VolumesAssistedSnapshotsTest-125037186 tempest-VolumesAssistedSnapshotsTest-125037186-project-admin] Lock "f09171b0-1615-49ee-8c66-8b9c4f0af591" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.224s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-6a200434-b6fd-4a90-88ea-fe5961c2310d req-f0bc2512-37fc-4748-adda-40dadbcd2610 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-unplugged-0e166a72-2c1d-4e32-9e16-69566aa2859a {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6a200434-b6fd-4a90-88ea-fe5961c2310d req-f0bc2512-37fc-4748-adda-40dadbcd2610 service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6a200434-b6fd-4a90-88ea-fe5961c2310d req-f0bc2512-37fc-4748-adda-40dadbcd2610 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6a200434-b6fd-4a90-88ea-fe5961c2310d req-f0bc2512-37fc-4748-adda-40dadbcd2610 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-6a200434-b6fd-4a90-88ea-fe5961c2310d req-f0bc2512-37fc-4748-adda-40dadbcd2610 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-unplugged-0e166a72-2c1d-4e32-9e16-69566aa2859a {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-6a200434-b6fd-4a90-88ea-fe5961c2310d req-f0bc2512-37fc-4748-adda-40dadbcd2610 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-unplugged-0e166a72-2c1d-4e32-9e16-69566aa2859a for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-bcca8ca1-6f7b-40bf-942c-950a1f851d2f req-96c21102-946e-4b6d-97d3-c48ca2960163 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-unplugged-3135621b-7479-43f8-9ea4-c5106df4873c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-bcca8ca1-6f7b-40bf-942c-950a1f851d2f req-96c21102-946e-4b6d-97d3-c48ca2960163 service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-bcca8ca1-6f7b-40bf-942c-950a1f851d2f req-96c21102-946e-4b6d-97d3-c48ca2960163 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-bcca8ca1-6f7b-40bf-942c-950a1f851d2f req-96c21102-946e-4b6d-97d3-c48ca2960163 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-bcca8ca1-6f7b-40bf-942c-950a1f851d2f req-96c21102-946e-4b6d-97d3-c48ca2960163 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-unplugged-3135621b-7479-43f8-9ea4-c5106df4873c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:20:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-bcca8ca1-6f7b-40bf-942c-950a1f851d2f req-96c21102-946e-4b6d-97d3-c48ca2960163 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-unplugged-3135621b-7479-43f8-9ea4-c5106df4873c for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FNPrHceC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '165059ac-dd9e-4e8f-8362-ce615a19b4e5'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:20:07 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:20:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e8eb4e-b60c-48ba-8217-d4b83ef01149]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:20:07 user nova-compute[75356]: No targets found.
Nov 29 20:20:07 user nova-compute[75356]: iSNS:
Nov 29 20:20:07 user nova-compute[75356]: No targets found.
Nov 29 20:20:07 user nova-compute[75356]: STATIC:
Nov 29 20:20:07 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547
Nov 29 20:20:07 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:20:07 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:20:07 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5
Nov 29 20:20:07 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:20:07 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:20:07 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f
Nov 29 20:20:07 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:20:07 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:20:07 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78
Nov 29 20:20:07 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:20:07 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:20:07 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7
Nov 29 20:20:07 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:20:07 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:20:07 user nova-compute[75356]: FIRMWARE:
Nov 29 20:20:07 user nova-compute[75356]: No targets found.
Nov 29 20:20:07 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:20:07 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:20:07 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3746e87-41cd-411e-8588-4743f2b848c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2144d999-24cb-47be-8163-27bd56147432]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)
Nov 29 20:20:07 user nova-compute[75356]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:20:07 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:20:07 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:20:07 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:20:07 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 (non-flash)
Nov 29 20:20:07 user nova-compute[75356]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:20:07 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:20:07 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:20:07 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:20:07 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f83081c29e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5'): ({'sdj'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Removing single pathed devices sdj {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d99486-57bd-4548-b613-0361aa253875]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[325f4262-e55e-4f21-8d9c-f2b7180fd41f]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Flushing IO for device /dev/sdj {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.011s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b908c82-a163-48ff-b8d4-1e9e8dd58a59]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.038s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92fd3fb-490e-4444-bef5-a5d64a21bd9d]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] SCSI volumes sdj have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c04877b-69e8-4f36-81bd-619eff74815c]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedbaf5c-3954-4c06-adca-3e9ea5b6ed7b]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5, portal: 172.16.0.220,3260]
Nov 29 20:20:07 user nova-compute[75356]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5, portal: 172.16.0.220,3260] successful.
Nov 29 20:20:07 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:165059ac-dd9e-4e8f-8362-ce615a19b4e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb44ca7-d580-45ce-9113-163235c16076]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] <== disconnect_volume: return (328ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixCdmtaE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'fb7280bd-7153-4868-b1c9-35cc77e96277', 'attached_at': '', 'detached_at': '', 'volume_id': 'd655d5aa-afbe-448d-9068-36b17ef93b78', 'serial'} {{(pid=75356) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 29 20:20:07 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] swap_volume: removing Cinder connection for volume 165059ac-dd9e-4e8f-8362-ce615a19b4e5 {{(pid=75356) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 29 20:20:08 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Instance destroyed successfully.
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.objects.instance [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lazy-loading 'resources' on Instance uuid 87fe5c12-c611-4855-8190-6406eca25dba {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1786059119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1786059119',id=12,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Nh0/p7EJswGp3VeXBY5B4OA3/el93z5xaGce4Ke5DnkmOxiLU/Ea5qDNIyc4+O48K6kNq5XnDRcAKQjSZ9woOM9ldfSQfP7ETfWoKe6dHcYQO+HWCJ1XyNkiIA72EDw==',key_name='tempest-keypair-1957815519',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:18:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a951d8b7b8741a688b87fb45529db1c',ramdisk_id='',reservation_id='r-7j320fe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1407027468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1407027468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='737af0562f894f89a83f7575eaeb01d6',uuid=87fe5c12-c611-4855-8190-6406eca25dba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "address": "fa:16:3e:0e:b4:fe", "network": {"id": "6123d0a4-2d12-4965-b318-00d82c21b25f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-131558133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e5a6aa-c3", "ovs_interfaceid": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converting VIF {"id": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "address": "fa:16:3e:0e:b4:fe", "network": {"id": "6123d0a4-2d12-4965-b318-00d82c21b25f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-131558133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e5a6aa-c3", "ovs_interfaceid": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:b4:fe,bridge_name='br-int',has_traffic_filtering=True,id=27e5a6aa-c30c-4d12-bbf0-1473aac563cc,network=Network(6123d0a4-2d12-4965-b318-00d82c21b25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e5a6aa-c3') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG os_vif [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:b4:fe,bridge_name='br-int',has_traffic_filtering=True,id=27e5a6aa-c30c-4d12-bbf0-1473aac563cc,network=Network(6123d0a4-2d12-4965-b318-00d82c21b25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e5a6aa-c3') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27e5a6aa-c3, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8abc9ca-9020-4883-a9cb-613db17a1eb2) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: INFO os_vif [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:b4:fe,bridge_name='br-int',has_traffic_filtering=True,id=27e5a6aa-c30c-4d12-bbf0-1473aac563cc,network=Network(6123d0a4-2d12-4965-b318-00d82c21b25f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e5a6aa-c3')
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1786059119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1786059119',id=12,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Nh0/p7EJswGp3VeXBY5B4OA3/el93z5xaGce4Ke5DnkmOxiLU/Ea5qDNIyc4+O48K6kNq5XnDRcAKQjSZ9woOM9ldfSQfP7ETfWoKe6dHcYQO+HWCJ1XyNkiIA72EDw==',key_name='tempest-keypair-1957815519',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:18:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a951d8b7b8741a688b87fb45529db1c',ramdisk_id='',reservation_id='r-7j320fe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1407027468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1407027468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='737af0562f894f89a83f7575eaeb01d6',uuid=87fe5c12-c611-4855-8190-6406eca25dba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "990817da-1c01-455d-9144-c6de7cab7e11", "address": "fa:16:3e:41:b2:32", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990817da-1c", "ovs_interfaceid": "990817da-1c01-455d-9144-c6de7cab7e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converting VIF {"id": "990817da-1c01-455d-9144-c6de7cab7e11", "address": "fa:16:3e:41:b2:32", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990817da-1c", "ovs_interfaceid": "990817da-1c01-455d-9144-c6de7cab7e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:b2:32,bridge_name='br-int',has_traffic_filtering=True,id=990817da-1c01-455d-9144-c6de7cab7e11,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap990817da-1c') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG os_vif [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:b2:32,bridge_name='br-int',has_traffic_filtering=True,id=990817da-1c01-455d-9144-c6de7cab7e11,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap990817da-1c') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap990817da-1c, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9edd3851-b5a9-4927-a6d9-c9d79be493f9) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: INFO os_vif [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:b2:32,bridge_name='br-int',has_traffic_filtering=True,id=990817da-1c01-455d-9144-c6de7cab7e11,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap990817da-1c')
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1786059119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1786059119',id=12,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Nh0/p7EJswGp3VeXBY5B4OA3/el93z5xaGce4Ke5DnkmOxiLU/Ea5qDNIyc4+O48K6kNq5XnDRcAKQjSZ9woOM9ldfSQfP7ETfWoKe6dHcYQO+HWCJ1XyNkiIA72EDw==',key_name='tempest-keypair-1957815519',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:18:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a951d8b7b8741a688b87fb45529db1c',ramdisk_id='',reservation_id='r-7j320fe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1407027468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1407027468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='737af0562f894f89a83f7575eaeb01d6',uuid=87fe5c12-c611-4855-8190-6406eca25dba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3135621b-7479-43f8-9ea4-c5106df4873c", "address": "fa:16:3e:38:04:13", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3135621b-74", "ovs_interfaceid": "3135621b-7479-43f8-9ea4-c5106df4873c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converting VIF {"id": "3135621b-7479-43f8-9ea4-c5106df4873c", "address": "fa:16:3e:38:04:13", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3135621b-74", "ovs_interfaceid": "3135621b-7479-43f8-9ea4-c5106df4873c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:04:13,bridge_name='br-int',has_traffic_filtering=True,id=3135621b-7479-43f8-9ea4-c5106df4873c,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3135621b-74') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG os_vif [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:04:13,bridge_name='br-int',has_traffic_filtering=True,id=3135621b-7479-43f8-9ea4-c5106df4873c,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3135621b-74') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3135621b-74, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2a9d38d-742a-415a-b104-697be274e91d) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: INFO os_vif [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:04:13,bridge_name='br-int',has_traffic_filtering=True,id=3135621b-7479-43f8-9ea4-c5106df4873c,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3135621b-74')
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1786059119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1786059119',id=12,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Nh0/p7EJswGp3VeXBY5B4OA3/el93z5xaGce4Ke5DnkmOxiLU/Ea5qDNIyc4+O48K6kNq5XnDRcAKQjSZ9woOM9ldfSQfP7ETfWoKe6dHcYQO+HWCJ1XyNkiIA72EDw==',key_name='tempest-keypair-1957815519',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:18:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a951d8b7b8741a688b87fb45529db1c',ramdisk_id='',reservation_id='r-7j320fe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1407027468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1407027468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='737af0562f894f89a83f7575eaeb01d6',uuid=87fe5c12-c611-4855-8190-6406eca25dba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc", "address": "fa:16:3e:d0:1c:12", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec8333a3-8d", "ovs_interfaceid": "ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converting VIF {"id": "ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc", "address": "fa:16:3e:d0:1c:12", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec8333a3-8d", "ovs_interfaceid": "ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1c:12,bridge_name='br-int',has_traffic_filtering=True,id=ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec8333a3-8d') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG os_vif [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1c:12,bridge_name='br-int',has_traffic_filtering=True,id=ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec8333a3-8d') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec8333a3-8d, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9166a37f-0826-4c3d-83de-3917a0e9246f) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] swap_volume: Updating volume 165059ac-dd9e-4e8f-8362-ce615a19b4e5 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "ixCdmtaE", "auth_password": "GQIhDentdCmwp0", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "d655d5aa-afbe-448d-9068-36b17ef93b78"}, "status": "reserved", "instance": "fb7280bd-7153-4868-b1c9-35cc77e96277", "attached_at": "", "detached_at": "", "volume_id": "d655d5aa-afbe-448d-9068-36b17ef93b78", "serial": "d655d5aa-afbe-448d-9068-36b17ef93b78"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd655d5aa-afbe-448d-9068-36b17ef93b78', 'no_device': None, 'attachment_id': '4b572f40-eb0b-42fa-aa1b-08babf5ff43e'} {{(pid=75356) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ac23095b-f2c9-438c-a17a-70961c0ff9ed tempest-TestVolumeSwap-904576084 tempest-TestVolumeSwap-904576084-project-admin] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.524s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: INFO os_vif [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1c:12,bridge_name='br-int',has_traffic_filtering=True,id=ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec8333a3-8d')
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1786059119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1786059119',id=12,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Nh0/p7EJswGp3VeXBY5B4OA3/el93z5xaGce4Ke5DnkmOxiLU/Ea5qDNIyc4+O48K6kNq5XnDRcAKQjSZ9woOM9ldfSQfP7ETfWoKe6dHcYQO+HWCJ1XyNkiIA72EDw==',key_name='tempest-keypair-1957815519',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:18:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a951d8b7b8741a688b87fb45529db1c',ramdisk_id='',reservation_id='r-7j320fe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1407027468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1407027468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='737af0562f894f89a83f7575eaeb01d6',uuid=87fe5c12-c611-4855-8190-6406eca25dba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "address": "fa:16:3e:dd:b5:0a", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e166a72-2c", "ovs_interfaceid": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converting VIF {"id": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "address": "fa:16:3e:dd:b5:0a", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e166a72-2c", "ovs_interfaceid": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:b5:0a,bridge_name='br-int',has_traffic_filtering=True,id=0e166a72-2c1d-4e32-9e16-69566aa2859a,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e166a72-2c') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG os_vif [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:b5:0a,bridge_name='br-int',has_traffic_filtering=True,id=0e166a72-2c1d-4e32-9e16-69566aa2859a,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e166a72-2c') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e166a72-2c, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-plugged-27e5a6aa-c30c-4d12-bbf0-1473aac563cc {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-plugged-27e5a6aa-c30c-4d12-bbf0-1473aac563cc {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:20:08 user nova-compute[75356]: WARNING nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received unexpected event network-vif-plugged-27e5a6aa-c30c-4d12-bbf0-1473aac563cc for instance with vm_state active and task_state deleting.
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-unplugged-990817da-1c01-455d-9144-c6de7cab7e11 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-unplugged-990817da-1c01-455d-9144-c6de7cab7e11 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-unplugged-990817da-1c01-455d-9144-c6de7cab7e11 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-plugged-990817da-1c01-455d-9144-c6de7cab7e11 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-plugged-990817da-1c01-455d-9144-c6de7cab7e11 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:20:08 user nova-compute[75356]: WARNING nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received unexpected event network-vif-plugged-990817da-1c01-455d-9144-c6de7cab7e11 for instance with vm_state active and task_state deleting.
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-unplugged-ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-unplugged-ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-unplugged-ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-plugged-ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-plugged-ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:20:08 user nova-compute[75356]: WARNING nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received unexpected event network-vif-plugged-ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc for instance with vm_state active and task_state deleting.
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-unplugged-2e856d03-9c9d-4484-bc17-220a97f74696 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-unplugged-2e856d03-9c9d-4484-bc17-220a97f74696 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-unplugged-2e856d03-9c9d-4484-bc17-220a97f74696 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-plugged-2e856d03-9c9d-4484-bc17-220a97f74696 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-plugged-2e856d03-9c9d-4484-bc17-220a97f74696 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:20:08 user nova-compute[75356]: WARNING nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received unexpected event network-vif-plugged-2e856d03-9c9d-4484-bc17-220a97f74696 for instance with vm_state active and task_state deleting.
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-unplugged-79852366-6beb-4192-bea2-ca9971d59810 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-unplugged-79852366-6beb-4192-bea2-ca9971d59810 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-unplugged-79852366-6beb-4192-bea2-ca9971d59810 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-plugged-79852366-6beb-4192-bea2-ca9971d59810 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-plugged-79852366-6beb-4192-bea2-ca9971d59810 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:20:08 user nova-compute[75356]: WARNING nova.compute.manager [req-d8cdff45-49c2-4c85-a9bb-f6526ac4d5df req-f8a609be-a85a-46ce-8cdb-d09babcb2acb service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received unexpected event network-vif-plugged-79852366-6beb-4192-bea2-ca9971d59810 for instance with vm_state active and task_state deleting.
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=07c2c1b7-84b0-4ee4-9bac-91d557df42fd) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: INFO os_vif [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:b5:0a,bridge_name='br-int',has_traffic_filtering=True,id=0e166a72-2c1d-4e32-9e16-69566aa2859a,network=Network(c5e8c815-12b4-4425-b059-ae01bfc8e055),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e166a72-2c')
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1786059119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1786059119',id=12,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Nh0/p7EJswGp3VeXBY5B4OA3/el93z5xaGce4Ke5DnkmOxiLU/Ea5qDNIyc4+O48K6kNq5XnDRcAKQjSZ9woOM9ldfSQfP7ETfWoKe6dHcYQO+HWCJ1XyNkiIA72EDw==',key_name='tempest-keypair-1957815519',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:18:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a951d8b7b8741a688b87fb45529db1c',ramdisk_id='',reservation_id='r-7j320fe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1407027468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1407027468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='737af0562f894f89a83f7575eaeb01d6',uuid=87fe5c12-c611-4855-8190-6406eca25dba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e856d03-9c9d-4484-bc17-220a97f74696", "address": "fa:16:3e:a6:18:62", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e856d03-9c", "ovs_interfaceid": "2e856d03-9c9d-4484-bc17-220a97f74696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converting VIF {"id": "2e856d03-9c9d-4484-bc17-220a97f74696", "address": "fa:16:3e:a6:18:62", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e856d03-9c", "ovs_interfaceid": "2e856d03-9c9d-4484-bc17-220a97f74696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:18:62,bridge_name='br-int',has_traffic_filtering=True,id=2e856d03-9c9d-4484-bc17-220a97f74696,network=Network(d8cceb20-7800-4f94-9044-cdc204990f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e856d03-9c') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG os_vif [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:18:62,bridge_name='br-int',has_traffic_filtering=True,id=2e856d03-9c9d-4484-bc17-220a97f74696,network=Network(d8cceb20-7800-4f94-9044-cdc204990f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e856d03-9c') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e856d03-9c, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1699bf44-de26-40dd-9f8c-3a818c7a59ff) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: INFO os_vif [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:18:62,bridge_name='br-int',has_traffic_filtering=True,id=2e856d03-9c9d-4484-bc17-220a97f74696,network=Network(d8cceb20-7800-4f94-9044-cdc204990f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e856d03-9c')
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1786059119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1786059119',id=12,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/Nh0/p7EJswGp3VeXBY5B4OA3/el93z5xaGce4Ke5DnkmOxiLU/Ea5qDNIyc4+O48K6kNq5XnDRcAKQjSZ9woOM9ldfSQfP7ETfWoKe6dHcYQO+HWCJ1XyNkiIA72EDw==',key_name='tempest-keypair-1957815519',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:18:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a951d8b7b8741a688b87fb45529db1c',ramdisk_id='',reservation_id='r-7j320fe6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1407027468',owner_user_name='tempest-TaggedBootDevicesTest_v242-1407027468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='737af0562f894f89a83f7575eaeb01d6',uuid=87fe5c12-c611-4855-8190-6406eca25dba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79852366-6beb-4192-bea2-ca9971d59810", "address": "fa:16:3e:37:f9:ae", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79852366-6b", "ovs_interfaceid": "79852366-6beb-4192-bea2-ca9971d59810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converting VIF {"id": "79852366-6beb-4192-bea2-ca9971d59810", "address": "fa:16:3e:37:f9:ae", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79852366-6b", "ovs_interfaceid": "79852366-6beb-4192-bea2-ca9971d59810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:f9:ae,bridge_name='br-int',has_traffic_filtering=True,id=79852366-6beb-4192-bea2-ca9971d59810,network=Network(d8cceb20-7800-4f94-9044-cdc204990f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79852366-6b') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG os_vif [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:f9:ae,bridge_name='br-int',has_traffic_filtering=True,id=79852366-6beb-4192-bea2-ca9971d59810,network=Network(d8cceb20-7800-4f94-9044-cdc204990f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79852366-6b') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79852366-6b, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cd46cd9-7ad7-40f6-ad3e-0b53f06f10a5) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:08 user nova-compute[75356]: INFO os_vif [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:f9:ae,bridge_name='br-int',has_traffic_filtering=True,id=79852366-6beb-4192-bea2-ca9971d59810,network=Network(d8cceb20-7800-4f94-9044-cdc204990f5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79852366-6b')
Nov 29 20:20:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMpmZAFH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:20:08 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:20:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c23129-bf05-4975-b8be-7d79d01b4ece]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:20:08 user nova-compute[75356]: No targets found.
Nov 29 20:20:08 user nova-compute[75356]: iSNS:
Nov 29 20:20:08 user nova-compute[75356]: No targets found.
Nov 29 20:20:08 user nova-compute[75356]: STATIC:
Nov 29 20:20:08 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547
Nov 29 20:20:08 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:20:08 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:20:08 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f
Nov 29 20:20:08 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:20:08 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:20:08 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78
Nov 29 20:20:08 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:20:08 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:20:08 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7
Nov 29 20:20:08 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:20:08 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:20:08 user nova-compute[75356]: FIRMWARE:
Nov 29 20:20:08 user nova-compute[75356]: No targets found.
Nov 29 20:20:08 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:20:08 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:20:08 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[455b412b-6203-4998-a1fb-c32278b527c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b676cd0-e1cd-449d-8f6c-35117451f9a6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:20:08 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:20:08 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:20:08 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:20:08 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:20:08 user nova-compute[75356]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 (non-flash)
Nov 29 20:20:08 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:20:08 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:20:08 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f83083152d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7'): ({'sdb'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Removing single pathed devices sdb {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bba97a9-ca33-4be8-8dd2-bbc468550a43]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b5ebe1-aa70-4c30-bb3c-7a80eaeb7f6d]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Flushing IO for device /dev/sdb {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6f3997-ff70-4f98-a0ef-7eea05560de1]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[558878bb-2385-497d-b986-231c15da02cc]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] SCSI volumes sdb have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[886e08e8-2357-4c57-b226-fe4ce819cc05]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f78d6d9-d31d-47c9-9d2a-780f53f4f70e]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7, portal: 172.16.0.220,3260]
Nov 29 20:20:09 user nova-compute[75356]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7, portal: 172.16.0.220,3260] successful.
Nov 29 20:20:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG nova.compute.manager [req-ebde5492-0453-4008-a54c-c3691469f397 req-0752110c-f786-43e4-ab88-5992b81f1212 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-plugged-0e166a72-2c1d-4e32-9e16-69566aa2859a {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ebde5492-0453-4008-a54c-c3691469f397 req-0752110c-f786-43e4-ab88-5992b81f1212 service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ebde5492-0453-4008-a54c-c3691469f397 req-0752110c-f786-43e4-ab88-5992b81f1212 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ebde5492-0453-4008-a54c-c3691469f397 req-0752110c-f786-43e4-ab88-5992b81f1212 service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG nova.compute.manager [req-ebde5492-0453-4008-a54c-c3691469f397 req-0752110c-f786-43e4-ab88-5992b81f1212 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-plugged-0e166a72-2c1d-4e32-9e16-69566aa2859a {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:20:09 user nova-compute[75356]: WARNING nova.compute.manager [req-ebde5492-0453-4008-a54c-c3691469f397 req-0752110c-f786-43e4-ab88-5992b81f1212 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received unexpected event network-vif-plugged-0e166a72-2c1d-4e32-9e16-69566aa2859a for instance with vm_state active and task_state deleting.
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG nova.compute.manager [req-0c9f5754-09e4-4fed-8bb1-b46a8f708135 req-a77af13e-06e5-4bc1-a3cd-a655e56edc0a service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-plugged-3135621b-7479-43f8-9ea4-c5106df4873c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0c9f5754-09e4-4fed-8bb1-b46a8f708135 req-a77af13e-06e5-4bc1-a3cd-a655e56edc0a service nova] Acquiring lock "87fe5c12-c611-4855-8190-6406eca25dba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0c9f5754-09e4-4fed-8bb1-b46a8f708135 req-a77af13e-06e5-4bc1-a3cd-a655e56edc0a service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0c9f5754-09e4-4fed-8bb1-b46a8f708135 req-a77af13e-06e5-4bc1-a3cd-a655e56edc0a service nova] Lock "87fe5c12-c611-4855-8190-6406eca25dba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG nova.compute.manager [req-0c9f5754-09e4-4fed-8bb1-b46a8f708135 req-a77af13e-06e5-4bc1-a3cd-a655e56edc0a service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] No waiting events found dispatching network-vif-plugged-3135621b-7479-43f8-9ea4-c5106df4873c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:20:09 user nova-compute[75356]: WARNING nova.compute.manager [req-0c9f5754-09e4-4fed-8bb1-b46a8f708135 req-a77af13e-06e5-4bc1-a3cd-a655e56edc0a service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received unexpected event network-vif-plugged-3135621b-7479-43f8-9ea4-c5106df4873c for instance with vm_state active and task_state deleting.
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9df962b-5c68-44f7-aebf-2c91f69811c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d6089a-21c3-4bd8-b7b8-3c6bbe992e88]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] <== disconnect_volume: return (299ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OLznVCJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:20:09 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3215a0-cb75-4627-ba3b-e147290c9f12]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:20:09 user nova-compute[75356]: No targets found.
Nov 29 20:20:09 user nova-compute[75356]: iSNS:
Nov 29 20:20:09 user nova-compute[75356]: No targets found.
Nov 29 20:20:09 user nova-compute[75356]: STATIC:
Nov 29 20:20:09 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547
Nov 29 20:20:09 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:20:09 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:20:09 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f
Nov 29 20:20:09 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:20:09 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:20:09 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78
Nov 29 20:20:09 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:20:09 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:20:09 user nova-compute[75356]: FIRMWARE:
Nov 29 20:20:09 user nova-compute[75356]: No targets found.
Nov 29 20:20:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:20:09 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:20:09 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b137627-04ec-4569-ab9a-4d90829143c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[41270a28-6ad9-46b7-ab42-71943f8e2f3e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:20:09 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:20:09 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:20:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:20:09 user nova-compute[75356]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f (non-flash)
Nov 29 20:20:09 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:20:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e44a7640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f'): ({'sdc'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Removing single pathed devices sdc {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd6cad4-b343-446c-ab77-333627ad5380]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3a92c0-9b6d-4949-925b-135132fce271]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Flushing IO for device /dev/sdc {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ceefaf-9b09-487b-9d68-814825258bed]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[945056e6-cbed-4141-a269-71b84dafcba4]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6681f912-7f22-46da-b6b4-31676f0488ee]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[896dc41f-2406-4640-a422-4dfb68a700d5]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f, portal: 172.16.0.220,3260]
Nov 29 20:20:09 user nova-compute[75356]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f, portal: 172.16.0.220,3260] successful.
Nov 29 20:20:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d224672-854d-4749-b8fb-942523caa12f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e13fba7-5239-47c1-bf00-a1c47c123f51]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] <== disconnect_volume: return (305ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QaKstcYk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:20:09 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee1e5c8-1c14-4ced-b778-7698a0a7c54e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:20:09 user nova-compute[75356]: No targets found.
Nov 29 20:20:09 user nova-compute[75356]: iSNS:
Nov 29 20:20:09 user nova-compute[75356]: No targets found.
Nov 29 20:20:09 user nova-compute[75356]: STATIC:
Nov 29 20:20:09 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547
Nov 29 20:20:09 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:20:09 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:20:09 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78
Nov 29 20:20:09 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:20:09 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:20:09 user nova-compute[75356]: FIRMWARE:
Nov 29 20:20:09 user nova-compute[75356]: No targets found.
Nov 29 20:20:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:20:09 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:20:09 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ab3795-6d0f-4434-bea8-812dec88f2c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dedf752-52c5-4e7d-a29b-e8b26be19dd5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:20:09 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:20:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:20:09 user nova-compute[75356]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 (non-flash)
Nov 29 20:20:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e44a7640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547'): ({'sdd'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Removing single pathed devices sdd {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6814a8ce-579f-4fb4-a0d9-710678a43563]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba87024-dc11-405b-8389-11274668ea65]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Flushing IO for device /dev/sdd {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[682b71aa-bf26-406a-876c-91e755885f79]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e85176-c67c-444f-80e1-5c10160ecc6f]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] SCSI volumes sdd have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2056909c-a85d-4226-9f9b-9773c1ce025a]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[129a7478-1286-4402-891f-9ce6e9bf1c5b]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547, portal: 172.16.0.220,3260]
Nov 29 20:20:09 user nova-compute[75356]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547, portal: 172.16.0.220,3260] successful.
Nov 29 20:20:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b189071-f183-448d-8a64-fa5c0aa5c547 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3edc69-7715-479f-94aa-f4414d0a947c]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] <== disconnect_volume: return (289ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:20:09 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Deleting instance files /opt/stack/data/nova/instances/87fe5c12-c611-4855-8190-6406eca25dba_del
Nov 29 20:20:09 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Deletion of /opt/stack/data/nova/instances/87fe5c12-c611-4855-8190-6406eca25dba_del complete
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Acquiring lock "fb7280bd-7153-4868-b1c9-35cc77e96277" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:09 user nova-compute[75356]: INFO nova.compute.manager [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Detaching volume d655d5aa-afbe-448d-9068-36b17ef93b78
Nov 29 20:20:09 user nova-compute[75356]: INFO nova.compute.manager [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Took 3.63 seconds to destroy the instance on the hypervisor.
Nov 29 20:20:09 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:20:09 user nova-compute[75356]: INFO nova.virt.block_device [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Attempting to driver detach volume d655d5aa-afbe-448d-9068-36b17ef93b78 from mountpoint /dev/vdb
Nov 29 20:20:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Attempting to detach device vdb from instance fb7280bd-7153-4868-b1c9-35cc77e96277 from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:20:09 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:20:09 user nova-compute[75356]:   <source dev="/dev/sde"/>
Nov 29 20:20:09 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:20:09 user nova-compute[75356]:   <serial>d655d5aa-afbe-448d-9068-36b17ef93b78</serial>
Nov 29 20:20:09 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:20:09 user nova-compute[75356]: </disk>
Nov 29 20:20:09 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:20:09 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Successfully detached device vdb from instance fb7280bd-7153-4868-b1c9-35cc77e96277 from the persistent domain config.
Nov 29 20:20:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fb7280bd-7153-4868-b1c9-35cc77e96277 from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:20:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:20:09 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:20:09 user nova-compute[75356]:   <source dev="/dev/sde"/>
Nov 29 20:20:09 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:20:09 user nova-compute[75356]:   <serial>d655d5aa-afbe-448d-9068-36b17ef93b78</serial>
Nov 29 20:20:09 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:20:09 user nova-compute[75356]: </disk>
Nov 29 20:20:09 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:20:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fb7280bd-7153-4868-b1c9-35cc77e96277 {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:20:11 user nova-compute[75356]: DEBUG nova.compute.manager [req-b468dfee-faab-49f7-9c2b-988358033166 req-147ffae8-9f0e-46c9-a2b9-09332f30f65b service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-deleted-ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:11 user nova-compute[75356]: INFO nova.compute.manager [req-b468dfee-faab-49f7-9c2b-988358033166 req-147ffae8-9f0e-46c9-a2b9-09332f30f65b service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Neutron deleted interface ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc; detaching it from the instance and deleting it from the info cache
Nov 29 20:20:11 user nova-compute[75356]: DEBUG nova.network.neutron [req-b468dfee-faab-49f7-9c2b-988358033166 req-147ffae8-9f0e-46c9-a2b9-09332f30f65b service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Updating instance_info_cache with network_info: [{"id": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "address": "fa:16:3e:0e:b4:fe", "network": {"id": "6123d0a4-2d12-4965-b318-00d82c21b25f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-131558133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e5a6aa-c3", "ovs_interfaceid": "27e5a6aa-c30c-4d12-bbf0-1473aac563cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "990817da-1c01-455d-9144-c6de7cab7e11", "address": "fa:16:3e:41:b2:32", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap990817da-1c", "ovs_interfaceid": "990817da-1c01-455d-9144-c6de7cab7e11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3135621b-7479-43f8-9ea4-c5106df4873c", "address": "fa:16:3e:38:04:13", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3135621b-74", "ovs_interfaceid": "3135621b-7479-43f8-9ea4-c5106df4873c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "address": "fa:16:3e:dd:b5:0a", "network": {"id": "c5e8c815-12b4-4425-b059-ae01bfc8e055", "bridge": "br-int", "label": "tempest-device-tagging-net1-618582456", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e166a72-2c", "ovs_interfaceid": "0e166a72-2c1d-4e32-9e16-69566aa2859a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e856d03-9c9d-4484-bc17-220a97f74696", "address": "fa:16:3e:a6:18:62", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e856d03-9c", "ovs_interfaceid": "2e856d03-9c9d-4484-bc17-220a97f74696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "79852366-6beb-4192-bea2-ca9971d59810", "address": "fa:16:3e:37:f9:ae", "network": {"id": "d8cceb20-7800-4f94-9044-cdc204990f5a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1001440964", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7a951d8b7b8741a688b87fb45529db1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79852366-6b", "ovs_interfaceid": "79852366-6beb-4192-bea2-ca9971d59810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:20:11 user nova-compute[75356]: DEBUG nova.compute.manager [req-b468dfee-faab-49f7-9c2b-988358033166 req-147ffae8-9f0e-46c9-a2b9-09332f30f65b service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Detach interface failed, port_id=ec8333a3-8da8-41d9-9d2d-a6310d7a4bbc, reason: Instance 87fe5c12-c611-4855-8190-6406eca25dba could not be found. {{(pid=75356) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 20:20:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:12 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:20:12 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Took 3.19 seconds to deallocate network for instance.
Nov 29 20:20:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-d162459c-1c86-43bf-9a15-19e60273f6d5 req-11522e6c-5bbe-4821-9cc9-2e4733b0a433 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-deleted-79852366-6beb-4192-bea2-ca9971d59810 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-d162459c-1c86-43bf-9a15-19e60273f6d5 req-11522e6c-5bbe-4821-9cc9-2e4733b0a433 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-deleted-0e166a72-2c1d-4e32-9e16-69566aa2859a {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-d162459c-1c86-43bf-9a15-19e60273f6d5 req-11522e6c-5bbe-4821-9cc9-2e4733b0a433 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-deleted-2e856d03-9c9d-4484-bc17-220a97f74696 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-d162459c-1c86-43bf-9a15-19e60273f6d5 req-11522e6c-5bbe-4821-9cc9-2e4733b0a433 service nova] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Received event network-vif-deleted-27e5a6aa-c30c-4d12-bbf0-1473aac563cc {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:15 user nova-compute[75356]: INFO nova.compute.manager [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] [instance: 87fe5c12-c611-4855-8190-6406eca25dba] Took 2.24 seconds to detach 3 volumes for instance.
Nov 29 20:20:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:15 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:20:15 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:20:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:15 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Deleted allocations for instance 87fe5c12-c611-4855-8190-6406eca25dba
Nov 29 20:20:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7225afa8-e5ed-4123-a578-9691cb5d57c1 tempest-TaggedBootDevicesTest_v242-1407027468 tempest-TaggedBootDevicesTest_v242-1407027468-project-member] Lock "87fe5c12-c611-4855-8190-6406eca25dba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.666s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:21 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Waiting for libvirt event about the detach of device tapf52c2f0a-7f with device alias net1 from instance 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 is timed out.
Nov 29 20:20:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:29:9d:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tapf52c2f0a-7f"/></interface> {{(pid=75356) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 20:20:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:29:9d:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tapf52c2f0a-7f"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 29 20:20:21 user nova-compute[75356]:   <name>instance-00000008</name>
Nov 29 20:20:21 user nova-compute[75356]:   <uuid>3d1a8bb2-82f9-4a3f-aeff-a5472477d651</uuid>
Nov 29 20:20:21 user nova-compute[75356]:   <metadata>
Nov 29 20:20:21 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:20:21 user nova-compute[75356]:   <nova:package version="0.0.0"/>
Nov 29 20:20:21 user nova-compute[75356]:   <nova:name>tempest-device-tagging-server-2087794140</nova:name>
Nov 29 20:20:21 user nova-compute[75356]:   <nova:creationTime>2023-11-29 20:19:25</nova:creationTime>
Nov 29 20:20:21 user nova-compute[75356]:   <nova:flavor name="m1.tiny">
Nov 29 20:20:21 user nova-compute[75356]:     <nova:memory>512</nova:memory>
Nov 29 20:20:21 user nova-compute[75356]:     <nova:disk>1</nova:disk>
Nov 29 20:20:21 user nova-compute[75356]:     <nova:swap>0</nova:swap>
Nov 29 20:20:21 user nova-compute[75356]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:20:21 user nova-compute[75356]:     <nova:vcpus>1</nova:vcpus>
Nov 29 20:20:21 user nova-compute[75356]:   </nova:flavor>
Nov 29 20:20:21 user nova-compute[75356]:   <nova:owner>
Nov 29 20:20:21 user nova-compute[75356]:     <nova:user uuid="e5b4a48f9bfd406cae779bfc3dc5e302">tempest-TaggedAttachmentsTest-75465737-project-member</nova:user>
Nov 29 20:20:21 user nova-compute[75356]:     <nova:project uuid="076d6fb1d7e1485f847881bd7fe665f3">tempest-TaggedAttachmentsTest-75465737</nova:project>
Nov 29 20:20:21 user nova-compute[75356]:   </nova:owner>
Nov 29 20:20:21 user nova-compute[75356]:   <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:20:21 user nova-compute[75356]:   <nova:ports>
Nov 29 20:20:21 user nova-compute[75356]:     <nova:port uuid="577e6509-523f-46e2-9994-9d1eb9ff0c13">
Nov 29 20:20:21 user nova-compute[75356]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 20:20:21 user nova-compute[75356]:     </nova:port>
Nov 29 20:20:21 user nova-compute[75356]:     <nova:port uuid="f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4">
Nov 29 20:20:21 user nova-compute[75356]:       <nova:ip type="fixed" address="10.10.10.83" ipVersion="4"/>
Nov 29 20:20:21 user nova-compute[75356]:     </nova:port>
Nov 29 20:20:21 user nova-compute[75356]:   </nova:ports>
Nov 29 20:20:21 user nova-compute[75356]: </nova:instance>
Nov 29 20:20:21 user nova-compute[75356]:   </metadata>
Nov 29 20:20:21 user nova-compute[75356]:   <memory unit='KiB'>524288</memory>
Nov 29 20:20:21 user nova-compute[75356]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 20:20:21 user nova-compute[75356]:   <vcpu placement='static'>1</vcpu>
Nov 29 20:20:21 user nova-compute[75356]:   <resource>
Nov 29 20:20:21 user nova-compute[75356]:     <partition>/machine</partition>
Nov 29 20:20:21 user nova-compute[75356]:   </resource>
Nov 29 20:20:21 user nova-compute[75356]:   <sysinfo type='smbios'>
Nov 29 20:20:21 user nova-compute[75356]:     <system>
Nov 29 20:20:21 user nova-compute[75356]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 20:20:21 user nova-compute[75356]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 20:20:21 user nova-compute[75356]:       <entry name='version'>0.0.0</entry>
Nov 29 20:20:21 user nova-compute[75356]:       <entry name='serial'>3d1a8bb2-82f9-4a3f-aeff-a5472477d651</entry>
Nov 29 20:20:21 user nova-compute[75356]:       <entry name='uuid'>3d1a8bb2-82f9-4a3f-aeff-a5472477d651</entry>
Nov 29 20:20:21 user nova-compute[75356]:       <entry name='family'>Virtual Machine</entry>
Nov 29 20:20:21 user nova-compute[75356]:     </system>
Nov 29 20:20:21 user nova-compute[75356]:   </sysinfo>
Nov 29 20:20:21 user nova-compute[75356]:   <os>
Nov 29 20:20:21 user nova-compute[75356]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 20:20:21 user nova-compute[75356]:     <boot dev='hd'/>
Nov 29 20:20:21 user nova-compute[75356]:     <smbios mode='sysinfo'/>
Nov 29 20:20:21 user nova-compute[75356]:   </os>
Nov 29 20:20:21 user nova-compute[75356]:   <features>
Nov 29 20:20:21 user nova-compute[75356]:     <acpi/>
Nov 29 20:20:21 user nova-compute[75356]:     <apic/>
Nov 29 20:20:21 user nova-compute[75356]:     <vmcoreinfo state='on'/>
Nov 29 20:20:21 user nova-compute[75356]:   </features>
Nov 29 20:20:21 user nova-compute[75356]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 20:20:21 user nova-compute[75356]:     <model fallback='forbid'>Nehalem</model>
Nov 29 20:20:21 user nova-compute[75356]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 20:20:21 user nova-compute[75356]:     <feature policy='require' name='vme'/>
Nov 29 20:20:21 user nova-compute[75356]:     <feature policy='require' name='x2apic'/>
Nov 29 20:20:21 user nova-compute[75356]:     <feature policy='require' name='hypervisor'/>
Nov 29 20:20:21 user nova-compute[75356]:   </cpu>
Nov 29 20:20:21 user nova-compute[75356]:   <clock offset='utc'>
Nov 29 20:20:21 user nova-compute[75356]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 20:20:21 user nova-compute[75356]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 20:20:21 user nova-compute[75356]:     <timer name='hpet' present='no'/>
Nov 29 20:20:21 user nova-compute[75356]:   </clock>
Nov 29 20:20:21 user nova-compute[75356]:   <on_poweroff>destroy</on_poweroff>
Nov 29 20:20:21 user nova-compute[75356]:   <on_reboot>restart</on_reboot>
Nov 29 20:20:21 user nova-compute[75356]:   <on_crash>destroy</on_crash>
Nov 29 20:20:21 user nova-compute[75356]:   <devices>
Nov 29 20:20:21 user nova-compute[75356]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 20:20:21 user nova-compute[75356]:     <disk type='file' device='disk'>
Nov 29 20:20:21 user nova-compute[75356]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 20:20:21 user nova-compute[75356]:       <source file='/opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk' index='2'/>
Nov 29 20:20:21 user nova-compute[75356]:       <backingStore type='file' index='3'>
Nov 29 20:20:21 user nova-compute[75356]:         <format type='raw'/>
Nov 29 20:20:21 user nova-compute[75356]:         <source file='/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9'/>
Nov 29 20:20:21 user nova-compute[75356]:         <backingStore/>
Nov 29 20:20:21 user nova-compute[75356]:       </backingStore>
Nov 29 20:20:21 user nova-compute[75356]:       <target dev='vda' bus='virtio'/>
Nov 29 20:20:21 user nova-compute[75356]:       <alias name='virtio-disk0'/>
Nov 29 20:20:21 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 20:20:21 user nova-compute[75356]:     </disk>
Nov 29 20:20:21 user nova-compute[75356]:     <disk type='file' device='cdrom'>
Nov 29 20:20:21 user nova-compute[75356]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 20:20:21 user nova-compute[75356]:       <source file='/opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk.config' index='1'/>
Nov 29 20:20:21 user nova-compute[75356]:       <backingStore/>
Nov 29 20:20:21 user nova-compute[75356]:       <target dev='hda' bus='ide'/>
Nov 29 20:20:21 user nova-compute[75356]:       <readonly/>
Nov 29 20:20:21 user nova-compute[75356]:       <alias name='ide0-0-0'/>
Nov 29 20:20:21 user nova-compute[75356]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 20:20:21 user nova-compute[75356]:     </disk>
Nov 29 20:20:21 user nova-compute[75356]:     <controller type='usb' index='0' model='none'>
Nov 29 20:20:21 user nova-compute[75356]:       <alias name='usb'/>
Nov 29 20:20:21 user nova-compute[75356]:     </controller>
Nov 29 20:20:21 user nova-compute[75356]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 20:20:21 user nova-compute[75356]:       <alias name='pci.0'/>
Nov 29 20:20:21 user nova-compute[75356]:     </controller>
Nov 29 20:20:21 user nova-compute[75356]:     <controller type='ide' index='0'>
Nov 29 20:20:21 user nova-compute[75356]:       <alias name='ide'/>
Nov 29 20:20:21 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 20:20:21 user nova-compute[75356]:     </controller>
Nov 29 20:20:21 user nova-compute[75356]:     <interface type='ethernet'>
Nov 29 20:20:21 user nova-compute[75356]:       <mac address='fa:16:3e:34:be:70'/>
Nov 29 20:20:21 user nova-compute[75356]:       <target dev='tap577e6509-52'/>
Nov 29 20:20:21 user nova-compute[75356]:       <model type='virtio'/>
Nov 29 20:20:21 user nova-compute[75356]:       <mtu size='1442'/>
Nov 29 20:20:21 user nova-compute[75356]:       <alias name='net0'/>
Nov 29 20:20:21 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 20:20:21 user nova-compute[75356]:     </interface>
Nov 29 20:20:21 user nova-compute[75356]:     <serial type='pty'>
Nov 29 20:20:21 user nova-compute[75356]:       <source path='/dev/pts/6'/>
Nov 29 20:20:21 user nova-compute[75356]:       <log file='/opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/console.log' append='off'/>
Nov 29 20:20:21 user nova-compute[75356]:       <target type='isa-serial' port='0'>
Nov 29 20:20:21 user nova-compute[75356]:         <model name='isa-serial'/>
Nov 29 20:20:21 user nova-compute[75356]:       </target>
Nov 29 20:20:21 user nova-compute[75356]:       <alias name='serial0'/>
Nov 29 20:20:21 user nova-compute[75356]:     </serial>
Nov 29 20:20:21 user nova-compute[75356]:     <console type='pty' tty='/dev/pts/6'>
Nov 29 20:20:21 user nova-compute[75356]:       <source path='/dev/pts/6'/>
Nov 29 20:20:21 user nova-compute[75356]:       <log file='/opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/console.log' append='off'/>
Nov 29 20:20:21 user nova-compute[75356]:       <target type='serial' port='0'/>
Nov 29 20:20:21 user nova-compute[75356]:       <alias name='serial0'/>
Nov 29 20:20:21 user nova-compute[75356]:     </console>
Nov 29 20:20:21 user nova-compute[75356]:     <input type='mouse' bus='ps2'>
Nov 29 20:20:21 user nova-compute[75356]:       <alias name='input0'/>
Nov 29 20:20:21 user nova-compute[75356]:     </input>
Nov 29 20:20:21 user nova-compute[75356]:     <input type='keyboard' bus='ps2'>
Nov 29 20:20:21 user nova-compute[75356]:       <alias name='input1'/>
Nov 29 20:20:21 user nova-compute[75356]:     </input>
Nov 29 20:20:21 user nova-compute[75356]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 29 20:20:21 user nova-compute[75356]:       <listen type='address' address='0.0.0.0'/>
Nov 29 20:20:21 user nova-compute[75356]:     </graphics>
Nov 29 20:20:21 user nova-compute[75356]:     <audio id='1' type='none'/>
Nov 29 20:20:21 user nova-compute[75356]:     <video>
Nov 29 20:20:21 user nova-compute[75356]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 20:20:21 user nova-compute[75356]:       <alias name='video0'/>
Nov 29 20:20:21 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 20:20:21 user nova-compute[75356]:     </video>
Nov 29 20:20:21 user nova-compute[75356]:     <memballoon model='virtio'>
Nov 29 20:20:21 user nova-compute[75356]:       <stats period='10'/>
Nov 29 20:20:21 user nova-compute[75356]:       <alias name='balloon0'/>
Nov 29 20:20:21 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 20:20:21 user nova-compute[75356]:     </memballoon>
Nov 29 20:20:21 user nova-compute[75356]:     <rng model='virtio'>
Nov 29 20:20:21 user nova-compute[75356]:       <backend model='random'>/dev/urandom</backend>
Nov 29 20:20:21 user nova-compute[75356]:       <alias name='rng0'/>
Nov 29 20:20:21 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 20:20:21 user nova-compute[75356]:     </rng>
Nov 29 20:20:21 user nova-compute[75356]:   </devices>
Nov 29 20:20:21 user nova-compute[75356]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 20:20:21 user nova-compute[75356]:     <label>libvirt-3d1a8bb2-82f9-4a3f-aeff-a5472477d651</label>
Nov 29 20:20:21 user nova-compute[75356]:     <imagelabel>libvirt-3d1a8bb2-82f9-4a3f-aeff-a5472477d651</imagelabel>
Nov 29 20:20:21 user nova-compute[75356]:   </seclabel>
Nov 29 20:20:21 user nova-compute[75356]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 20:20:21 user nova-compute[75356]:     <label>+64055:+108</label>
Nov 29 20:20:21 user nova-compute[75356]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 20:20:21 user nova-compute[75356]:   </seclabel>
Nov 29 20:20:21 user nova-compute[75356]: </domain>
Nov 29 20:20:21 user nova-compute[75356]:  {{(pid=75356) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 20:20:21 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Successfully detached device tapf52c2f0a-7f from instance 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 from the live domain config.
Nov 29 20:20:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2087794140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2087794140',id=8,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMcSB5W90J44Qo16Oh0Cpy3jhi4X0540/9A+XafSyfNEzKrqoj4TuajJuNFlGXhbGXb/O9kxaBhSAt46g/kgqUtmOKqWshX+iOmBJWeort/VCkacPfcnj7JuOcU0rQEdQ==',key_name='tempest-keypair-504121784',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:17:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='076d6fb1d7e1485f847881bd7fe665f3',ramdisk_id='',reservation_id='r-8hmccieq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-75465737',owner_user_name='tempest-TaggedAttachmentsTest-75465737-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:17:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5b4a48f9bfd406cae779bfc3dc5e302',uuid=3d1a8bb2-82f9-4a3f-aeff-a5472477d651,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "address": "fa:16:3e:29:9d:4c", "network": {"id": "f2704b81-951a-4297-9c57-421301a5a26d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-239219297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52c2f0a-7f", "ovs_interfaceid": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:20:21 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Converting VIF {"id": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "address": "fa:16:3e:29:9d:4c", "network": {"id": "f2704b81-951a-4297-9c57-421301a5a26d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-239219297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52c2f0a-7f", "ovs_interfaceid": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:20:21 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:9d:4c,bridge_name='br-int',has_traffic_filtering=True,id=f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4,network=Network(f2704b81-951a-4297-9c57-421301a5a26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52c2f0a-7f') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:20:21 user nova-compute[75356]: DEBUG os_vif [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:9d:4c,bridge_name='br-int',has_traffic_filtering=True,id=f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4,network=Network(f2704b81-951a-4297-9c57-421301a5a26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52c2f0a-7f') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:20:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf52c2f0a-7f, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8b6e908-d873-4d62-8db8-7b92437b65be) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:21 user nova-compute[75356]: INFO os_vif [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:9d:4c,bridge_name='br-int',has_traffic_filtering=True,id=f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4,network=Network(f2704b81-951a-4297-9c57-421301a5a26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52c2f0a-7f')
Nov 29 20:20:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:20:21 user nova-compute[75356]:   <nova:package version="0.0.0"/>
Nov 29 20:20:21 user nova-compute[75356]:   <nova:name>tempest-device-tagging-server-2087794140</nova:name>
Nov 29 20:20:21 user nova-compute[75356]:   <nova:creationTime>2023-11-29 20:20:21</nova:creationTime>
Nov 29 20:20:21 user nova-compute[75356]:   <nova:flavor name="m1.tiny">
Nov 29 20:20:21 user nova-compute[75356]:     <nova:memory>512</nova:memory>
Nov 29 20:20:21 user nova-compute[75356]:     <nova:disk>1</nova:disk>
Nov 29 20:20:21 user nova-compute[75356]:     <nova:swap>0</nova:swap>
Nov 29 20:20:21 user nova-compute[75356]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:20:21 user nova-compute[75356]:     <nova:vcpus>1</nova:vcpus>
Nov 29 20:20:21 user nova-compute[75356]:   </nova:flavor>
Nov 29 20:20:21 user nova-compute[75356]:   <nova:owner>
Nov 29 20:20:21 user nova-compute[75356]:     <nova:user uuid="e5b4a48f9bfd406cae779bfc3dc5e302">tempest-TaggedAttachmentsTest-75465737-project-member</nova:user>
Nov 29 20:20:21 user nova-compute[75356]:     <nova:project uuid="076d6fb1d7e1485f847881bd7fe665f3">tempest-TaggedAttachmentsTest-75465737</nova:project>
Nov 29 20:20:21 user nova-compute[75356]:   </nova:owner>
Nov 29 20:20:21 user nova-compute[75356]:   <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:20:21 user nova-compute[75356]:   <nova:ports>
Nov 29 20:20:21 user nova-compute[75356]:     <nova:port uuid="577e6509-523f-46e2-9994-9d1eb9ff0c13">
Nov 29 20:20:21 user nova-compute[75356]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 20:20:21 user nova-compute[75356]:     </nova:port>
Nov 29 20:20:21 user nova-compute[75356]:   </nova:ports>
Nov 29 20:20:21 user nova-compute[75356]: </nova:instance>
Nov 29 20:20:21 user nova-compute[75356]:  {{(pid=75356) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 20:20:22 user nova-compute[75356]: DEBUG nova.compute.manager [req-e68fd9d9-f841-4775-a648-2023ab60e0f1 req-8efd6d09-d8b8-45ad-92b6-71847171509d service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Received event network-vif-deleted-f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:22 user nova-compute[75356]: INFO nova.compute.manager [req-e68fd9d9-f841-4775-a648-2023ab60e0f1 req-8efd6d09-d8b8-45ad-92b6-71847171509d service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Neutron deleted interface f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4; detaching it from the instance and deleting it from the info cache
Nov 29 20:20:22 user nova-compute[75356]: DEBUG nova.network.neutron [req-e68fd9d9-f841-4775-a648-2023ab60e0f1 req-8efd6d09-d8b8-45ad-92b6-71847171509d service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Updating instance_info_cache with network_info: [{"id": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "address": "fa:16:3e:34:be:70", "network": {"id": "fe921eef-0c3b-459b-b302-b879394d578b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-572349767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577e6509-52", "ovs_interfaceid": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:20:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Acquiring lock "refresh_cache-3d1a8bb2-82f9-4a3f-aeff-a5472477d651" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:20:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Acquired lock "refresh_cache-3d1a8bb2-82f9-4a3f-aeff-a5472477d651" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:20:22 user nova-compute[75356]: DEBUG nova.network.neutron [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:20:22 user nova-compute[75356]: DEBUG nova.objects.instance [req-e68fd9d9-f841-4775-a648-2023ab60e0f1 req-8efd6d09-d8b8-45ad-92b6-71847171509d service nova] Lazy-loading 'system_metadata' on Instance uuid 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:20:22 user nova-compute[75356]: DEBUG nova.objects.instance [req-e68fd9d9-f841-4775-a648-2023ab60e0f1 req-8efd6d09-d8b8-45ad-92b6-71847171509d service nova] Lazy-loading 'flavor' on Instance uuid 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:20:22 user nova-compute[75356]: DEBUG nova.objects.base [req-e68fd9d9-f841-4775-a648-2023ab60e0f1 req-8efd6d09-d8b8-45ad-92b6-71847171509d service nova] Object Instance<3d1a8bb2-82f9-4a3f-aeff-a5472477d651> lazy-loaded attributes: system_metadata,flavor {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:20:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [req-e68fd9d9-f841-4775-a648-2023ab60e0f1 req-8efd6d09-d8b8-45ad-92b6-71847171509d service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2087794140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2087794140',id=8,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMcSB5W90J44Qo16Oh0Cpy3jhi4X0540/9A+XafSyfNEzKrqoj4TuajJuNFlGXhbGXb/O9kxaBhSAt46g/kgqUtmOKqWshX+iOmBJWeort/VCkacPfcnj7JuOcU0rQEdQ==',key_name='tempest-keypair-504121784',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:17:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='076d6fb1d7e1485f847881bd7fe665f3',ramdisk_id='',reservation_id='r-8hmccieq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-75465737',owner_user_name='tempest-TaggedAttachmentsTest-75465737-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:17:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5b4a48f9bfd406cae779bfc3dc5e302',uuid=3d1a8bb2-82f9-4a3f-aeff-a5472477d651,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "address": "fa:16:3e:29:9d:4c", "network": {"id": "f2704b81-951a-4297-9c57-421301a5a26d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-239219297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52c2f0a-7f", "ovs_interfaceid": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:20:22 user nova-compute[75356]: DEBUG nova.network.os_vif_util [req-e68fd9d9-f841-4775-a648-2023ab60e0f1 req-8efd6d09-d8b8-45ad-92b6-71847171509d service nova] Converting VIF {"id": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "address": "fa:16:3e:29:9d:4c", "network": {"id": "f2704b81-951a-4297-9c57-421301a5a26d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-239219297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52c2f0a-7f", "ovs_interfaceid": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:20:22 user nova-compute[75356]: DEBUG nova.network.os_vif_util [req-e68fd9d9-f841-4775-a648-2023ab60e0f1 req-8efd6d09-d8b8-45ad-92b6-71847171509d service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:9d:4c,bridge_name='br-int',has_traffic_filtering=True,id=f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4,network=Network(f2704b81-951a-4297-9c57-421301a5a26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52c2f0a-7f') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:20:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [req-e68fd9d9-f841-4775-a648-2023ab60e0f1 req-8efd6d09-d8b8-45ad-92b6-71847171509d service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:29:9d:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tapf52c2f0a-7f"/></interface> {{(pid=75356) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 20:20:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [req-e68fd9d9-f841-4775-a648-2023ab60e0f1 req-8efd6d09-d8b8-45ad-92b6-71847171509d service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:29:9d:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tapf52c2f0a-7f"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 29 20:20:22 user nova-compute[75356]:   <name>instance-00000008</name>
Nov 29 20:20:22 user nova-compute[75356]:   <uuid>3d1a8bb2-82f9-4a3f-aeff-a5472477d651</uuid>
Nov 29 20:20:22 user nova-compute[75356]:   <metadata>
Nov 29 20:20:22 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:20:22 user nova-compute[75356]:   <nova:package version="0.0.0"/>
Nov 29 20:20:22 user nova-compute[75356]:   <nova:name>tempest-device-tagging-server-2087794140</nova:name>
Nov 29 20:20:22 user nova-compute[75356]:   <nova:creationTime>2023-11-29 20:20:21</nova:creationTime>
Nov 29 20:20:22 user nova-compute[75356]:   <nova:flavor name="m1.tiny">
Nov 29 20:20:22 user nova-compute[75356]:     <nova:memory>512</nova:memory>
Nov 29 20:20:22 user nova-compute[75356]:     <nova:disk>1</nova:disk>
Nov 29 20:20:22 user nova-compute[75356]:     <nova:swap>0</nova:swap>
Nov 29 20:20:22 user nova-compute[75356]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:20:22 user nova-compute[75356]:     <nova:vcpus>1</nova:vcpus>
Nov 29 20:20:22 user nova-compute[75356]:   </nova:flavor>
Nov 29 20:20:22 user nova-compute[75356]:   <nova:owner>
Nov 29 20:20:22 user nova-compute[75356]:     <nova:user uuid="e5b4a48f9bfd406cae779bfc3dc5e302">tempest-TaggedAttachmentsTest-75465737-project-member</nova:user>
Nov 29 20:20:22 user nova-compute[75356]:     <nova:project uuid="076d6fb1d7e1485f847881bd7fe665f3">tempest-TaggedAttachmentsTest-75465737</nova:project>
Nov 29 20:20:22 user nova-compute[75356]:   </nova:owner>
Nov 29 20:20:22 user nova-compute[75356]:   <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:20:22 user nova-compute[75356]:   <nova:ports>
Nov 29 20:20:22 user nova-compute[75356]:     <nova:port uuid="577e6509-523f-46e2-9994-9d1eb9ff0c13">
Nov 29 20:20:22 user nova-compute[75356]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 20:20:22 user nova-compute[75356]:     </nova:port>
Nov 29 20:20:22 user nova-compute[75356]:   </nova:ports>
Nov 29 20:20:22 user nova-compute[75356]: </nova:instance>
Nov 29 20:20:22 user nova-compute[75356]:   </metadata>
Nov 29 20:20:22 user nova-compute[75356]:   <memory unit='KiB'>524288</memory>
Nov 29 20:20:22 user nova-compute[75356]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 20:20:22 user nova-compute[75356]:   <vcpu placement='static'>1</vcpu>
Nov 29 20:20:22 user nova-compute[75356]:   <resource>
Nov 29 20:20:22 user nova-compute[75356]:     <partition>/machine</partition>
Nov 29 20:20:22 user nova-compute[75356]:   </resource>
Nov 29 20:20:22 user nova-compute[75356]:   <sysinfo type='smbios'>
Nov 29 20:20:22 user nova-compute[75356]:     <system>
Nov 29 20:20:22 user nova-compute[75356]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 20:20:22 user nova-compute[75356]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 20:20:22 user nova-compute[75356]:       <entry name='version'>0.0.0</entry>
Nov 29 20:20:22 user nova-compute[75356]:       <entry name='serial'>3d1a8bb2-82f9-4a3f-aeff-a5472477d651</entry>
Nov 29 20:20:22 user nova-compute[75356]:       <entry name='uuid'>3d1a8bb2-82f9-4a3f-aeff-a5472477d651</entry>
Nov 29 20:20:22 user nova-compute[75356]:       <entry name='family'>Virtual Machine</entry>
Nov 29 20:20:22 user nova-compute[75356]:     </system>
Nov 29 20:20:22 user nova-compute[75356]:   </sysinfo>
Nov 29 20:20:22 user nova-compute[75356]:   <os>
Nov 29 20:20:22 user nova-compute[75356]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 20:20:22 user nova-compute[75356]:     <boot dev='hd'/>
Nov 29 20:20:22 user nova-compute[75356]:     <smbios mode='sysinfo'/>
Nov 29 20:20:22 user nova-compute[75356]:   </os>
Nov 29 20:20:22 user nova-compute[75356]:   <features>
Nov 29 20:20:22 user nova-compute[75356]:     <acpi/>
Nov 29 20:20:22 user nova-compute[75356]:     <apic/>
Nov 29 20:20:22 user nova-compute[75356]:     <vmcoreinfo state='on'/>
Nov 29 20:20:22 user nova-compute[75356]:   </features>
Nov 29 20:20:22 user nova-compute[75356]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 20:20:22 user nova-compute[75356]:     <model fallback='forbid'>Nehalem</model>
Nov 29 20:20:22 user nova-compute[75356]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 20:20:22 user nova-compute[75356]:     <feature policy='require' name='vme'/>
Nov 29 20:20:22 user nova-compute[75356]:     <feature policy='require' name='x2apic'/>
Nov 29 20:20:22 user nova-compute[75356]:     <feature policy='require' name='hypervisor'/>
Nov 29 20:20:22 user nova-compute[75356]:   </cpu>
Nov 29 20:20:22 user nova-compute[75356]:   <clock offset='utc'>
Nov 29 20:20:22 user nova-compute[75356]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 20:20:22 user nova-compute[75356]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 20:20:22 user nova-compute[75356]:     <timer name='hpet' present='no'/>
Nov 29 20:20:22 user nova-compute[75356]:   </clock>
Nov 29 20:20:22 user nova-compute[75356]:   <on_poweroff>destroy</on_poweroff>
Nov 29 20:20:22 user nova-compute[75356]:   <on_reboot>restart</on_reboot>
Nov 29 20:20:22 user nova-compute[75356]:   <on_crash>destroy</on_crash>
Nov 29 20:20:22 user nova-compute[75356]:   <devices>
Nov 29 20:20:22 user nova-compute[75356]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 20:20:22 user nova-compute[75356]:     <disk type='file' device='disk'>
Nov 29 20:20:22 user nova-compute[75356]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 20:20:22 user nova-compute[75356]:       <source file='/opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk' index='2'/>
Nov 29 20:20:22 user nova-compute[75356]:       <backingStore type='file' index='3'>
Nov 29 20:20:22 user nova-compute[75356]:         <format type='raw'/>
Nov 29 20:20:22 user nova-compute[75356]:         <source file='/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9'/>
Nov 29 20:20:22 user nova-compute[75356]:         <backingStore/>
Nov 29 20:20:22 user nova-compute[75356]:       </backingStore>
Nov 29 20:20:22 user nova-compute[75356]:       <target dev='vda' bus='virtio'/>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='virtio-disk0'/>
Nov 29 20:20:22 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 20:20:22 user nova-compute[75356]:     </disk>
Nov 29 20:20:22 user nova-compute[75356]:     <disk type='file' device='cdrom'>
Nov 29 20:20:22 user nova-compute[75356]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 20:20:22 user nova-compute[75356]:       <source file='/opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk.config' index='1'/>
Nov 29 20:20:22 user nova-compute[75356]:       <backingStore/>
Nov 29 20:20:22 user nova-compute[75356]:       <target dev='hda' bus='ide'/>
Nov 29 20:20:22 user nova-compute[75356]:       <readonly/>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='ide0-0-0'/>
Nov 29 20:20:22 user nova-compute[75356]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 20:20:22 user nova-compute[75356]:     </disk>
Nov 29 20:20:22 user nova-compute[75356]:     <controller type='usb' index='0' model='none'>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='usb'/>
Nov 29 20:20:22 user nova-compute[75356]:     </controller>
Nov 29 20:20:22 user nova-compute[75356]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='pci.0'/>
Nov 29 20:20:22 user nova-compute[75356]:     </controller>
Nov 29 20:20:22 user nova-compute[75356]:     <controller type='ide' index='0'>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='ide'/>
Nov 29 20:20:22 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 20:20:22 user nova-compute[75356]:     </controller>
Nov 29 20:20:22 user nova-compute[75356]:     <interface type='ethernet'>
Nov 29 20:20:22 user nova-compute[75356]:       <mac address='fa:16:3e:34:be:70'/>
Nov 29 20:20:22 user nova-compute[75356]:       <target dev='tap577e6509-52'/>
Nov 29 20:20:22 user nova-compute[75356]:       <model type='virtio'/>
Nov 29 20:20:22 user nova-compute[75356]:       <mtu size='1442'/>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='net0'/>
Nov 29 20:20:22 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 20:20:22 user nova-compute[75356]:     </interface>
Nov 29 20:20:22 user nova-compute[75356]:     <serial type='pty'>
Nov 29 20:20:22 user nova-compute[75356]:       <source path='/dev/pts/6'/>
Nov 29 20:20:22 user nova-compute[75356]:       <log file='/opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/console.log' append='off'/>
Nov 29 20:20:22 user nova-compute[75356]:       <target type='isa-serial' port='0'>
Nov 29 20:20:22 user nova-compute[75356]:         <model name='isa-serial'/>
Nov 29 20:20:22 user nova-compute[75356]:       </target>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='serial0'/>
Nov 29 20:20:22 user nova-compute[75356]:     </serial>
Nov 29 20:20:22 user nova-compute[75356]:     <console type='pty' tty='/dev/pts/6'>
Nov 29 20:20:22 user nova-compute[75356]:       <source path='/dev/pts/6'/>
Nov 29 20:20:22 user nova-compute[75356]:       <log file='/opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/console.log' append='off'/>
Nov 29 20:20:22 user nova-compute[75356]:       <target type='serial' port='0'/>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='serial0'/>
Nov 29 20:20:22 user nova-compute[75356]:     </console>
Nov 29 20:20:22 user nova-compute[75356]:     <input type='mouse' bus='ps2'>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='input0'/>
Nov 29 20:20:22 user nova-compute[75356]:     </input>
Nov 29 20:20:22 user nova-compute[75356]:     <input type='keyboard' bus='ps2'>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='input1'/>
Nov 29 20:20:22 user nova-compute[75356]:     </input>
Nov 29 20:20:22 user nova-compute[75356]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 29 20:20:22 user nova-compute[75356]:       <listen type='address' address='0.0.0.0'/>
Nov 29 20:20:22 user nova-compute[75356]:     </graphics>
Nov 29 20:20:22 user nova-compute[75356]:     <audio id='1' type='none'/>
Nov 29 20:20:22 user nova-compute[75356]:     <video>
Nov 29 20:20:22 user nova-compute[75356]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='video0'/>
Nov 29 20:20:22 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 20:20:22 user nova-compute[75356]:     </video>
Nov 29 20:20:22 user nova-compute[75356]:     <memballoon model='virtio'>
Nov 29 20:20:22 user nova-compute[75356]:       <stats period='10'/>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='balloon0'/>
Nov 29 20:20:22 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 20:20:22 user nova-compute[75356]:     </memballoon>
Nov 29 20:20:22 user nova-compute[75356]:     <rng model='virtio'>
Nov 29 20:20:22 user nova-compute[75356]:       <backend model='random'>/dev/urandom</backend>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='rng0'/>
Nov 29 20:20:22 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 20:20:22 user nova-compute[75356]:     </rng>
Nov 29 20:20:22 user nova-compute[75356]:   </devices>
Nov 29 20:20:22 user nova-compute[75356]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 20:20:22 user nova-compute[75356]:     <label>libvirt-3d1a8bb2-82f9-4a3f-aeff-a5472477d651</label>
Nov 29 20:20:22 user nova-compute[75356]:     <imagelabel>libvirt-3d1a8bb2-82f9-4a3f-aeff-a5472477d651</imagelabel>
Nov 29 20:20:22 user nova-compute[75356]:   </seclabel>
Nov 29 20:20:22 user nova-compute[75356]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 20:20:22 user nova-compute[75356]:     <label>+64055:+108</label>
Nov 29 20:20:22 user nova-compute[75356]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 20:20:22 user nova-compute[75356]:   </seclabel>
Nov 29 20:20:22 user nova-compute[75356]: </domain>
Nov 29 20:20:22 user nova-compute[75356]:  {{(pid=75356) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 20:20:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [req-e68fd9d9-f841-4775-a648-2023ab60e0f1 req-8efd6d09-d8b8-45ad-92b6-71847171509d service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:29:9d:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tapf52c2f0a-7f"/></interface> {{(pid=75356) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 20:20:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [req-e68fd9d9-f841-4775-a648-2023ab60e0f1 req-8efd6d09-d8b8-45ad-92b6-71847171509d service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:29:9d:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tapf52c2f0a-7f"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 29 20:20:22 user nova-compute[75356]:   <name>instance-00000008</name>
Nov 29 20:20:22 user nova-compute[75356]:   <uuid>3d1a8bb2-82f9-4a3f-aeff-a5472477d651</uuid>
Nov 29 20:20:22 user nova-compute[75356]:   <metadata>
Nov 29 20:20:22 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:20:22 user nova-compute[75356]:   <nova:package version="0.0.0"/>
Nov 29 20:20:22 user nova-compute[75356]:   <nova:name>tempest-device-tagging-server-2087794140</nova:name>
Nov 29 20:20:22 user nova-compute[75356]:   <nova:creationTime>2023-11-29 20:20:21</nova:creationTime>
Nov 29 20:20:22 user nova-compute[75356]:   <nova:flavor name="m1.tiny">
Nov 29 20:20:22 user nova-compute[75356]:     <nova:memory>512</nova:memory>
Nov 29 20:20:22 user nova-compute[75356]:     <nova:disk>1</nova:disk>
Nov 29 20:20:22 user nova-compute[75356]:     <nova:swap>0</nova:swap>
Nov 29 20:20:22 user nova-compute[75356]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:20:22 user nova-compute[75356]:     <nova:vcpus>1</nova:vcpus>
Nov 29 20:20:22 user nova-compute[75356]:   </nova:flavor>
Nov 29 20:20:22 user nova-compute[75356]:   <nova:owner>
Nov 29 20:20:22 user nova-compute[75356]:     <nova:user uuid="e5b4a48f9bfd406cae779bfc3dc5e302">tempest-TaggedAttachmentsTest-75465737-project-member</nova:user>
Nov 29 20:20:22 user nova-compute[75356]:     <nova:project uuid="076d6fb1d7e1485f847881bd7fe665f3">tempest-TaggedAttachmentsTest-75465737</nova:project>
Nov 29 20:20:22 user nova-compute[75356]:   </nova:owner>
Nov 29 20:20:22 user nova-compute[75356]:   <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:20:22 user nova-compute[75356]:   <nova:ports>
Nov 29 20:20:22 user nova-compute[75356]:     <nova:port uuid="577e6509-523f-46e2-9994-9d1eb9ff0c13">
Nov 29 20:20:22 user nova-compute[75356]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 20:20:22 user nova-compute[75356]:     </nova:port>
Nov 29 20:20:22 user nova-compute[75356]:   </nova:ports>
Nov 29 20:20:22 user nova-compute[75356]: </nova:instance>
Nov 29 20:20:22 user nova-compute[75356]:   </metadata>
Nov 29 20:20:22 user nova-compute[75356]:   <memory unit='KiB'>524288</memory>
Nov 29 20:20:22 user nova-compute[75356]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 20:20:22 user nova-compute[75356]:   <vcpu placement='static'>1</vcpu>
Nov 29 20:20:22 user nova-compute[75356]:   <resource>
Nov 29 20:20:22 user nova-compute[75356]:     <partition>/machine</partition>
Nov 29 20:20:22 user nova-compute[75356]:   </resource>
Nov 29 20:20:22 user nova-compute[75356]:   <sysinfo type='smbios'>
Nov 29 20:20:22 user nova-compute[75356]:     <system>
Nov 29 20:20:22 user nova-compute[75356]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 20:20:22 user nova-compute[75356]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 20:20:22 user nova-compute[75356]:       <entry name='version'>0.0.0</entry>
Nov 29 20:20:22 user nova-compute[75356]:       <entry name='serial'>3d1a8bb2-82f9-4a3f-aeff-a5472477d651</entry>
Nov 29 20:20:22 user nova-compute[75356]:       <entry name='uuid'>3d1a8bb2-82f9-4a3f-aeff-a5472477d651</entry>
Nov 29 20:20:22 user nova-compute[75356]:       <entry name='family'>Virtual Machine</entry>
Nov 29 20:20:22 user nova-compute[75356]:     </system>
Nov 29 20:20:22 user nova-compute[75356]:   </sysinfo>
Nov 29 20:20:22 user nova-compute[75356]:   <os>
Nov 29 20:20:22 user nova-compute[75356]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 20:20:22 user nova-compute[75356]:     <boot dev='hd'/>
Nov 29 20:20:22 user nova-compute[75356]:     <smbios mode='sysinfo'/>
Nov 29 20:20:22 user nova-compute[75356]:   </os>
Nov 29 20:20:22 user nova-compute[75356]:   <features>
Nov 29 20:20:22 user nova-compute[75356]:     <acpi/>
Nov 29 20:20:22 user nova-compute[75356]:     <apic/>
Nov 29 20:20:22 user nova-compute[75356]:     <vmcoreinfo state='on'/>
Nov 29 20:20:22 user nova-compute[75356]:   </features>
Nov 29 20:20:22 user nova-compute[75356]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 20:20:22 user nova-compute[75356]:     <model fallback='forbid'>Nehalem</model>
Nov 29 20:20:22 user nova-compute[75356]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 20:20:22 user nova-compute[75356]:     <feature policy='require' name='vme'/>
Nov 29 20:20:22 user nova-compute[75356]:     <feature policy='require' name='x2apic'/>
Nov 29 20:20:22 user nova-compute[75356]:     <feature policy='require' name='hypervisor'/>
Nov 29 20:20:22 user nova-compute[75356]:   </cpu>
Nov 29 20:20:22 user nova-compute[75356]:   <clock offset='utc'>
Nov 29 20:20:22 user nova-compute[75356]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 20:20:22 user nova-compute[75356]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 20:20:22 user nova-compute[75356]:     <timer name='hpet' present='no'/>
Nov 29 20:20:22 user nova-compute[75356]:   </clock>
Nov 29 20:20:22 user nova-compute[75356]:   <on_poweroff>destroy</on_poweroff>
Nov 29 20:20:22 user nova-compute[75356]:   <on_reboot>restart</on_reboot>
Nov 29 20:20:22 user nova-compute[75356]:   <on_crash>destroy</on_crash>
Nov 29 20:20:22 user nova-compute[75356]:   <devices>
Nov 29 20:20:22 user nova-compute[75356]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 20:20:22 user nova-compute[75356]:     <disk type='file' device='disk'>
Nov 29 20:20:22 user nova-compute[75356]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 20:20:22 user nova-compute[75356]:       <source file='/opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk' index='2'/>
Nov 29 20:20:22 user nova-compute[75356]:       <backingStore type='file' index='3'>
Nov 29 20:20:22 user nova-compute[75356]:         <format type='raw'/>
Nov 29 20:20:22 user nova-compute[75356]:         <source file='/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9'/>
Nov 29 20:20:22 user nova-compute[75356]:         <backingStore/>
Nov 29 20:20:22 user nova-compute[75356]:       </backingStore>
Nov 29 20:20:22 user nova-compute[75356]:       <target dev='vda' bus='virtio'/>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='virtio-disk0'/>
Nov 29 20:20:22 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 20:20:22 user nova-compute[75356]:     </disk>
Nov 29 20:20:22 user nova-compute[75356]:     <disk type='file' device='cdrom'>
Nov 29 20:20:22 user nova-compute[75356]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 20:20:22 user nova-compute[75356]:       <source file='/opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk.config' index='1'/>
Nov 29 20:20:22 user nova-compute[75356]:       <backingStore/>
Nov 29 20:20:22 user nova-compute[75356]:       <target dev='hda' bus='ide'/>
Nov 29 20:20:22 user nova-compute[75356]:       <readonly/>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='ide0-0-0'/>
Nov 29 20:20:22 user nova-compute[75356]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 20:20:22 user nova-compute[75356]:     </disk>
Nov 29 20:20:22 user nova-compute[75356]:     <controller type='usb' index='0' model='none'>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='usb'/>
Nov 29 20:20:22 user nova-compute[75356]:     </controller>
Nov 29 20:20:22 user nova-compute[75356]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='pci.0'/>
Nov 29 20:20:22 user nova-compute[75356]:     </controller>
Nov 29 20:20:22 user nova-compute[75356]:     <controller type='ide' index='0'>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='ide'/>
Nov 29 20:20:22 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 20:20:22 user nova-compute[75356]:     </controller>
Nov 29 20:20:22 user nova-compute[75356]:     <interface type='ethernet'>
Nov 29 20:20:22 user nova-compute[75356]:       <mac address='fa:16:3e:34:be:70'/>
Nov 29 20:20:22 user nova-compute[75356]:       <target dev='tap577e6509-52'/>
Nov 29 20:20:22 user nova-compute[75356]:       <model type='virtio'/>
Nov 29 20:20:22 user nova-compute[75356]:       <mtu size='1442'/>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='net0'/>
Nov 29 20:20:22 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 20:20:22 user nova-compute[75356]:     </interface>
Nov 29 20:20:22 user nova-compute[75356]:     <serial type='pty'>
Nov 29 20:20:22 user nova-compute[75356]:       <source path='/dev/pts/6'/>
Nov 29 20:20:22 user nova-compute[75356]:       <log file='/opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/console.log' append='off'/>
Nov 29 20:20:22 user nova-compute[75356]:       <target type='isa-serial' port='0'>
Nov 29 20:20:22 user nova-compute[75356]:         <model name='isa-serial'/>
Nov 29 20:20:22 user nova-compute[75356]:       </target>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='serial0'/>
Nov 29 20:20:22 user nova-compute[75356]:     </serial>
Nov 29 20:20:22 user nova-compute[75356]:     <console type='pty' tty='/dev/pts/6'>
Nov 29 20:20:22 user nova-compute[75356]:       <source path='/dev/pts/6'/>
Nov 29 20:20:22 user nova-compute[75356]:       <log file='/opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/console.log' append='off'/>
Nov 29 20:20:22 user nova-compute[75356]:       <target type='serial' port='0'/>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='serial0'/>
Nov 29 20:20:22 user nova-compute[75356]:     </console>
Nov 29 20:20:22 user nova-compute[75356]:     <input type='mouse' bus='ps2'>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='input0'/>
Nov 29 20:20:22 user nova-compute[75356]:     </input>
Nov 29 20:20:22 user nova-compute[75356]:     <input type='keyboard' bus='ps2'>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='input1'/>
Nov 29 20:20:22 user nova-compute[75356]:     </input>
Nov 29 20:20:22 user nova-compute[75356]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 29 20:20:22 user nova-compute[75356]:       <listen type='address' address='0.0.0.0'/>
Nov 29 20:20:22 user nova-compute[75356]:     </graphics>
Nov 29 20:20:22 user nova-compute[75356]:     <audio id='1' type='none'/>
Nov 29 20:20:22 user nova-compute[75356]:     <video>
Nov 29 20:20:22 user nova-compute[75356]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='video0'/>
Nov 29 20:20:22 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 20:20:22 user nova-compute[75356]:     </video>
Nov 29 20:20:22 user nova-compute[75356]:     <memballoon model='virtio'>
Nov 29 20:20:22 user nova-compute[75356]:       <stats period='10'/>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='balloon0'/>
Nov 29 20:20:22 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 20:20:22 user nova-compute[75356]:     </memballoon>
Nov 29 20:20:22 user nova-compute[75356]:     <rng model='virtio'>
Nov 29 20:20:22 user nova-compute[75356]:       <backend model='random'>/dev/urandom</backend>
Nov 29 20:20:22 user nova-compute[75356]:       <alias name='rng0'/>
Nov 29 20:20:22 user nova-compute[75356]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 20:20:22 user nova-compute[75356]:     </rng>
Nov 29 20:20:22 user nova-compute[75356]:   </devices>
Nov 29 20:20:22 user nova-compute[75356]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 20:20:22 user nova-compute[75356]:     <label>libvirt-3d1a8bb2-82f9-4a3f-aeff-a5472477d651</label>
Nov 29 20:20:22 user nova-compute[75356]:     <imagelabel>libvirt-3d1a8bb2-82f9-4a3f-aeff-a5472477d651</imagelabel>
Nov 29 20:20:22 user nova-compute[75356]:   </seclabel>
Nov 29 20:20:22 user nova-compute[75356]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 20:20:22 user nova-compute[75356]:     <label>+64055:+108</label>
Nov 29 20:20:22 user nova-compute[75356]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 20:20:22 user nova-compute[75356]:   </seclabel>
Nov 29 20:20:22 user nova-compute[75356]: </domain>
Nov 29 20:20:22 user nova-compute[75356]:  {{(pid=75356) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 20:20:22 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [req-e68fd9d9-f841-4775-a648-2023ab60e0f1 req-8efd6d09-d8b8-45ad-92b6-71847171509d service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Detaching interface fa:16:3e:29:9d:4c failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapf52c2f0a-7f' not found.
Nov 29 20:20:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [req-e68fd9d9-f841-4775-a648-2023ab60e0f1 req-8efd6d09-d8b8-45ad-92b6-71847171509d service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2087794140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2087794140',id=8,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMcSB5W90J44Qo16Oh0Cpy3jhi4X0540/9A+XafSyfNEzKrqoj4TuajJuNFlGXhbGXb/O9kxaBhSAt46g/kgqUtmOKqWshX+iOmBJWeort/VCkacPfcnj7JuOcU0rQEdQ==',key_name='tempest-keypair-504121784',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:17:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='076d6fb1d7e1485f847881bd7fe665f3',ramdisk_id='',reservation_id='r-8hmccieq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-75465737',owner_user_name='tempest-TaggedAttachmentsTest-75465737-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:17:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5b4a48f9bfd406cae779bfc3dc5e302',uuid=3d1a8bb2-82f9-4a3f-aeff-a5472477d651,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "address": "fa:16:3e:29:9d:4c", "network": {"id": "f2704b81-951a-4297-9c57-421301a5a26d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-239219297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52c2f0a-7f", "ovs_interfaceid": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:20:22 user nova-compute[75356]: DEBUG nova.network.os_vif_util [req-e68fd9d9-f841-4775-a648-2023ab60e0f1 req-8efd6d09-d8b8-45ad-92b6-71847171509d service nova] Converting VIF {"id": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "address": "fa:16:3e:29:9d:4c", "network": {"id": "f2704b81-951a-4297-9c57-421301a5a26d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-239219297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf52c2f0a-7f", "ovs_interfaceid": "f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:20:22 user nova-compute[75356]: DEBUG nova.network.os_vif_util [req-e68fd9d9-f841-4775-a648-2023ab60e0f1 req-8efd6d09-d8b8-45ad-92b6-71847171509d service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:9d:4c,bridge_name='br-int',has_traffic_filtering=True,id=f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4,network=Network(f2704b81-951a-4297-9c57-421301a5a26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52c2f0a-7f') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:20:22 user nova-compute[75356]: DEBUG os_vif [req-e68fd9d9-f841-4775-a648-2023ab60e0f1 req-8efd6d09-d8b8-45ad-92b6-71847171509d service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:9d:4c,bridge_name='br-int',has_traffic_filtering=True,id=f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4,network=Network(f2704b81-951a-4297-9c57-421301a5a26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52c2f0a-7f') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:20:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf52c2f0a-7f, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:20:22 user nova-compute[75356]: INFO os_vif [req-e68fd9d9-f841-4775-a648-2023ab60e0f1 req-8efd6d09-d8b8-45ad-92b6-71847171509d service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:9d:4c,bridge_name='br-int',has_traffic_filtering=True,id=f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4,network=Network(f2704b81-951a-4297-9c57-421301a5a26d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf52c2f0a-7f')
Nov 29 20:20:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [req-e68fd9d9-f841-4775-a648-2023ab60e0f1 req-8efd6d09-d8b8-45ad-92b6-71847171509d service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:20:22 user nova-compute[75356]:   <nova:package version="0.0.0"/>
Nov 29 20:20:22 user nova-compute[75356]:   <nova:name>tempest-device-tagging-server-2087794140</nova:name>
Nov 29 20:20:22 user nova-compute[75356]:   <nova:creationTime>2023-11-29 20:20:22</nova:creationTime>
Nov 29 20:20:22 user nova-compute[75356]:   <nova:flavor name="m1.tiny">
Nov 29 20:20:22 user nova-compute[75356]:     <nova:memory>512</nova:memory>
Nov 29 20:20:22 user nova-compute[75356]:     <nova:disk>1</nova:disk>
Nov 29 20:20:22 user nova-compute[75356]:     <nova:swap>0</nova:swap>
Nov 29 20:20:22 user nova-compute[75356]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:20:22 user nova-compute[75356]:     <nova:vcpus>1</nova:vcpus>
Nov 29 20:20:22 user nova-compute[75356]:   </nova:flavor>
Nov 29 20:20:22 user nova-compute[75356]:   <nova:owner>
Nov 29 20:20:22 user nova-compute[75356]:     <nova:user uuid="e5b4a48f9bfd406cae779bfc3dc5e302">tempest-TaggedAttachmentsTest-75465737-project-member</nova:user>
Nov 29 20:20:22 user nova-compute[75356]:     <nova:project uuid="076d6fb1d7e1485f847881bd7fe665f3">tempest-TaggedAttachmentsTest-75465737</nova:project>
Nov 29 20:20:22 user nova-compute[75356]:   </nova:owner>
Nov 29 20:20:22 user nova-compute[75356]:   <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:20:22 user nova-compute[75356]:   <nova:ports>
Nov 29 20:20:22 user nova-compute[75356]:     <nova:port uuid="577e6509-523f-46e2-9994-9d1eb9ff0c13">
Nov 29 20:20:22 user nova-compute[75356]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 20:20:22 user nova-compute[75356]:     </nova:port>
Nov 29 20:20:22 user nova-compute[75356]:   </nova:ports>
Nov 29 20:20:22 user nova-compute[75356]: </nova:instance>
Nov 29 20:20:22 user nova-compute[75356]:  {{(pid=75356) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 20:20:23 user nova-compute[75356]: DEBUG nova.network.neutron [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Updating instance_info_cache with network_info: [{"id": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "address": "fa:16:3e:34:be:70", "network": {"id": "fe921eef-0c3b-459b-b302-b879394d578b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-572349767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577e6509-52", "ovs_interfaceid": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:20:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Releasing lock "refresh_cache-3d1a8bb2-82f9-4a3f-aeff-a5472477d651" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:20:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7b410169-f73a-4352-8369-39b07d1ebb10 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "interface-3d1a8bb2-82f9-4a3f-aeff-a5472477d651-f52c2f0a-7f09-4cc1-819e-46ce6f10b7a4" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.591s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "68f3a04c-4259-4ead-9fd2-65d4651fee4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "68f3a04c-4259-4ead-9fd2-65d4651fee4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:23 user nova-compute[75356]: DEBUG nova.compute.manager [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:20:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:23 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:20:23 user nova-compute[75356]: INFO nova.compute.claims [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Claim successful on node user
Nov 29 20:20:23 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:20:23 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:20:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:23 user nova-compute[75356]: DEBUG nova.compute.manager [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:20:24 user nova-compute[75356]: DEBUG nova.compute.manager [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:20:24 user nova-compute[75356]: DEBUG nova.network.neutron [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:20:24 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:20:24 user nova-compute[75356]: DEBUG nova.compute.manager [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:20:24 user nova-compute[75356]: DEBUG nova.policy [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91cd534885224b259429518c575b82e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e9eb99ca1b4dddb0075e78847b980b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:20:24 user nova-compute[75356]: DEBUG nova.compute.manager [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:20:24 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:20:24 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Creating image(s)
Nov 29 20:20:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "/opt/stack/data/nova/instances/68f3a04c-4259-4ead-9fd2-65d4651fee4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "/opt/stack/data/nova/instances/68f3a04c-4259-4ead-9fd2-65d4651fee4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "/opt/stack/data/nova/instances/68f3a04c-4259-4ead-9fd2-65d4651fee4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.184s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:24 user nova-compute[75356]: DEBUG nova.network.neutron [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Successfully created port: 0f1cd6cc-489d-47c0-a112-119d74b216d9 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:20:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.204s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/68f3a04c-4259-4ead-9fd2-65d4651fee4b/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/68f3a04c-4259-4ead-9fd2-65d4651fee4b/disk 1073741824" returned: 0 in 0.047s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.174s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:24 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68f3a04c-4259-4ead-9fd2-65d4651fee4b/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:20:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f3a04c-4259-4ead-9fd2-65d4651fee4b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f3a04c-4259-4ead-9fd2-65d4651fee4b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Cannot resize image /opt/stack/data/nova/instances/68f3a04c-4259-4ead-9fd2-65d4651fee4b/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Ensure instance console log exists: /opt/stack/data/nova/instances/68f3a04c-4259-4ead-9fd2-65d4651fee4b/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.network.neutron [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Successfully updated port: 0f1cd6cc-489d-47c0-a112-119d74b216d9 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "refresh_cache-68f3a04c-4259-4ead-9fd2-65d4651fee4b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquired lock "refresh_cache-68f3a04c-4259-4ead-9fd2-65d4651fee4b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.network.neutron [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-927d8339-049c-4370-a675-a7af1cee0600 req-334fffac-556b-4b7e-9b41-394fcec818e3 service nova] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Received event network-changed-0f1cd6cc-489d-47c0-a112-119d74b216d9 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-927d8339-049c-4370-a675-a7af1cee0600 req-334fffac-556b-4b7e-9b41-394fcec818e3 service nova] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Refreshing instance network info cache due to event network-changed-0f1cd6cc-489d-47c0-a112-119d74b216d9. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-927d8339-049c-4370-a675-a7af1cee0600 req-334fffac-556b-4b7e-9b41-394fcec818e3 service nova] Acquiring lock "refresh_cache-68f3a04c-4259-4ead-9fd2-65d4651fee4b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.network.neutron [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.network.neutron [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Updating instance_info_cache with network_info: [{"id": "0f1cd6cc-489d-47c0-a112-119d74b216d9", "address": "fa:16:3e:3a:83:bd", "network": {"id": "4e1439ac-1b43-4407-997e-6ac5b6a0066f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2125172073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2e9eb99ca1b4dddb0075e78847b980b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1cd6cc-48", "ovs_interfaceid": "0f1cd6cc-489d-47c0-a112-119d74b216d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Releasing lock "refresh_cache-68f3a04c-4259-4ead-9fd2-65d4651fee4b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.compute.manager [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Instance network_info: |[{"id": "0f1cd6cc-489d-47c0-a112-119d74b216d9", "address": "fa:16:3e:3a:83:bd", "network": {"id": "4e1439ac-1b43-4407-997e-6ac5b6a0066f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2125172073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2e9eb99ca1b4dddb0075e78847b980b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1cd6cc-48", "ovs_interfaceid": "0f1cd6cc-489d-47c0-a112-119d74b216d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-927d8339-049c-4370-a675-a7af1cee0600 req-334fffac-556b-4b7e-9b41-394fcec818e3 service nova] Acquired lock "refresh_cache-68f3a04c-4259-4ead-9fd2-65d4651fee4b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.network.neutron [req-927d8339-049c-4370-a675-a7af1cee0600 req-334fffac-556b-4b7e-9b41-394fcec818e3 service nova] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Refreshing network info cache for port 0f1cd6cc-489d-47c0-a112-119d74b216d9 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Start _get_guest_xml network_info=[{"id": "0f1cd6cc-489d-47c0-a112-119d74b216d9", "address": "fa:16:3e:3a:83:bd", "network": {"id": "4e1439ac-1b43-4407-997e-6ac5b6a0066f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2125172073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2e9eb99ca1b4dddb0075e78847b980b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1cd6cc-48", "ovs_interfaceid": "0f1cd6cc-489d-47c0-a112-119d74b216d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:20:25 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:20:25 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:20:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1691522379',display_name='tempest-VolumesAdminNegativeTest-server-1691522379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1691522379',id=14,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2e9eb99ca1b4dddb0075e78847b980b',ramdisk_id='',reservation_id='r-5i65o6yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1603071749',owner_user_name='tempest-VolumesAdminNegativeTest-1603071749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:20:24Z,user_data=None,user_id='91cd534885224b259429518c575b82e7',uuid=68f3a04c-4259-4ead-9fd2-65d4651fee4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f1cd6cc-489d-47c0-a112-119d74b216d9", "address": "fa:16:3e:3a:83:bd", "network": {"id": "4e1439ac-1b43-4407-997e-6ac5b6a0066f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2125172073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2e9eb99ca1b4dddb0075e78847b980b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1cd6cc-48", "ovs_interfaceid": "0f1cd6cc-489d-47c0-a112-119d74b216d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Converting VIF {"id": "0f1cd6cc-489d-47c0-a112-119d74b216d9", "address": "fa:16:3e:3a:83:bd", "network": {"id": "4e1439ac-1b43-4407-997e-6ac5b6a0066f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2125172073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2e9eb99ca1b4dddb0075e78847b980b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1cd6cc-48", "ovs_interfaceid": "0f1cd6cc-489d-47c0-a112-119d74b216d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:83:bd,bridge_name='br-int',has_traffic_filtering=True,id=0f1cd6cc-489d-47c0-a112-119d74b216d9,network=Network(4e1439ac-1b43-4407-997e-6ac5b6a0066f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f1cd6cc-48') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.objects.instance [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lazy-loading 'pci_devices' on Instance uuid 68f3a04c-4259-4ead-9fd2-65d4651fee4b {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:20:25 user nova-compute[75356]:   <uuid>68f3a04c-4259-4ead-9fd2-65d4651fee4b</uuid>
Nov 29 20:20:25 user nova-compute[75356]:   <name>instance-0000000e</name>
Nov 29 20:20:25 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:20:25 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:20:25 user nova-compute[75356]:   <metadata>
Nov 29 20:20:25 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:20:25 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:20:25 user nova-compute[75356]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1691522379</nova:name>
Nov 29 20:20:25 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:20:25</nova:creationTime>
Nov 29 20:20:25 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:20:25 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:20:25 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:20:25 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:20:25 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:20:25 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:20:25 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:20:25 user nova-compute[75356]:       <nova:owner>
Nov 29 20:20:25 user nova-compute[75356]:         <nova:user uuid="91cd534885224b259429518c575b82e7">tempest-VolumesAdminNegativeTest-1603071749-project-member</nova:user>
Nov 29 20:20:25 user nova-compute[75356]:         <nova:project uuid="f2e9eb99ca1b4dddb0075e78847b980b">tempest-VolumesAdminNegativeTest-1603071749</nova:project>
Nov 29 20:20:25 user nova-compute[75356]:       </nova:owner>
Nov 29 20:20:25 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:20:25 user nova-compute[75356]:       <nova:ports>
Nov 29 20:20:25 user nova-compute[75356]:         <nova:port uuid="0f1cd6cc-489d-47c0-a112-119d74b216d9">
Nov 29 20:20:25 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 20:20:25 user nova-compute[75356]:         </nova:port>
Nov 29 20:20:25 user nova-compute[75356]:       </nova:ports>
Nov 29 20:20:25 user nova-compute[75356]:     </nova:instance>
Nov 29 20:20:25 user nova-compute[75356]:   </metadata>
Nov 29 20:20:25 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:20:25 user nova-compute[75356]:     <system>
Nov 29 20:20:25 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:20:25 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:20:25 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:20:25 user nova-compute[75356]:       <entry name="serial">68f3a04c-4259-4ead-9fd2-65d4651fee4b</entry>
Nov 29 20:20:25 user nova-compute[75356]:       <entry name="uuid">68f3a04c-4259-4ead-9fd2-65d4651fee4b</entry>
Nov 29 20:20:25 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:20:25 user nova-compute[75356]:     </system>
Nov 29 20:20:25 user nova-compute[75356]:   </sysinfo>
Nov 29 20:20:25 user nova-compute[75356]:   <os>
Nov 29 20:20:25 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:20:25 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:20:25 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:20:25 user nova-compute[75356]:   </os>
Nov 29 20:20:25 user nova-compute[75356]:   <features>
Nov 29 20:20:25 user nova-compute[75356]:     <acpi/>
Nov 29 20:20:25 user nova-compute[75356]:     <apic/>
Nov 29 20:20:25 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:20:25 user nova-compute[75356]:   </features>
Nov 29 20:20:25 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:20:25 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:20:25 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:20:25 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:20:25 user nova-compute[75356]:   </clock>
Nov 29 20:20:25 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:20:25 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:20:25 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:20:25 user nova-compute[75356]:   </cpu>
Nov 29 20:20:25 user nova-compute[75356]:   <devices>
Nov 29 20:20:25 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:20:25 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:20:25 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/68f3a04c-4259-4ead-9fd2-65d4651fee4b/disk"/>
Nov 29 20:20:25 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:20:25 user nova-compute[75356]:     </disk>
Nov 29 20:20:25 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:20:25 user nova-compute[75356]:       <mac address="fa:16:3e:3a:83:bd"/>
Nov 29 20:20:25 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:20:25 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:20:25 user nova-compute[75356]:       <target dev="tap0f1cd6cc-48"/>
Nov 29 20:20:25 user nova-compute[75356]:     </interface>
Nov 29 20:20:25 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:20:25 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/68f3a04c-4259-4ead-9fd2-65d4651fee4b/console.log" append="off"/>
Nov 29 20:20:25 user nova-compute[75356]:     </serial>
Nov 29 20:20:25 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:20:25 user nova-compute[75356]:     <video>
Nov 29 20:20:25 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:20:25 user nova-compute[75356]:     </video>
Nov 29 20:20:25 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:20:25 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:20:25 user nova-compute[75356]:     </rng>
Nov 29 20:20:25 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:20:25 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:20:25 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:20:25 user nova-compute[75356]:     </memballoon>
Nov 29 20:20:25 user nova-compute[75356]:   </devices>
Nov 29 20:20:25 user nova-compute[75356]: </domain>
Nov 29 20:20:25 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:20:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1691522379',display_name='tempest-VolumesAdminNegativeTest-server-1691522379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1691522379',id=14,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2e9eb99ca1b4dddb0075e78847b980b',ramdisk_id='',reservation_id='r-5i65o6yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1603071749',owner_user_name='tempest-VolumesAdminNegativeTest-1603071749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:20:24Z,user_data=None,user_id='91cd534885224b259429518c575b82e7',uuid=68f3a04c-4259-4ead-9fd2-65d4651fee4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f1cd6cc-489d-47c0-a112-119d74b216d9", "address": "fa:16:3e:3a:83:bd", "network": {"id": "4e1439ac-1b43-4407-997e-6ac5b6a0066f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2125172073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2e9eb99ca1b4dddb0075e78847b980b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1cd6cc-48", "ovs_interfaceid": "0f1cd6cc-489d-47c0-a112-119d74b216d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Converting VIF {"id": "0f1cd6cc-489d-47c0-a112-119d74b216d9", "address": "fa:16:3e:3a:83:bd", "network": {"id": "4e1439ac-1b43-4407-997e-6ac5b6a0066f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2125172073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2e9eb99ca1b4dddb0075e78847b980b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1cd6cc-48", "ovs_interfaceid": "0f1cd6cc-489d-47c0-a112-119d74b216d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:83:bd,bridge_name='br-int',has_traffic_filtering=True,id=0f1cd6cc-489d-47c0-a112-119d74b216d9,network=Network(4e1439ac-1b43-4407-997e-6ac5b6a0066f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f1cd6cc-48') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG os_vif [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:83:bd,bridge_name='br-int',has_traffic_filtering=True,id=0f1cd6cc-489d-47c0-a112-119d74b216d9,network=Network(4e1439ac-1b43-4407-997e-6ac5b6a0066f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f1cd6cc-48') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8eb226a8-edd8-523b-9d29-5efe0f389f5d', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f1cd6cc-48, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f1cd6cc-48, col_values=(('qos', UUID('5c895b5a-b6d6-4f8c-b5f7-4a376b7e711e')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f1cd6cc-48, col_values=(('external_ids', {'iface-id': '0f1cd6cc-489d-47c0-a112-119d74b216d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:83:bd', 'vm-uuid': '68f3a04c-4259-4ead-9fd2-65d4651fee4b'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:25 user nova-compute[75356]: INFO os_vif [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:83:bd,bridge_name='br-int',has_traffic_filtering=True,id=0f1cd6cc-489d-47c0-a112-119d74b216d9,network=Network(4e1439ac-1b43-4407-997e-6ac5b6a0066f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f1cd6cc-48')
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] No VIF found with MAC fa:16:3e:3a:83:bd, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.network.neutron [req-927d8339-049c-4370-a675-a7af1cee0600 req-334fffac-556b-4b7e-9b41-394fcec818e3 service nova] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Updated VIF entry in instance network info cache for port 0f1cd6cc-489d-47c0-a112-119d74b216d9. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG nova.network.neutron [req-927d8339-049c-4370-a675-a7af1cee0600 req-334fffac-556b-4b7e-9b41-394fcec818e3 service nova] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Updating instance_info_cache with network_info: [{"id": "0f1cd6cc-489d-47c0-a112-119d74b216d9", "address": "fa:16:3e:3a:83:bd", "network": {"id": "4e1439ac-1b43-4407-997e-6ac5b6a0066f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2125172073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2e9eb99ca1b4dddb0075e78847b980b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1cd6cc-48", "ovs_interfaceid": "0f1cd6cc-489d-47c0-a112-119d74b216d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:20:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-927d8339-049c-4370-a675-a7af1cee0600 req-334fffac-556b-4b7e-9b41-394fcec818e3 service nova] Releasing lock "refresh_cache-68f3a04c-4259-4ead-9fd2-65d4651fee4b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:20:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-22f88acd-84e1-4f7f-be49-c69a3df67257 req-284babfd-d844-48da-a50f-9b905eba94e0 service nova] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Received event network-vif-plugged-0f1cd6cc-489d-47c0-a112-119d74b216d9 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-22f88acd-84e1-4f7f-be49-c69a3df67257 req-284babfd-d844-48da-a50f-9b905eba94e0 service nova] Acquiring lock "68f3a04c-4259-4ead-9fd2-65d4651fee4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-22f88acd-84e1-4f7f-be49-c69a3df67257 req-284babfd-d844-48da-a50f-9b905eba94e0 service nova] Lock "68f3a04c-4259-4ead-9fd2-65d4651fee4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-22f88acd-84e1-4f7f-be49-c69a3df67257 req-284babfd-d844-48da-a50f-9b905eba94e0 service nova] Lock "68f3a04c-4259-4ead-9fd2-65d4651fee4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-22f88acd-84e1-4f7f-be49-c69a3df67257 req-284babfd-d844-48da-a50f-9b905eba94e0 service nova] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] No waiting events found dispatching network-vif-plugged-0f1cd6cc-489d-47c0-a112-119d74b216d9 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:20:27 user nova-compute[75356]: WARNING nova.compute.manager [req-22f88acd-84e1-4f7f-be49-c69a3df67257 req-284babfd-d844-48da-a50f-9b905eba94e0 service nova] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Received unexpected event network-vif-plugged-0f1cd6cc-489d-47c0-a112-119d74b216d9 for instance with vm_state building and task_state spawning.
Nov 29 20:20:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:29 user nova-compute[75356]: DEBUG nova.compute.manager [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:20:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:20:29 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Instance spawned successfully.
Nov 29 20:20:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:20:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:20:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:20:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:20:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:20:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:20:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:20:29 user nova-compute[75356]: INFO nova.compute.manager [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 29 20:20:29 user nova-compute[75356]: DEBUG nova.compute.manager [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:20:29 user nova-compute[75356]: DEBUG nova.compute.manager [req-debf712f-5b0a-478f-89c9-9fc1a696b7a8 req-6aea747b-24ed-4434-85c7-0e97ff16c079 service nova] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Received event network-vif-plugged-0f1cd6cc-489d-47c0-a112-119d74b216d9 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-debf712f-5b0a-478f-89c9-9fc1a696b7a8 req-6aea747b-24ed-4434-85c7-0e97ff16c079 service nova] Acquiring lock "68f3a04c-4259-4ead-9fd2-65d4651fee4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-debf712f-5b0a-478f-89c9-9fc1a696b7a8 req-6aea747b-24ed-4434-85c7-0e97ff16c079 service nova] Lock "68f3a04c-4259-4ead-9fd2-65d4651fee4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-debf712f-5b0a-478f-89c9-9fc1a696b7a8 req-6aea747b-24ed-4434-85c7-0e97ff16c079 service nova] Lock "68f3a04c-4259-4ead-9fd2-65d4651fee4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:29 user nova-compute[75356]: DEBUG nova.compute.manager [req-debf712f-5b0a-478f-89c9-9fc1a696b7a8 req-6aea747b-24ed-4434-85c7-0e97ff16c079 service nova] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] No waiting events found dispatching network-vif-plugged-0f1cd6cc-489d-47c0-a112-119d74b216d9 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:20:29 user nova-compute[75356]: WARNING nova.compute.manager [req-debf712f-5b0a-478f-89c9-9fc1a696b7a8 req-6aea747b-24ed-4434-85c7-0e97ff16c079 service nova] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Received unexpected event network-vif-plugged-0f1cd6cc-489d-47c0-a112-119d74b216d9 for instance with vm_state building and task_state spawning.
Nov 29 20:20:29 user nova-compute[75356]: INFO nova.compute.manager [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Took 5.98 seconds to build instance.
Nov 29 20:20:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-40214c20-abd0-4c25-9b7f-ca733d6a0954 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "68f3a04c-4259-4ead-9fd2-65d4651fee4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.078s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:30 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fb7280bd-7153-4868-b1c9-35cc77e96277 is timed out.
Nov 29 20:20:30 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Successfully detached device vdb from instance fb7280bd-7153-4868-b1c9-35cc77e96277 from the live domain config.
Nov 29 20:20:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixCdmtaE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'd655d5aa-afbe-448d-9068-36b17ef93b78'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:20:30 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:20:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[047bae2d-d4ac-4831-8c57-c1706208faf5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:20:30 user nova-compute[75356]: No targets found.
Nov 29 20:20:30 user nova-compute[75356]: iSNS:
Nov 29 20:20:30 user nova-compute[75356]: No targets found.
Nov 29 20:20:30 user nova-compute[75356]: STATIC:
Nov 29 20:20:30 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78
Nov 29 20:20:30 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:20:30 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:20:30 user nova-compute[75356]: FIRMWARE:
Nov 29 20:20:30 user nova-compute[75356]: No targets found.
Nov 29 20:20:30 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:20:30 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:20:30 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc419efa-a5ca-44a5-ba9b-a70566ce08bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63ccf61-a769-47e2-9bab-915c976c3864]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:20:30 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 (non-flash)
Nov 29 20:20:30 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f83082c6a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78'): ({'sde'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Removing single pathed devices sde {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a442a5-def7-44e6-a217-af87db0d5b90]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f809ca92-f4e7-4060-ac84-7afcceec0e99]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Flushing IO for device /dev/sde {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bc711f-566b-4fa6-9230-4e4afcdfcb8d]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11800c8-b96e-40e8-9153-173d8b353bf6]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] SCSI volumes sde have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4be351f-1377-40d6-b0a6-0b708c1c858f]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f524a0cd-1d11-4404-9515-646e1d3be409]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78, portal: 172.16.0.220,3260]
Nov 29 20:20:30 user nova-compute[75356]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78, portal: 172.16.0.220,3260] successful.
Nov 29 20:20:30 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d655d5aa-afbe-448d-9068-36b17ef93b78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacf0d52-89d4-4d46-81b5-948e78c10dd3]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] <== disconnect_volume: return (326ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:20:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:31 user nova-compute[75356]: DEBUG nova.objects.instance [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lazy-loading 'flavor' on Instance uuid fb7280bd-7153-4868-b1c9-35cc77e96277 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:20:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6b10bfce-accc-4ac1-850c-5b7fd9b85ab9 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.763s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Acquiring lock "f09171b0-1615-49ee-8c66-8b9c4f0af591" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Lock "f09171b0-1615-49ee-8c66-8b9c4f0af591" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Acquiring lock "f09171b0-1615-49ee-8c66-8b9c4f0af591-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Lock "f09171b0-1615-49ee-8c66-8b9c4f0af591-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Lock "f09171b0-1615-49ee-8c66-8b9c4f0af591-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:39 user nova-compute[75356]: INFO nova.compute.manager [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Terminating instance
Nov 29 20:20:39 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:20:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:39 user nova-compute[75356]: DEBUG nova.compute.manager [req-07a0e3ad-5dc7-4fb5-8648-d141a33d50d6 req-9de57bf3-985d-4c5f-8f82-6586e87e28db service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Received event network-vif-unplugged-924ed0c8-9079-4837-b3bb-4ec2e2c6e359 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-07a0e3ad-5dc7-4fb5-8648-d141a33d50d6 req-9de57bf3-985d-4c5f-8f82-6586e87e28db service nova] Acquiring lock "f09171b0-1615-49ee-8c66-8b9c4f0af591-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-07a0e3ad-5dc7-4fb5-8648-d141a33d50d6 req-9de57bf3-985d-4c5f-8f82-6586e87e28db service nova] Lock "f09171b0-1615-49ee-8c66-8b9c4f0af591-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-07a0e3ad-5dc7-4fb5-8648-d141a33d50d6 req-9de57bf3-985d-4c5f-8f82-6586e87e28db service nova] Lock "f09171b0-1615-49ee-8c66-8b9c4f0af591-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:39 user nova-compute[75356]: DEBUG nova.compute.manager [req-07a0e3ad-5dc7-4fb5-8648-d141a33d50d6 req-9de57bf3-985d-4c5f-8f82-6586e87e28db service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] No waiting events found dispatching network-vif-unplugged-924ed0c8-9079-4837-b3bb-4ec2e2c6e359 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:20:39 user nova-compute[75356]: DEBUG nova.compute.manager [req-07a0e3ad-5dc7-4fb5-8648-d141a33d50d6 req-9de57bf3-985d-4c5f-8f82-6586e87e28db service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Received event network-vif-unplugged-924ed0c8-9079-4837-b3bb-4ec2e2c6e359 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:20:40 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Instance destroyed successfully.
Nov 29 20:20:40 user nova-compute[75356]: DEBUG nova.objects.instance [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Lazy-loading 'resources' on Instance uuid f09171b0-1615-49ee-8c66-8b9c4f0af591 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:20:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-329021864',display_name='tempest-VolumesAssistedSnapshotsTest-server-329021864',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-329021864',id=10,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpuZoeGEW+qKdJdr8AkjZHp5veDLJA3Za8BVlHjlGgrjB2ViXm3QRdZwInTpguMp9iZPBYrpjupk0MVMrxMqg57xO2s2KYEVmANOF/1iGyA3qw8cy8dzeQ/4M/uPIuJyw==',key_name='tempest-keypair-766467664',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:17:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8de78788d21744bcb173947de904ed69',ramdisk_id='',reservation_id='r-4y5zse10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-423101085',owner_user_name='tempest-VolumesAssistedSnapshotsTest-423101085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:17:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1e3ea854abf4278936b6fdf1d517761',uuid=f09171b0-1615-49ee-8c66-8b9c4f0af591,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "924ed0c8-9079-4837-b3bb-4ec2e2c6e359", "address": "fa:16:3e:bb:ea:02", "network": {"id": "945008af-d620-4459-95c8-9aa9515d0718", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1884938817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de78788d21744bcb173947de904ed69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924ed0c8-90", "ovs_interfaceid": "924ed0c8-9079-4837-b3bb-4ec2e2c6e359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:20:40 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Converting VIF {"id": "924ed0c8-9079-4837-b3bb-4ec2e2c6e359", "address": "fa:16:3e:bb:ea:02", "network": {"id": "945008af-d620-4459-95c8-9aa9515d0718", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1884938817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8de78788d21744bcb173947de904ed69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap924ed0c8-90", "ovs_interfaceid": "924ed0c8-9079-4837-b3bb-4ec2e2c6e359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:20:40 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:ea:02,bridge_name='br-int',has_traffic_filtering=True,id=924ed0c8-9079-4837-b3bb-4ec2e2c6e359,network=Network(945008af-d620-4459-95c8-9aa9515d0718),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924ed0c8-90') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:20:40 user nova-compute[75356]: DEBUG os_vif [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:ea:02,bridge_name='br-int',has_traffic_filtering=True,id=924ed0c8-9079-4837-b3bb-4ec2e2c6e359,network=Network(945008af-d620-4459-95c8-9aa9515d0718),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924ed0c8-90') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:20:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap924ed0c8-90, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=742c8aba-a828-4069-b8b5-8106d30ccda0) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:40 user nova-compute[75356]: INFO os_vif [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:ea:02,bridge_name='br-int',has_traffic_filtering=True,id=924ed0c8-9079-4837-b3bb-4ec2e2c6e359,network=Network(945008af-d620-4459-95c8-9aa9515d0718),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap924ed0c8-90')
Nov 29 20:20:40 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Deleting instance files /opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591_del
Nov 29 20:20:40 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Deletion of /opt/stack/data/nova/instances/f09171b0-1615-49ee-8c66-8b9c4f0af591_del complete
Nov 29 20:20:40 user nova-compute[75356]: INFO nova.compute.manager [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 20:20:40 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:20:40 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:20:40 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:20:41 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:20:41 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Took 0.84 seconds to deallocate network for instance.
Nov 29 20:20:41 user nova-compute[75356]: DEBUG nova.compute.manager [req-d80c8b13-fd55-40f4-97e0-30c19a78abf0 req-4eceba57-e980-422b-bc7b-1516ee43bd54 service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Received event network-vif-deleted-924ed0c8-9079-4837-b3bb-4ec2e2c6e359 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:41 user nova-compute[75356]: INFO nova.compute.manager [req-d80c8b13-fd55-40f4-97e0-30c19a78abf0 req-4eceba57-e980-422b-bc7b-1516ee43bd54 service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Neutron deleted interface 924ed0c8-9079-4837-b3bb-4ec2e2c6e359; detaching it from the instance and deleting it from the info cache
Nov 29 20:20:41 user nova-compute[75356]: DEBUG nova.network.neutron [req-d80c8b13-fd55-40f4-97e0-30c19a78abf0 req-4eceba57-e980-422b-bc7b-1516ee43bd54 service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:20:41 user nova-compute[75356]: DEBUG nova.compute.manager [req-d80c8b13-fd55-40f4-97e0-30c19a78abf0 req-4eceba57-e980-422b-bc7b-1516ee43bd54 service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Detach interface failed, port_id=924ed0c8-9079-4837-b3bb-4ec2e2c6e359, reason: Instance f09171b0-1615-49ee-8c66-8b9c4f0af591 could not be found. {{(pid=75356) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 20:20:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:41 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:20:41 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:20:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.513s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:41 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Deleted allocations for instance f09171b0-1615-49ee-8c66-8b9c4f0af591
Nov 29 20:20:41 user nova-compute[75356]: DEBUG nova.compute.manager [req-4011f451-3440-4f9c-b126-0f99b8dc22d2 req-07115cc6-48a1-4b2b-9211-d4505cc86299 service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Received event network-vif-plugged-924ed0c8-9079-4837-b3bb-4ec2e2c6e359 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4011f451-3440-4f9c-b126-0f99b8dc22d2 req-07115cc6-48a1-4b2b-9211-d4505cc86299 service nova] Acquiring lock "f09171b0-1615-49ee-8c66-8b9c4f0af591-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4011f451-3440-4f9c-b126-0f99b8dc22d2 req-07115cc6-48a1-4b2b-9211-d4505cc86299 service nova] Lock "f09171b0-1615-49ee-8c66-8b9c4f0af591-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4011f451-3440-4f9c-b126-0f99b8dc22d2 req-07115cc6-48a1-4b2b-9211-d4505cc86299 service nova] Lock "f09171b0-1615-49ee-8c66-8b9c4f0af591-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:41 user nova-compute[75356]: DEBUG nova.compute.manager [req-4011f451-3440-4f9c-b126-0f99b8dc22d2 req-07115cc6-48a1-4b2b-9211-d4505cc86299 service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] No waiting events found dispatching network-vif-plugged-924ed0c8-9079-4837-b3bb-4ec2e2c6e359 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:20:41 user nova-compute[75356]: WARNING nova.compute.manager [req-4011f451-3440-4f9c-b126-0f99b8dc22d2 req-07115cc6-48a1-4b2b-9211-d4505cc86299 service nova] [instance: f09171b0-1615-49ee-8c66-8b9c4f0af591] Received unexpected event network-vif-plugged-924ed0c8-9079-4837-b3bb-4ec2e2c6e359 for instance with vm_state deleted and task_state None.
Nov 29 20:20:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ca77a1c6-30c4-46b9-b378-f5b97ce52bb9 tempest-VolumesAssistedSnapshotsTest-423101085 tempest-VolumesAssistedSnapshotsTest-423101085-project-member] Lock "f09171b0-1615-49ee-8c66-8b9c4f0af591" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.500s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Acquiring lock "d8864353-ba84-4d79-a316-46a185729caa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "d8864353-ba84-4d79-a316-46a185729caa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Acquiring lock "d8864353-ba84-4d79-a316-46a185729caa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "d8864353-ba84-4d79-a316-46a185729caa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "d8864353-ba84-4d79-a316-46a185729caa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:42 user nova-compute[75356]: INFO nova.compute.manager [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Terminating instance
Nov 29 20:20:42 user nova-compute[75356]: DEBUG nova.compute.manager [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:20:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:43 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: d8864353-ba84-4d79-a316-46a185729caa] Instance destroyed successfully.
Nov 29 20:20:43 user nova-compute[75356]: DEBUG nova.objects.instance [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lazy-loading 'resources' on Instance uuid d8864353-ba84-4d79-a316-46a185729caa {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:18:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-171947667',display_name='tempest-ServersNegativeTestJSON-server-171947667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-171947667',id=13,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:18:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f191c68eb9041d289e04d64dc71ddb8',ramdisk_id='',reservation_id='r-82cq7a1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-851047228',owner_user_name='tempest-ServersNegativeTestJSON-851047228-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:18:59Z,user_data=None,user_id='9e7fb9cda998444b912de256b9efa7e8',uuid=d8864353-ba84-4d79-a316-46a185729caa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74095f60-9801-4b07-98bf-33541cf69058", "address": "fa:16:3e:78:1a:e8", "network": {"id": "ee89a769-4a94-475b-b835-e49cabad1f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407371162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f191c68eb9041d289e04d64dc71ddb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74095f60-98", "ovs_interfaceid": "74095f60-9801-4b07-98bf-33541cf69058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Converting VIF {"id": "74095f60-9801-4b07-98bf-33541cf69058", "address": "fa:16:3e:78:1a:e8", "network": {"id": "ee89a769-4a94-475b-b835-e49cabad1f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407371162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f191c68eb9041d289e04d64dc71ddb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74095f60-98", "ovs_interfaceid": "74095f60-9801-4b07-98bf-33541cf69058", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:1a:e8,bridge_name='br-int',has_traffic_filtering=True,id=74095f60-9801-4b07-98bf-33541cf69058,network=Network(ee89a769-4a94-475b-b835-e49cabad1f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74095f60-98') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG os_vif [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:1a:e8,bridge_name='br-int',has_traffic_filtering=True,id=74095f60-9801-4b07-98bf-33541cf69058,network=Network(ee89a769-4a94-475b-b835-e49cabad1f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74095f60-98') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74095f60-98, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee719fe6-263b-4da6-8899-a2de8dcf2170) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:43 user nova-compute[75356]: INFO os_vif [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:1a:e8,bridge_name='br-int',has_traffic_filtering=True,id=74095f60-9801-4b07-98bf-33541cf69058,network=Network(ee89a769-4a94-475b-b835-e49cabad1f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74095f60-98')
Nov 29 20:20:43 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Deleting instance files /opt/stack/data/nova/instances/d8864353-ba84-4d79-a316-46a185729caa_del
Nov 29 20:20:43 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Deletion of /opt/stack/data/nova/instances/d8864353-ba84-4d79-a316-46a185729caa_del complete
Nov 29 20:20:43 user nova-compute[75356]: INFO nova.compute.manager [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: d8864353-ba84-4d79-a316-46a185729caa] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 29 20:20:43 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: d8864353-ba84-4d79-a316-46a185729caa] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: d8864353-ba84-4d79-a316-46a185729caa] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-61b30056-9550-46dd-8455-18d15bc441ad req-ed58715a-1375-4c3a-b145-f9984127b483 service nova] [instance: d8864353-ba84-4d79-a316-46a185729caa] Received event network-vif-unplugged-74095f60-9801-4b07-98bf-33541cf69058 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-61b30056-9550-46dd-8455-18d15bc441ad req-ed58715a-1375-4c3a-b145-f9984127b483 service nova] Acquiring lock "d8864353-ba84-4d79-a316-46a185729caa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-61b30056-9550-46dd-8455-18d15bc441ad req-ed58715a-1375-4c3a-b145-f9984127b483 service nova] Lock "d8864353-ba84-4d79-a316-46a185729caa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-61b30056-9550-46dd-8455-18d15bc441ad req-ed58715a-1375-4c3a-b145-f9984127b483 service nova] Lock "d8864353-ba84-4d79-a316-46a185729caa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-61b30056-9550-46dd-8455-18d15bc441ad req-ed58715a-1375-4c3a-b145-f9984127b483 service nova] [instance: d8864353-ba84-4d79-a316-46a185729caa] No waiting events found dispatching network-vif-unplugged-74095f60-9801-4b07-98bf-33541cf69058 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-61b30056-9550-46dd-8455-18d15bc441ad req-ed58715a-1375-4c3a-b145-f9984127b483 service nova] [instance: d8864353-ba84-4d79-a316-46a185729caa] Received event network-vif-unplugged-74095f60-9801-4b07-98bf-33541cf69058 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-61b30056-9550-46dd-8455-18d15bc441ad req-ed58715a-1375-4c3a-b145-f9984127b483 service nova] [instance: d8864353-ba84-4d79-a316-46a185729caa] Received event network-vif-plugged-74095f60-9801-4b07-98bf-33541cf69058 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-61b30056-9550-46dd-8455-18d15bc441ad req-ed58715a-1375-4c3a-b145-f9984127b483 service nova] Acquiring lock "d8864353-ba84-4d79-a316-46a185729caa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-61b30056-9550-46dd-8455-18d15bc441ad req-ed58715a-1375-4c3a-b145-f9984127b483 service nova] Lock "d8864353-ba84-4d79-a316-46a185729caa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-61b30056-9550-46dd-8455-18d15bc441ad req-ed58715a-1375-4c3a-b145-f9984127b483 service nova] Lock "d8864353-ba84-4d79-a316-46a185729caa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-61b30056-9550-46dd-8455-18d15bc441ad req-ed58715a-1375-4c3a-b145-f9984127b483 service nova] [instance: d8864353-ba84-4d79-a316-46a185729caa] No waiting events found dispatching network-vif-plugged-74095f60-9801-4b07-98bf-33541cf69058 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:20:43 user nova-compute[75356]: WARNING nova.compute.manager [req-61b30056-9550-46dd-8455-18d15bc441ad req-ed58715a-1375-4c3a-b145-f9984127b483 service nova] [instance: d8864353-ba84-4d79-a316-46a185729caa] Received unexpected event network-vif-plugged-74095f60-9801-4b07-98bf-33541cf69058 for instance with vm_state active and task_state deleting.
Nov 29 20:20:43 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: d8864353-ba84-4d79-a316-46a185729caa] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:20:43 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: d8864353-ba84-4d79-a316-46a185729caa] Took 0.53 seconds to deallocate network for instance.
Nov 29 20:20:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-5be79e56-1e58-483e-a68c-283888983a46 req-013e483d-af93-41d9-a72e-53b1e7a16459 service nova] [instance: d8864353-ba84-4d79-a316-46a185729caa] Received event network-vif-deleted-74095f60-9801-4b07-98bf-33541cf69058 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:43 user nova-compute[75356]: INFO nova.compute.manager [req-5be79e56-1e58-483e-a68c-283888983a46 req-013e483d-af93-41d9-a72e-53b1e7a16459 service nova] [instance: d8864353-ba84-4d79-a316-46a185729caa] Neutron deleted interface 74095f60-9801-4b07-98bf-33541cf69058; detaching it from the instance and deleting it from the info cache
Nov 29 20:20:43 user nova-compute[75356]: DEBUG nova.network.neutron [req-5be79e56-1e58-483e-a68c-283888983a46 req-013e483d-af93-41d9-a72e-53b1e7a16459 service nova] [instance: d8864353-ba84-4d79-a316-46a185729caa] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-5be79e56-1e58-483e-a68c-283888983a46 req-013e483d-af93-41d9-a72e-53b1e7a16459 service nova] [instance: d8864353-ba84-4d79-a316-46a185729caa] Detach interface failed, port_id=74095f60-9801-4b07-98bf-33541cf69058, reason: Instance d8864353-ba84-4d79-a316-46a185729caa could not be found. {{(pid=75356) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:44 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:20:44 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:20:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:44 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Deleted allocations for instance d8864353-ba84-4d79-a316-46a185729caa
Nov 29 20:20:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-36818f6e-8ce7-4f71-bf00-c33c2cc40045 tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "d8864353-ba84-4d79-a316-46a185729caa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.052s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:50 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:20:50 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:20:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:50 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:20:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquiring lock "28f5dcc3-db77-4c65-87af-e300f99d2be5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:50 user nova-compute[75356]: DEBUG nova.objects.instance [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lazy-loading 'flavor' on Instance uuid 28f5dcc3-db77-4c65-87af-e300f99d2be5 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:20:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquiring lock "28f5dcc3-db77-4c65-87af-e300f99d2be5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:51 user nova-compute[75356]: INFO nova.compute.manager [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Attaching volume e3b4bf51-31c9-4811-8217-6e19e7a97957 to /dev/vdb
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG os_brick.utils [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b83f006-d6e1-4565-b0b7-4cc691fa0c3a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "36ec2327-b376-49e4-8592-b2a077b79043" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "36ec2327-b376-49e4-8592-b2a077b79043" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f3a04c-4259-4ead-9fd2-65d4651fee4b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.030s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d9db78-c677-4539-909d-e51e144064f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG nova.compute.manager [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddb6668-e8ef-4b5a-b438-96030663d755]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[167e3e09-bf45-47f4-a8f8-91b90347eceb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:20:51 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e3d78e-662c-4105-8429-597ef43a285d]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG os_brick.utils [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] <== get_connector_properties: return (242ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Updating existing volume attachment record: 441ad9e9-546d-4044-85b0-746b97cf1f77 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:20:51 user nova-compute[75356]: INFO nova.compute.claims [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Claim successful on node user
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f3a04c-4259-4ead-9fd2-65d4651fee4b/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f3a04c-4259-4ead-9fd2-65d4651fee4b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f3a04c-4259-4ead-9fd2-65d4651fee4b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.682s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG nova.network.neutron [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:20:52 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:20:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG nova.policy [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abc7cfc71d0c448cbbe8d42f8b617d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b14efb1a4d34a3db7a51bd79234b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Acquiring lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Acquiring lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:52 user nova-compute[75356]: INFO nova.compute.manager [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Terminating instance
Nov 29 20:20:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:20:52 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Creating image(s)
Nov 29 20:20:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "/opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "/opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "/opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.255s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.229s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk 1073741824" returned: 0 in 0.114s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.354s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.211s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG nova.network.neutron [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Successfully created port: b592a6b3-336d-4af0-ac33-8aa5f050fe9e {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:20:53 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Instance destroyed successfully.
Nov 29 20:20:53 user nova-compute[75356]: DEBUG nova.objects.instance [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lazy-loading 'resources' on Instance uuid 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2087794140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2087794140',id=8,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMcSB5W90J44Qo16Oh0Cpy3jhi4X0540/9A+XafSyfNEzKrqoj4TuajJuNFlGXhbGXb/O9kxaBhSAt46g/kgqUtmOKqWshX+iOmBJWeort/VCkacPfcnj7JuOcU0rQEdQ==',key_name='tempest-keypair-504121784',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:17:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='076d6fb1d7e1485f847881bd7fe665f3',ramdisk_id='',reservation_id='r-8hmccieq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-75465737',owner_user_name='tempest-TaggedAttachmentsTest-75465737-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:17:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5b4a48f9bfd406cae779bfc3dc5e302',uuid=3d1a8bb2-82f9-4a3f-aeff-a5472477d651,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "address": "fa:16:3e:34:be:70", "network": {"id": "fe921eef-0c3b-459b-b302-b879394d578b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-572349767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577e6509-52", "ovs_interfaceid": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Converting VIF {"id": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "address": "fa:16:3e:34:be:70", "network": {"id": "fe921eef-0c3b-459b-b302-b879394d578b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-572349767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076d6fb1d7e1485f847881bd7fe665f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577e6509-52", "ovs_interfaceid": "577e6509-523f-46e2-9994-9d1eb9ff0c13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:be:70,bridge_name='br-int',has_traffic_filtering=True,id=577e6509-523f-46e2-9994-9d1eb9ff0c13,network=Network(fe921eef-0c3b-459b-b302-b879394d578b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap577e6509-52') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG os_vif [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:be:70,bridge_name='br-int',has_traffic_filtering=True,id=577e6509-523f-46e2-9994-9d1eb9ff0c13,network=Network(fe921eef-0c3b-459b-b302-b879394d578b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap577e6509-52') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Cannot resize image /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Ensure instance console log exists: /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap577e6509-52, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0aa92398-6676-4e1a-9a4b-2f9e41fd3338) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:53 user nova-compute[75356]: INFO os_vif [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:be:70,bridge_name='br-int',has_traffic_filtering=True,id=577e6509-523f-46e2-9994-9d1eb9ff0c13,network=Network(fe921eef-0c3b-459b-b302-b879394d578b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap577e6509-52')
Nov 29 20:20:53 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Deleting instance files /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651_del
Nov 29 20:20:53 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Deletion of /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651_del complete
Nov 29 20:20:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:53 user nova-compute[75356]: INFO nova.compute.manager [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 29 20:20:53 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:20:53 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:20:53 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000008, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/3d1a8bb2-82f9-4a3f-aeff-a5472477d651/disk
Nov 29 20:20:54 user nova-compute[75356]: DEBUG nova.network.neutron [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Successfully updated port: b592a6b3-336d-4af0-ac33-8aa5f050fe9e {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG nova.compute.manager [req-53e44cbb-0b2b-48cf-8f5e-979364c36167 req-e1ad246e-dacb-446a-b3e1-74de534481e5 service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Received event network-changed-b592a6b3-336d-4af0-ac33-8aa5f050fe9e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG nova.compute.manager [req-53e44cbb-0b2b-48cf-8f5e-979364c36167 req-e1ad246e-dacb-446a-b3e1-74de534481e5 service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Refreshing instance network info cache due to event network-changed-b592a6b3-336d-4af0-ac33-8aa5f050fe9e. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-53e44cbb-0b2b-48cf-8f5e-979364c36167 req-e1ad246e-dacb-446a-b3e1-74de534481e5 service nova] Acquiring lock "refresh_cache-36ec2327-b376-49e4-8592-b2a077b79043" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-53e44cbb-0b2b-48cf-8f5e-979364c36167 req-e1ad246e-dacb-446a-b3e1-74de534481e5 service nova] Acquired lock "refresh_cache-36ec2327-b376-49e4-8592-b2a077b79043" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG nova.network.neutron [req-53e44cbb-0b2b-48cf-8f5e-979364c36167 req-e1ad246e-dacb-446a-b3e1-74de534481e5 service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Refreshing network info cache for port b592a6b3-336d-4af0-ac33-8aa5f050fe9e {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:20:54 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:20:54 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:20:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=7988MB free_disk=25.432430267333984GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "refresh_cache-36ec2327-b376-49e4-8592-b2a077b79043" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG nova.network.neutron [req-53e44cbb-0b2b-48cf-8f5e-979364c36167 req-e1ad246e-dacb-446a-b3e1-74de534481e5 service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 9751c435-4d10-46dc-86e7-39d40e8209d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0b59517a-c467-432a-a73a-d1460c1574e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 96cbbbdb-e1cc-49da-9a9f-5b83031b235b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 972e22c1-bd85-4507-9166-ace3fce8e698 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 3d1a8bb2-82f9-4a3f-aeff-a5472477d651 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance fb7280bd-7153-4868-b1c9-35cc77e96277 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 68f3a04c-4259-4ead-9fd2-65d4651fee4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 36ec2327-b376-49e4-8592-b2a077b79043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:20:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.675s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:55 user nova-compute[75356]: DEBUG nova.network.neutron [req-53e44cbb-0b2b-48cf-8f5e-979364c36167 req-e1ad246e-dacb-446a-b3e1-74de534481e5 service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:20:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-53e44cbb-0b2b-48cf-8f5e-979364c36167 req-e1ad246e-dacb-446a-b3e1-74de534481e5 service nova] Releasing lock "refresh_cache-36ec2327-b376-49e4-8592-b2a077b79043" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:20:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquired lock "refresh_cache-36ec2327-b376-49e4-8592-b2a077b79043" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:20:55 user nova-compute[75356]: DEBUG nova.network.neutron [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:20:55 user nova-compute[75356]: DEBUG nova.network.neutron [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:20:55 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:20:55 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:20:55 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:20:56 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Took 2.39 seconds to deallocate network for instance.
Nov 29 20:20:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.network.neutron [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Updating instance_info_cache with network_info: [{"id": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "address": "fa:16:3e:2c:f4:1f", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb592a6b3-33", "ovs_interfaceid": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.compute.manager [req-75e3b1ae-f90a-427c-9448-58f1a424a459 req-e590d8b4-aae5-4729-9141-ddcdb9d9b7de service nova] [instance: 3d1a8bb2-82f9-4a3f-aeff-a5472477d651] Received event network-vif-deleted-577e6509-523f-46e2-9994-9d1eb9ff0c13 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Releasing lock "refresh_cache-36ec2327-b376-49e4-8592-b2a077b79043" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.compute.manager [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Instance network_info: |[{"id": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "address": "fa:16:3e:2c:f4:1f", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb592a6b3-33", "ovs_interfaceid": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Start _get_guest_xml network_info=[{"id": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "address": "fa:16:3e:2c:f4:1f", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb592a6b3-33", "ovs_interfaceid": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:20:56 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:20:56 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2086140812',display_name='tempest-tempest.common.compute-instance-2086140812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2086140812',id=15,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkT9y7rrd/Y5ebvEZ6un5mDuYkh3taeh/2CNWnRGvskqEqjhBdlrCLi3cPcBtL8QdOGFvHh7tZcM81p1N+u4M88CWgTrMXsWASi0tU/5YZzvvrfG6YTm/WptIWFFOdngQ==',key_name='tempest-keypair-24359724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b14efb1a4d34a3db7a51bd79234b86b',ramdisk_id='',reservation_id='r-8udz7yf5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1000495362',owner_user_name='tempest-ServerActionsTestOtherA-1000495362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc7cfc71d0c448cbbe8d42f8b617d8b',uuid=36ec2327-b376-49e4-8592-b2a077b79043,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "address": "fa:16:3e:2c:f4:1f", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb592a6b3-33", "ovs_interfaceid": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converting VIF {"id": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "address": "fa:16:3e:2c:f4:1f", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb592a6b3-33", "ovs_interfaceid": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:f4:1f,bridge_name='br-int',has_traffic_filtering=True,id=b592a6b3-336d-4af0-ac33-8aa5f050fe9e,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb592a6b3-33') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.objects.instance [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lazy-loading 'pci_devices' on Instance uuid 36ec2327-b376-49e4-8592-b2a077b79043 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:20:56 user nova-compute[75356]:   <uuid>36ec2327-b376-49e4-8592-b2a077b79043</uuid>
Nov 29 20:20:56 user nova-compute[75356]:   <name>instance-0000000f</name>
Nov 29 20:20:56 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:20:56 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:20:56 user nova-compute[75356]:   <metadata>
Nov 29 20:20:56 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:20:56 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:20:56 user nova-compute[75356]:       <nova:name>tempest-tempest.common.compute-instance-2086140812</nova:name>
Nov 29 20:20:56 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:20:56</nova:creationTime>
Nov 29 20:20:56 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:20:56 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:20:56 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:20:56 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:20:56 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:20:56 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:20:56 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:20:56 user nova-compute[75356]:       <nova:owner>
Nov 29 20:20:56 user nova-compute[75356]:         <nova:user uuid="abc7cfc71d0c448cbbe8d42f8b617d8b">tempest-ServerActionsTestOtherA-1000495362-project-member</nova:user>
Nov 29 20:20:56 user nova-compute[75356]:         <nova:project uuid="8b14efb1a4d34a3db7a51bd79234b86b">tempest-ServerActionsTestOtherA-1000495362</nova:project>
Nov 29 20:20:56 user nova-compute[75356]:       </nova:owner>
Nov 29 20:20:56 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:20:56 user nova-compute[75356]:       <nova:ports>
Nov 29 20:20:56 user nova-compute[75356]:         <nova:port uuid="b592a6b3-336d-4af0-ac33-8aa5f050fe9e">
Nov 29 20:20:56 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 20:20:56 user nova-compute[75356]:         </nova:port>
Nov 29 20:20:56 user nova-compute[75356]:       </nova:ports>
Nov 29 20:20:56 user nova-compute[75356]:     </nova:instance>
Nov 29 20:20:56 user nova-compute[75356]:   </metadata>
Nov 29 20:20:56 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:20:56 user nova-compute[75356]:     <system>
Nov 29 20:20:56 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:20:56 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:20:56 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:20:56 user nova-compute[75356]:       <entry name="serial">36ec2327-b376-49e4-8592-b2a077b79043</entry>
Nov 29 20:20:56 user nova-compute[75356]:       <entry name="uuid">36ec2327-b376-49e4-8592-b2a077b79043</entry>
Nov 29 20:20:56 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:20:56 user nova-compute[75356]:     </system>
Nov 29 20:20:56 user nova-compute[75356]:   </sysinfo>
Nov 29 20:20:56 user nova-compute[75356]:   <os>
Nov 29 20:20:56 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:20:56 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:20:56 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:20:56 user nova-compute[75356]:   </os>
Nov 29 20:20:56 user nova-compute[75356]:   <features>
Nov 29 20:20:56 user nova-compute[75356]:     <acpi/>
Nov 29 20:20:56 user nova-compute[75356]:     <apic/>
Nov 29 20:20:56 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:20:56 user nova-compute[75356]:   </features>
Nov 29 20:20:56 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:20:56 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:20:56 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:20:56 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:20:56 user nova-compute[75356]:   </clock>
Nov 29 20:20:56 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:20:56 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:20:56 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:20:56 user nova-compute[75356]:   </cpu>
Nov 29 20:20:56 user nova-compute[75356]:   <devices>
Nov 29 20:20:56 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:20:56 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:20:56 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk"/>
Nov 29 20:20:56 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:20:56 user nova-compute[75356]:     </disk>
Nov 29 20:20:56 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:20:56 user nova-compute[75356]:       <mac address="fa:16:3e:2c:f4:1f"/>
Nov 29 20:20:56 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:20:56 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:20:56 user nova-compute[75356]:       <target dev="tapb592a6b3-33"/>
Nov 29 20:20:56 user nova-compute[75356]:     </interface>
Nov 29 20:20:56 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:20:56 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/console.log" append="off"/>
Nov 29 20:20:56 user nova-compute[75356]:     </serial>
Nov 29 20:20:56 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:20:56 user nova-compute[75356]:     <video>
Nov 29 20:20:56 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:20:56 user nova-compute[75356]:     </video>
Nov 29 20:20:56 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:20:56 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:20:56 user nova-compute[75356]:     </rng>
Nov 29 20:20:56 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:20:56 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:20:56 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:20:56 user nova-compute[75356]:     </memballoon>
Nov 29 20:20:56 user nova-compute[75356]:   </devices>
Nov 29 20:20:56 user nova-compute[75356]: </domain>
Nov 29 20:20:56 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2086140812',display_name='tempest-tempest.common.compute-instance-2086140812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2086140812',id=15,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkT9y7rrd/Y5ebvEZ6un5mDuYkh3taeh/2CNWnRGvskqEqjhBdlrCLi3cPcBtL8QdOGFvHh7tZcM81p1N+u4M88CWgTrMXsWASi0tU/5YZzvvrfG6YTm/WptIWFFOdngQ==',key_name='tempest-keypair-24359724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b14efb1a4d34a3db7a51bd79234b86b',ramdisk_id='',reservation_id='r-8udz7yf5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1000495362',owner_user_name='tempest-ServerActionsTestOtherA-1000495362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc7cfc71d0c448cbbe8d42f8b617d8b',uuid=36ec2327-b376-49e4-8592-b2a077b79043,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "address": "fa:16:3e:2c:f4:1f", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb592a6b3-33", "ovs_interfaceid": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converting VIF {"id": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "address": "fa:16:3e:2c:f4:1f", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb592a6b3-33", "ovs_interfaceid": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:f4:1f,bridge_name='br-int',has_traffic_filtering=True,id=b592a6b3-336d-4af0-ac33-8aa5f050fe9e,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb592a6b3-33') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG os_vif [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:f4:1f,bridge_name='br-int',has_traffic_filtering=True,id=b592a6b3-336d-4af0-ac33-8aa5f050fe9e,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb592a6b3-33') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '93d1f6c4-fdf6-5e9f-9ede-ecb791dfa7df', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb592a6b3-33, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb592a6b3-33, col_values=(('qos', UUID('bd5386d5-ad09-476e-9e51-ac12b17544e8')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb592a6b3-33, col_values=(('external_ids', {'iface-id': 'b592a6b3-336d-4af0-ac33-8aa5f050fe9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:f4:1f', 'vm-uuid': '36ec2327-b376-49e4-8592-b2a077b79043'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:20:56 user nova-compute[75356]: INFO os_vif [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:f4:1f,bridge_name='br-int',has_traffic_filtering=True,id=b592a6b3-336d-4af0-ac33-8aa5f050fe9e,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb592a6b3-33')
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] No VIF found with MAC fa:16:3e:2c:f4:1f, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.533s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:56 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Deleted allocations for instance 3d1a8bb2-82f9-4a3f-aeff-a5472477d651
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Updating instance_info_cache with network_info: [{"id": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "address": "fa:16:3e:6b:b2:4e", "network": {"id": "27a8d395-36c8-4f27-89cf-f5019ccbf9a2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45448e5cb4e84c14b1114846a6ccbdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ec4756-3f", "ovs_interfaceid": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-88f6137c-64a6-4f4c-9110-9f98bea3d9a9 tempest-TaggedAttachmentsTest-75465737 tempest-TaggedAttachmentsTest-75465737-project-member] Lock "3d1a8bb2-82f9-4a3f-aeff-a5472477d651" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.498s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:20:56 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:20:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:57 user nova-compute[75356]: DEBUG nova.objects.instance [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lazy-loading 'flavor' on Instance uuid 96cbbbdb-e1cc-49da-9a9f-5b83031b235b {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:20:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:57 user nova-compute[75356]: INFO nova.compute.manager [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Attaching volume 4a07443e-a368-43b5-90b0-e96c00dc86a7 to /dev/vdb
Nov 29 20:20:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG os_brick.utils [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf0ccec-d796-41b5-b7fc-1e471676276b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[93255782-94c2-4c3c-ae74-3ce6f37c9dd0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcdae06-6b6c-4ec8-929a-7e2ff49c4d3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97b3b54-312f-4046-9803-62fc890a9ad0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:20:58 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:20:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[391c88e1-c559-4e49-bcd8-ca79868a98ec]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG os_brick.utils [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Updating existing volume attachment record: 999d7ffa-4ff9-4492-b2ae-1f99136b4c96 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG nova.compute.manager [req-69ffbf8b-a353-4ffa-b813-5e1990bec143 req-6edb7685-3c22-417f-baf4-316f63165e59 service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Received event network-vif-plugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-69ffbf8b-a353-4ffa-b813-5e1990bec143 req-6edb7685-3c22-417f-baf4-316f63165e59 service nova] Acquiring lock "36ec2327-b376-49e4-8592-b2a077b79043-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-69ffbf8b-a353-4ffa-b813-5e1990bec143 req-6edb7685-3c22-417f-baf4-316f63165e59 service nova] Lock "36ec2327-b376-49e4-8592-b2a077b79043-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-69ffbf8b-a353-4ffa-b813-5e1990bec143 req-6edb7685-3c22-417f-baf4-316f63165e59 service nova] Lock "36ec2327-b376-49e4-8592-b2a077b79043-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:20:58 user nova-compute[75356]: DEBUG nova.compute.manager [req-69ffbf8b-a353-4ffa-b813-5e1990bec143 req-6edb7685-3c22-417f-baf4-316f63165e59 service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] No waiting events found dispatching network-vif-plugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:20:58 user nova-compute[75356]: WARNING nova.compute.manager [req-69ffbf8b-a353-4ffa-b813-5e1990bec143 req-6edb7685-3c22-417f-baf4-316f63165e59 service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Received unexpected event network-vif-plugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e for instance with vm_state building and task_state spawning.
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Acquiring lock "fb7280bd-7153-4868-b1c9-35cc77e96277" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Acquiring lock "fb7280bd-7153-4868-b1c9-35cc77e96277-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:00 user nova-compute[75356]: INFO nova.compute.manager [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Terminating instance
Nov 29 20:21:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoKFtdDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:21:00 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:21:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:21:00 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:21:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:21:00 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6929e746-b593-47b8-b05d-c66596ff4f1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:21:00 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3c46e0-1680-4b13-aef0-f102aff32eac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957] added
Nov 29 20:21:00 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0719af46-b572-413c-9679-869047e7740a]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.044s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d267f9-4905-42d4-9f01-a66b54374297]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG nova.compute.manager [req-150294f4-2d00-4d80-925a-4f38a5b058e3 req-bda4f8df-2ca9-4c92-a998-770b40b8e523 service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Received event network-vif-unplugged-14000a37-7834-4054-8a54-331e7d5d9d7b {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-150294f4-2d00-4d80-925a-4f38a5b058e3 req-bda4f8df-2ca9-4c92-a998-770b40b8e523 service nova] Acquiring lock "fb7280bd-7153-4868-b1c9-35cc77e96277-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-150294f4-2d00-4d80-925a-4f38a5b058e3 req-bda4f8df-2ca9-4c92-a998-770b40b8e523 service nova] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-150294f4-2d00-4d80-925a-4f38a5b058e3 req-bda4f8df-2ca9-4c92-a998-770b40b8e523 service nova] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG nova.compute.manager [req-150294f4-2d00-4d80-925a-4f38a5b058e3 req-bda4f8df-2ca9-4c92-a998-770b40b8e523 service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] No waiting events found dispatching network-vif-unplugged-14000a37-7834-4054-8a54-331e7d5d9d7b {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG nova.compute.manager [req-150294f4-2d00-4d80-925a-4f38a5b058e3 req-bda4f8df-2ca9-4c92-a998-770b40b8e523 service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Received event network-vif-unplugged-14000a37-7834-4054-8a54-331e7d5d9d7b for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JoKFtdDY {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:00 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Instance spawned successfully.
Nov 29 20:21:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JoKFtdDY" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efaf964-8d22-4ea9-981c-998b675c3595]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JoKFtdDY'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bd6370-a646-4c92-9176-dfe03731ab84]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG nova.compute.manager [req-54c6aacf-74ac-4f21-8ff4-0806ee10cfad req-5cc5e8b2-13fc-415a-9547-a9994ab6dd30 service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Received event network-vif-plugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-54c6aacf-74ac-4f21-8ff4-0806ee10cfad req-5cc5e8b2-13fc-415a-9547-a9994ab6dd30 service nova] Acquiring lock "36ec2327-b376-49e4-8592-b2a077b79043-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-54c6aacf-74ac-4f21-8ff4-0806ee10cfad req-5cc5e8b2-13fc-415a-9547-a9994ab6dd30 service nova] Lock "36ec2327-b376-49e4-8592-b2a077b79043-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-54c6aacf-74ac-4f21-8ff4-0806ee10cfad req-5cc5e8b2-13fc-415a-9547-a9994ab6dd30 service nova] Lock "36ec2327-b376-49e4-8592-b2a077b79043-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG nova.compute.manager [req-54c6aacf-74ac-4f21-8ff4-0806ee10cfad req-5cc5e8b2-13fc-415a-9547-a9994ab6dd30 service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] No waiting events found dispatching network-vif-plugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:21:00 user nova-compute[75356]: WARNING nova.compute.manager [req-54c6aacf-74ac-4f21-8ff4-0806ee10cfad req-5cc5e8b2-13fc-415a-9547-a9994ab6dd30 service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Received unexpected event network-vif-plugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e for instance with vm_state building and task_state spawning.
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7b0cdb-57cf-4c4b-985d-a48738c8d644]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 20:21:00 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 20:21:00 user nova-compute[75356]:  {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:21:00 user nova-compute[75356]: WARNING os_brick.initiator.connectors.iscsi [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 20:21:00 user nova-compute[75356]: 
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[400ed809-48ed-4c5c-8f73-bf607458eeff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957, portal: 172.16.0.220,3260]
Nov 29 20:21:00 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957, portal: 172.16.0.220,3260] successful.
Nov 29 20:21:00 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[edeea1ea-a149-4502-a85f-088b60273a31]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:00 user nova-compute[75356]: INFO nova.compute.manager [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Took 8.30 seconds to spawn the instance on the hypervisor.
Nov 29 20:21:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ef705e-afd5-487c-a988-362b3ce57a8f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:21:00 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:21:00 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24a1aa3-91cc-4ce8-aa31-0a89896efe0d]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:21:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoKFtdDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:21:00 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Instance destroyed successfully.
Nov 29 20:21:00 user nova-compute[75356]: DEBUG nova.objects.instance [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lazy-loading 'resources' on Instance uuid fb7280bd-7153-4868-b1c9-35cc77e96277 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:21:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1098333332',display_name='tempest-TestVolumeSwap-server-1098333332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1098333332',id=9,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG5ceNtdkGPD4EGF6iljLg0XeFPVMEtWrgNZnw/qTXeLBAEoYqA5r82GXdU5mIM33szpNzH2mA8AsD/5kYPJuCV6o0fy9VCwW2fGO3kRG34iYBdlAvyjOrsbfYxYXpaDw==',key_name='tempest-keypair-1085431435',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:17:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4965cd9c0823424d9e7dd283d7f7b210',ramdisk_id='',reservation_id='r-3fspgp5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1405815801',owner_user_name='tempest-TestVolumeSwap-1405815801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:17:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cfe06906d3b40849bfc37aba8222636',uuid=fb7280bd-7153-4868-b1c9-35cc77e96277,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14000a37-7834-4054-8a54-331e7d5d9d7b", "address": "fa:16:3e:36:54:40", "network": {"id": "c577b91d-6b91-44ff-b28f-40bc465b16b5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2092872784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4965cd9c0823424d9e7dd283d7f7b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14000a37-78", "ovs_interfaceid": "14000a37-7834-4054-8a54-331e7d5d9d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:21:01 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Converting VIF {"id": "14000a37-7834-4054-8a54-331e7d5d9d7b", "address": "fa:16:3e:36:54:40", "network": {"id": "c577b91d-6b91-44ff-b28f-40bc465b16b5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2092872784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4965cd9c0823424d9e7dd283d7f7b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14000a37-78", "ovs_interfaceid": "14000a37-7834-4054-8a54-331e7d5d9d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:21:01 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:54:40,bridge_name='br-int',has_traffic_filtering=True,id=14000a37-7834-4054-8a54-331e7d5d9d7b,network=Network(c577b91d-6b91-44ff-b28f-40bc465b16b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14000a37-78') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:21:01 user nova-compute[75356]: DEBUG os_vif [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:54:40,bridge_name='br-int',has_traffic_filtering=True,id=14000a37-7834-4054-8a54-331e7d5d9d7b,network=Network(c577b91d-6b91-44ff-b28f-40bc465b16b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14000a37-78') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:21:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14000a37-78, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:21:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:21:01 user nova-compute[75356]: INFO nova.compute.manager [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Took 9.61 seconds to build instance.
Nov 29 20:21:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6b3c407-7da6-466c-b415-6ef753a553ab) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:21:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:01 user nova-compute[75356]: INFO os_vif [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:54:40,bridge_name='br-int',has_traffic_filtering=True,id=14000a37-7834-4054-8a54-331e7d5d9d7b,network=Network(c577b91d-6b91-44ff-b28f-40bc465b16b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14000a37-78')
Nov 29 20:21:01 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Deleting instance files /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277_del
Nov 29 20:21:01 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Deletion of /opt/stack/data/nova/instances/fb7280bd-7153-4868-b1c9-35cc77e96277_del complete
Nov 29 20:21:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04c73b0f-6d08-48e0-8920-06c4e10b189d tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "36ec2327-b376-49e4-8592-b2a077b79043" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.819s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:01 user nova-compute[75356]: INFO nova.compute.manager [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 29 20:21:01 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:21:01 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:21:01 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:21:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:21:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] <== connect_volume: return (1461ms) {'type': 'block', 'scsi_wwn': '26139353262343632', 'path': '/dev/sdb'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:21:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139353262343632', 'path': '/dev/sdb'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:21:01 user nova-compute[75356]: DEBUG nova.objects.instance [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lazy-loading 'flavor' on Instance uuid 28f5dcc3-db77-4c65-87af-e300f99d2be5 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:21:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:21:01 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:21:01 user nova-compute[75356]:   <source dev="/dev/sdb"/>
Nov 29 20:21:01 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:21:01 user nova-compute[75356]:   <serial>e3b4bf51-31c9-4811-8217-6e19e7a97957</serial>
Nov 29 20:21:01 user nova-compute[75356]: </disk>
Nov 29 20:21:01 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:21:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:21:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:21:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] No VIF found with MAC fa:16:3e:6b:b2:4e, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:21:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d221dc9b-de32-485e-a9e3-e33f0cf823a6 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.526s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-f2be6ec7-dcda-4c99-a436-63df7554b04d req-ca9903a3-4b26-481f-81de-23eef1954ba6 service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Received event network-vif-plugged-14000a37-7834-4054-8a54-331e7d5d9d7b {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:21:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f2be6ec7-dcda-4c99-a436-63df7554b04d req-ca9903a3-4b26-481f-81de-23eef1954ba6 service nova] Acquiring lock "fb7280bd-7153-4868-b1c9-35cc77e96277-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f2be6ec7-dcda-4c99-a436-63df7554b04d req-ca9903a3-4b26-481f-81de-23eef1954ba6 service nova] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f2be6ec7-dcda-4c99-a436-63df7554b04d req-ca9903a3-4b26-481f-81de-23eef1954ba6 service nova] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-f2be6ec7-dcda-4c99-a436-63df7554b04d req-ca9903a3-4b26-481f-81de-23eef1954ba6 service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] No waiting events found dispatching network-vif-plugged-14000a37-7834-4054-8a54-331e7d5d9d7b {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:21:02 user nova-compute[75356]: WARNING nova.compute.manager [req-f2be6ec7-dcda-4c99-a436-63df7554b04d req-ca9903a3-4b26-481f-81de-23eef1954ba6 service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Received unexpected event network-vif-plugged-14000a37-7834-4054-8a54-331e7d5d9d7b for instance with vm_state active and task_state deleting.
Nov 29 20:21:03 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:21:03 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Took 1.90 seconds to deallocate network for instance.
Nov 29 20:21:03 user nova-compute[75356]: DEBUG nova.compute.manager [req-14d20173-b477-4209-8415-080d9a5a259a req-1e3e6b00-e9e7-4002-99ea-9586f602cdf4 service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Received event network-vif-deleted-14000a37-7834-4054-8a54-331e7d5d9d7b {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:21:03 user nova-compute[75356]: INFO nova.compute.manager [req-14d20173-b477-4209-8415-080d9a5a259a req-1e3e6b00-e9e7-4002-99ea-9586f602cdf4 service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Neutron deleted interface 14000a37-7834-4054-8a54-331e7d5d9d7b; detaching it from the instance and deleting it from the info cache
Nov 29 20:21:03 user nova-compute[75356]: DEBUG nova.network.neutron [req-14d20173-b477-4209-8415-080d9a5a259a req-1e3e6b00-e9e7-4002-99ea-9586f602cdf4 service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:21:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:03 user nova-compute[75356]: DEBUG nova.compute.manager [req-14d20173-b477-4209-8415-080d9a5a259a req-1e3e6b00-e9e7-4002-99ea-9586f602cdf4 service nova] [instance: fb7280bd-7153-4868-b1c9-35cc77e96277] Detach interface failed, port_id=14000a37-7834-4054-8a54-331e7d5d9d7b, reason: Instance fb7280bd-7153-4868-b1c9-35cc77e96277 could not be found. {{(pid=75356) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 20:21:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:03 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:21:03 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:21:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:03 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Deleted allocations for instance fb7280bd-7153-4868-b1c9-35cc77e96277
Nov 29 20:21:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0cf7116b-d128-4b74-9241-16ba31115216 tempest-TestVolumeSwap-1405815801 tempest-TestVolumeSwap-1405815801-project-member] Lock "fb7280bd-7153-4868-b1c9-35cc77e96277" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.600s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:03 user nova-compute[75356]: INFO nova.compute.manager [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Rescuing
Nov 29 20:21:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquiring lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:21:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquired lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:21:03 user nova-compute[75356]: DEBUG nova.network.neutron [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:21:04 user nova-compute[75356]: DEBUG nova.network.neutron [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Updating instance_info_cache with network_info: [{"id": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "address": "fa:16:3e:6b:b2:4e", "network": {"id": "27a8d395-36c8-4f27-89cf-f5019ccbf9a2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45448e5cb4e84c14b1114846a6ccbdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ec4756-3f", "ovs_interfaceid": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:21:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Releasing lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:21:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:05 user nova-compute[75356]: DEBUG nova.compute.manager [req-259a35ce-895a-4012-81bc-4f0584ba441a req-aa0f2a6e-20b1-49ee-bcd8-3f53004f496a service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received event network-vif-unplugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:21:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-259a35ce-895a-4012-81bc-4f0584ba441a req-aa0f2a6e-20b1-49ee-bcd8-3f53004f496a service nova] Acquiring lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-259a35ce-895a-4012-81bc-4f0584ba441a req-aa0f2a6e-20b1-49ee-bcd8-3f53004f496a service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-259a35ce-895a-4012-81bc-4f0584ba441a req-aa0f2a6e-20b1-49ee-bcd8-3f53004f496a service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:05 user nova-compute[75356]: DEBUG nova.compute.manager [req-259a35ce-895a-4012-81bc-4f0584ba441a req-aa0f2a6e-20b1-49ee-bcd8-3f53004f496a service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] No waiting events found dispatching network-vif-unplugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:21:05 user nova-compute[75356]: WARNING nova.compute.manager [req-259a35ce-895a-4012-81bc-4f0584ba441a req-aa0f2a6e-20b1-49ee-bcd8-3f53004f496a service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received unexpected event network-vif-unplugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e for instance with vm_state active and task_state rescuing.
Nov 29 20:21:05 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Instance destroyed successfully.
Nov 29 20:21:05 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Attempting a stable device rescue
Nov 29 20:21:05 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75356) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 20:21:05 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Instance directory exists: not creating {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 20:21:05 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Creating image(s)
Nov 29 20:21:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquiring lock "/opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "/opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "/opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:05 user nova-compute[75356]: DEBUG nova.objects.instance [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lazy-loading 'trusted_certs' on Instance uuid 28f5dcc3-db77-4c65-87af-e300f99d2be5 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:21:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquiring lock "9e26944ebafb7dbc83a3e23417e1c8827981807f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "9e26944ebafb7dbc83a3e23417e1c8827981807f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e26944ebafb7dbc83a3e23417e1c8827981807f.part --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "3584b853-567c-4dd2-ae4f-3ff074074137" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "3584b853-567c-4dd2-ae4f-3ff074074137" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:21:07 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:21:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e26944ebafb7dbc83a3e23417e1c8827981807f.part --force-share --output=json" returned: 0 in 0.203s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:07 user nova-compute[75356]: DEBUG nova.virt.images [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] 384f4bf5-4268-4be6-8da3-b95a6f40da4c was qcow2, converting to raw {{(pid=75356) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 20:21:07 user nova-compute[75356]: DEBUG nova.privsep.utils [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75356) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 20:21:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9e26944ebafb7dbc83a3e23417e1c8827981807f.part /opt/stack/data/nova/instances/_base/9e26944ebafb7dbc83a3e23417e1c8827981807f.converted {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:07 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:21:07 user nova-compute[75356]: INFO nova.compute.claims [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Claim successful on node user
Nov 29 20:21:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-ba2993d2-5665-462b-a323-dd9d708d0f7b req-2157a19b-a2b2-4ae5-a74d-d2406b787989 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received event network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:21:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ba2993d2-5665-462b-a323-dd9d708d0f7b req-2157a19b-a2b2-4ae5-a74d-d2406b787989 service nova] Acquiring lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ba2993d2-5665-462b-a323-dd9d708d0f7b req-2157a19b-a2b2-4ae5-a74d-d2406b787989 service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ba2993d2-5665-462b-a323-dd9d708d0f7b req-2157a19b-a2b2-4ae5-a74d-d2406b787989 service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-ba2993d2-5665-462b-a323-dd9d708d0f7b req-2157a19b-a2b2-4ae5-a74d-d2406b787989 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] No waiting events found dispatching network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:21:07 user nova-compute[75356]: WARNING nova.compute.manager [req-ba2993d2-5665-462b-a323-dd9d708d0f7b req-2157a19b-a2b2-4ae5-a74d-d2406b787989 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received unexpected event network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e for instance with vm_state active and task_state rescuing.
Nov 29 20:21:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9e26944ebafb7dbc83a3e23417e1c8827981807f.part /opt/stack/data/nova/instances/_base/9e26944ebafb7dbc83a3e23417e1c8827981807f.converted" returned: 0 in 0.515s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e26944ebafb7dbc83a3e23417e1c8827981807f.converted --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKteoRvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:21:08 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:21:08 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:21:08 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4be6b0-6413-43d8-9492-d73022dc6466]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:21:08 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[052c04ff-21db-4007-94b1-ae89385fabf0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7] added
Nov 29 20:21:08 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3993389a-7c45-46a2-a7f6-64ac9d177b7f]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfa072a-6c8d-46a6-b997-1c450db6572a]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wKteoRvT {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wKteoRvT" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc7eeba-6909-419c-9bf4-61469716d28d]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wKteoRvT'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf36e52-c4fe-4771-954c-e875faf1d9ce]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e26944ebafb7dbc83a3e23417e1c8827981807f.converted --force-share --output=json" returned: 0 in 0.243s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "9e26944ebafb7dbc83a3e23417e1c8827981807f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.325s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d994ae06-db34-4357-bb0c-8ea613537c9a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:21:08 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:21:08 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquiring lock "9e26944ebafb7dbc83a3e23417e1c8827981807f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "9e26944ebafb7dbc83a3e23417e1c8827981807f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e26944ebafb7dbc83a3e23417e1c8827981807f --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.801s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f5db88-3f45-4a16-ba04-226725be683a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260]
Nov 29 20:21:08 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260] successful.
Nov 29 20:21:08 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c09f94a-c574-440c-866d-dc5fcdc6d8a7]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[894f2054-62b3-4ea8-b5e3-00c09ce3bdbb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:21:08 user nova-compute[75356]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:21:08 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:21:08 user nova-compute[75356]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:21:08 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:08 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe89bb9-3266-4163-8188-f7be98a7c77d]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKteoRvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e26944ebafb7dbc83a3e23417e1c8827981807f --force-share --output=json" returned: 0 in 0.235s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9e26944ebafb7dbc83a3e23417e1c8827981807f,backing_fmt=raw /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk.rescue {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.policy [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc9deaf0a28f4afaad9e42ecc448a23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85535b509efe4dbb81c372f9031faac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9e26944ebafb7dbc83a3e23417e1c8827981807f,backing_fmt=raw /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk.rescue" returned: 0 in 0.082s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "9e26944ebafb7dbc83a3e23417e1c8827981807f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.objects.instance [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lazy-loading 'migration_context' on Instance uuid 28f5dcc3-db77-4c65-87af-e300f99d2be5 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.objects.base [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Object Instance<28f5dcc3-db77-4c65-87af-e300f99d2be5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Start _get_guest_xml network_info=[{"id": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "address": "fa:16:3e:6b:b2:4e", "network": {"id": "27a8d395-36c8-4f27-89cf-f5019ccbf9a2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "vif_mac": "fa:16:3e:6b:b2:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45448e5cb4e84c14b1114846a6ccbdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ec4756-3f", "ovs_interfaceid": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '384f4bf5-4268-4be6-8da3-b95a6f40da4c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoKFtdDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '28f5dcc3-db77-4c65-87af-e300f99d2be5', 'attached_at': '', 'detached_at': '', 'volume_id': 'e3b4bf51-31c9-4811-8217-6e19e7a97957', 'serial': 'e3b4bf51-31c9-4811-8217-6e19e7a97957'}, 'attachment_id': '441ad9e9-546d-4044-85b0-746b97cf1f77', 'volume_type': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.objects.instance [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lazy-loading 'resources' on Instance uuid 28f5dcc3-db77-4c65-87af-e300f99d2be5 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.objects.base [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Object Instance<28f5dcc3-db77-4c65-87af-e300f99d2be5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.objects.instance [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lazy-loading 'numa_topology' on Instance uuid 28f5dcc3-db77-4c65-87af-e300f99d2be5 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.objects.base [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Object Instance<28f5dcc3-db77-4c65-87af-e300f99d2be5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:21:08 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:21:08 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.objects.instance [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lazy-loading 'vcpu_model' on Instance uuid 28f5dcc3-db77-4c65-87af-e300f99d2be5 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:21:08 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Creating image(s)
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "/opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "/opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "/opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.objects.base [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Object Instance<28f5dcc3-db77-4c65-87af-e300f99d2be5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoKFtdDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:21:08 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:21:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.184s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/disk 1073741824" returned: 0 in 0.063s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.224s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26238613931613235', 'path': '/dev/sdc'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238613931613235', 'path': '/dev/sdc'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.607s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:21:09 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:21:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:21:09 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG nova.objects.instance [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lazy-loading 'flavor' on Instance uuid 96cbbbdb-e1cc-49da-9a9f-5b83031b235b {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d177c2-23e9-4f8c-81a5-d0c7be6faf1a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = JoKFtdDY\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 20:21:09 user nova-compute[75356]: node.name = iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:21:09 user nova-compute[75356]: node.tpgt = -1
Nov 29 20:21:09 user nova-compute[75356]: node.startup = automatic
Nov 29 20:21:09 user nova-compute[75356]: node.leading_login = No
Nov 29 20:21:09 user nova-compute[75356]: iface.iscsi_ifacename = default
Nov 29 20:21:09 user nova-compute[75356]: iface.net_ifacename = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.ipaddress = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.prefix_len = 0
Nov 29 20:21:09 user nova-compute[75356]: iface.hwaddress = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.transport_name = tcp
Nov 29 20:21:09 user nova-compute[75356]: iface.initiatorname = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.state = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.vlan_id = 0
Nov 29 20:21:09 user nova-compute[75356]: iface.vlan_priority = 0
Nov 29 20:21:09 user nova-compute[75356]: iface.vlan_state = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.iface_num = 0
Nov 29 20:21:09 user nova-compute[75356]: iface.mtu = 0
Nov 29 20:21:09 user nova-compute[75356]: iface.port = 0
Nov 29 20:21:09 user nova-compute[75356]: iface.bootproto = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.subnet_mask = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.gateway = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.dhcp_alt_client_id = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.dhcp_dns = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.dhcp_learn_iqn = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.dhcp_vendor_id_state = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.dhcp_vendor_id = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.dhcp_slp_da = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.fragmentation = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.gratuitous_arp = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.incoming_forwarding = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.tos_state = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.tos = 0
Nov 29 20:21:09 user nova-compute[75356]: iface.ttl = 0
Nov 29 20:21:09 user nova-compute[75356]: iface.delayed_ack = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.tcp_nagle = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.tcp_wsf_state = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.tcp_wsf = 0
Nov 29 20:21:09 user nova-compute[75356]: iface.tcp_timer_scale = 0
Nov 29 20:21:09 user nova-compute[75356]: iface.tcp_timestamp = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.redirect = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.def_task_mgmt_timeout = 0
Nov 29 20:21:09 user nova-compute[75356]: iface.header_digest = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.data_digest = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.immediate_data = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.initial_r2t = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.data_seq_inorder = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.data_pdu_inorder = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.erl = 0
Nov 29 20:21:09 user nova-compute[75356]: iface.max_receive_data_len = 0
Nov 29 20:21:09 user nova-compute[75356]: iface.first_burst_len = 0
Nov 29 20:21:09 user nova-compute[75356]: iface.max_outstanding_r2t = 0
Nov 29 20:21:09 user nova-compute[75356]: iface.max_burst_len = 0
Nov 29 20:21:09 user nova-compute[75356]: iface.chap_auth = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.bidi_chap = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.strict_login_compliance = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.discovery_auth = <empty>
Nov 29 20:21:09 user nova-compute[75356]: iface.discovery_logout = <empty>
Nov 29 20:21:09 user nova-compute[75356]: node.discovery_address = <empty>
Nov 29 20:21:09 user nova-compute[75356]: node.discovery_port = 0
Nov 29 20:21:09 user nova-compute[75356]: node.discovery_type = static
Nov 29 20:21:09 user nova-compute[75356]: node.session.initial_cmdsn = 0
Nov 29 20:21:09 user nova-compute[75356]: node.session.initial_login_retry_max = 8
Nov 29 20:21:09 user nova-compute[75356]: node.session.xmit_thread_priority = -20
Nov 29 20:21:09 user nova-compute[75356]: node.session.cmds_max = 128
Nov 29 20:21:09 user nova-compute[75356]: node.session.queue_depth = 32
Nov 29 20:21:09 user nova-compute[75356]: node.session.nr_sessions = 1
Nov 29 20:21:09 user nova-compute[75356]: node.session.auth.authmethod = CHAP
Nov 29 20:21:09 user nova-compute[75356]: node.session.auth.username = JoKFtdDY
Nov 29 20:21:09 user nova-compute[75356]: node.session.auth.password = ***
Nov 29 20:21:09 user nova-compute[75356]: node.session.auth.username_in = <empty>
Nov 29 20:21:09 user nova-compute[75356]: node.session.auth.password_in = <empty>
Nov 29 20:21:09 user nova-compute[75356]: node.session.auth.chap_algs = MD5
Nov 29 20:21:09 user nova-compute[75356]: node.session.timeo.replacement_timeout = 120
Nov 29 20:21:09 user nova-compute[75356]: node.session.err_timeo.abort_timeout = 15
Nov 29 20:21:09 user nova-compute[75356]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 20:21:09 user nova-compute[75356]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 20:21:09 user nova-compute[75356]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 20:21:09 user nova-compute[75356]: node.session.iscsi.FastAbort = Yes
Nov 29 20:21:09 user nova-compute[75356]: node.session.iscsi.InitialR2T = No
Nov 29 20:21:09 user nova-compute[75356]: node.session.iscsi.ImmediateData = Yes
Nov 29 20:21:09 user nova-compute[75356]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 20:21:09 user nova-compute[75356]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 20:21:09 user nova-compute[75356]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 20:21:09 user nova-compute[75356]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 20:21:09 user nova-compute[75356]: node.session.iscsi.MaxConnections = 1
Nov 29 20:21:09 user nova-compute[75356]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 20:21:09 user nova-compute[75356]: node.session.iscsi.ERL = 0
Nov 29 20:21:09 user nova-compute[75356]: node.session.scan = manual
Nov 29 20:21:09 user nova-compute[75356]: node.session.reopen_max = 0
Nov 29 20:21:09 user nova-compute[75356]: node.conn[0].address = 172.16.0.220
Nov 29 20:21:09 user nova-compute[75356]: node.conn[0].port = 3260
Nov 29 20:21:09 user nova-compute[75356]: node.conn[0].startup = manual
Nov 29 20:21:09 user nova-compute[75356]: node.conn[0].tcp.window_size = 524288
Nov 29 20:21:09 user nova-compute[75356]: node.conn[0].tcp.type_of_service = 0
Nov 29 20:21:09 user nova-compute[75356]: node.conn[0].timeo.logout_timeout = 15
Nov 29 20:21:09 user nova-compute[75356]: node.conn[0].timeo.login_timeout = 15
Nov 29 20:21:09 user nova-compute[75356]: node.conn[0].timeo.auth_timeout = 45
Nov 29 20:21:09 user nova-compute[75356]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 20:21:09 user nova-compute[75356]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 20:21:09 user nova-compute[75356]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 20:21:09 user nova-compute[75356]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 20:21:09 user nova-compute[75356]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 20:21:09 user nova-compute[75356]: node.conn[0].iscsi.DataDigest = None
Nov 29 20:21:09 user nova-compute[75356]: node.conn[0].iscsi.IFMarker = No
Nov 29 20:21:09 user nova-compute[75356]: node.conn[0].iscsi.OFMarker = No
Nov 29 20:21:09 user nova-compute[75356]: # END RECORD
Nov 29 20:21:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70a1713-b868-430e-92a8-2eaa38be7128]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:21:09 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:21:09 user nova-compute[75356]:   <source dev="/dev/sdc"/>
Nov 29 20:21:09 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:21:09 user nova-compute[75356]:   <serial>4a07443e-a368-43b5-90b0-e96c00dc86a7</serial>
Nov 29 20:21:09 user nova-compute[75356]: </disk>
Nov 29 20:21:09 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e995215b-f1a9-46c7-ad1e-205a601a0bfc]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JoKFtdDY {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JoKFtdDY" returned: 0 in 0.029s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50f79b3-3f64-4fc3-93db-56ca16ca3361]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JoKFtdDY'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Successfully created port: bd24c38c-a857-4b18-9d9b-55f692288c5f {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[048ed614-6a89-4c9f-92de-d7090ffff740]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Cannot resize image /opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Ensure instance console log exists: /opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae967d0-bacf-4f8e-ac39-76182f0d7e2c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:21:09 user nova-compute[75356]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:21:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:21:09 user nova-compute[75356]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:21:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.206s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] HCTL ('33', '0', '0', 0) found on session 13 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffb9b11-7602-4412-89f9-d2de6e7d71c0]: (4, ('0 0 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Searching for a device in session 13 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoKFtdDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.233s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] <== connect_volume: return (840ms) {'type': 'block', 'scsi_wwn': '26139353262343632', 'path': '/dev/sdb'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139353262343632', 'path': '/dev/sdb'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-598510486',display_name='tempest-ServerStableDeviceRescueTest-server-598510486',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-598510486',id=4,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxONYR7US0Zqc+k52oEx3HULG21Vb3SacYC5A1QxASviLskRyecdFv7MixuujXnSWxHTX4y8h2pNxHKdXKC80agpyrF7M04aMiRUDOy/8e5yjPGD6zvwZDgFznjov/1Kw==',key_name='tempest-keypair-1732727552',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:17:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45448e5cb4e84c14b1114846a6ccbdce',ramdisk_id='',reservation_id='r-9t7k0w0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1008853523',owner_user_name='tempest-ServerStableDeviceRescueTest-1008853523-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:19:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd40c898d11b440ca45ab29e8e6c7721',uuid=28f5dcc3-db77-4c65-87af-e300f99d2be5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "address": "fa:16:3e:6b:b2:4e", "network": {"id": "27a8d395-36c8-4f27-89cf-f5019ccbf9a2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "vif_mac": "fa:16:3e:6b:b2:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45448e5cb4e84c14b1114846a6ccbdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ec4756-3f", "ovs_interfaceid": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Converting VIF {"id": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "address": "fa:16:3e:6b:b2:4e", "network": {"id": "27a8d395-36c8-4f27-89cf-f5019ccbf9a2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "vif_mac": "fa:16:3e:6b:b2:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45448e5cb4e84c14b1114846a6ccbdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ec4756-3f", "ovs_interfaceid": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:b2:4e,bridge_name='br-int',has_traffic_filtering=True,id=d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e,network=Network(27a8d395-36c8-4f27-89cf-f5019ccbf9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ec4756-3f') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG nova.objects.instance [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lazy-loading 'pci_devices' on Instance uuid 28f5dcc3-db77-4c65-87af-e300f99d2be5 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG nova.objects.base [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Object Instance<28f5dcc3-db77-4c65-87af-e300f99d2be5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:21:09 user nova-compute[75356]:   <uuid>28f5dcc3-db77-4c65-87af-e300f99d2be5</uuid>
Nov 29 20:21:09 user nova-compute[75356]:   <name>instance-00000004</name>
Nov 29 20:21:09 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:21:09 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:21:09 user nova-compute[75356]:   <metadata>
Nov 29 20:21:09 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:21:09 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:21:09 user nova-compute[75356]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-598510486</nova:name>
Nov 29 20:21:09 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:21:08</nova:creationTime>
Nov 29 20:21:09 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:21:09 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:21:09 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:21:09 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:21:09 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:21:09 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:21:09 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:21:09 user nova-compute[75356]:       <nova:owner>
Nov 29 20:21:09 user nova-compute[75356]:         <nova:user uuid="bd40c898d11b440ca45ab29e8e6c7721">tempest-ServerStableDeviceRescueTest-1008853523-project-member</nova:user>
Nov 29 20:21:09 user nova-compute[75356]:         <nova:project uuid="45448e5cb4e84c14b1114846a6ccbdce">tempest-ServerStableDeviceRescueTest-1008853523</nova:project>
Nov 29 20:21:09 user nova-compute[75356]:       </nova:owner>
Nov 29 20:21:09 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:21:09 user nova-compute[75356]:       <nova:ports>
Nov 29 20:21:09 user nova-compute[75356]:         <nova:port uuid="d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e">
Nov 29 20:21:09 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 20:21:09 user nova-compute[75356]:         </nova:port>
Nov 29 20:21:09 user nova-compute[75356]:       </nova:ports>
Nov 29 20:21:09 user nova-compute[75356]:     </nova:instance>
Nov 29 20:21:09 user nova-compute[75356]:   </metadata>
Nov 29 20:21:09 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:21:09 user nova-compute[75356]:     <system>
Nov 29 20:21:09 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:21:09 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:21:09 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:21:09 user nova-compute[75356]:       <entry name="serial">28f5dcc3-db77-4c65-87af-e300f99d2be5</entry>
Nov 29 20:21:09 user nova-compute[75356]:       <entry name="uuid">28f5dcc3-db77-4c65-87af-e300f99d2be5</entry>
Nov 29 20:21:09 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:21:09 user nova-compute[75356]:     </system>
Nov 29 20:21:09 user nova-compute[75356]:   </sysinfo>
Nov 29 20:21:09 user nova-compute[75356]:   <os>
Nov 29 20:21:09 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:21:09 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:21:09 user nova-compute[75356]:   </os>
Nov 29 20:21:09 user nova-compute[75356]:   <features>
Nov 29 20:21:09 user nova-compute[75356]:     <acpi/>
Nov 29 20:21:09 user nova-compute[75356]:     <apic/>
Nov 29 20:21:09 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:21:09 user nova-compute[75356]:   </features>
Nov 29 20:21:09 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:21:09 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:21:09 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:21:09 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:21:09 user nova-compute[75356]:   </clock>
Nov 29 20:21:09 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:21:09 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:21:09 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:21:09 user nova-compute[75356]:   </cpu>
Nov 29 20:21:09 user nova-compute[75356]:   <devices>
Nov 29 20:21:09 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:21:09 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:21:09 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk"/>
Nov 29 20:21:09 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:21:09 user nova-compute[75356]:     </disk>
Nov 29 20:21:09 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:21:09 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:21:09 user nova-compute[75356]:       <source dev="/dev/sdb"/>
Nov 29 20:21:09 user nova-compute[75356]:       <target dev="vdb" bus="virtio"/>
Nov 29 20:21:09 user nova-compute[75356]:       <serial>e3b4bf51-31c9-4811-8217-6e19e7a97957</serial>
Nov 29 20:21:09 user nova-compute[75356]:     </disk>
Nov 29 20:21:09 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:21:09 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:21:09 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk.rescue"/>
Nov 29 20:21:09 user nova-compute[75356]:       <target dev="vdc" bus="virtio"/>
Nov 29 20:21:09 user nova-compute[75356]:       <boot order="1"/>
Nov 29 20:21:09 user nova-compute[75356]:     </disk>
Nov 29 20:21:09 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:21:09 user nova-compute[75356]:       <mac address="fa:16:3e:6b:b2:4e"/>
Nov 29 20:21:09 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:21:09 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:21:09 user nova-compute[75356]:       <target dev="tapd6ec4756-3f"/>
Nov 29 20:21:09 user nova-compute[75356]:     </interface>
Nov 29 20:21:09 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:21:09 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/console.log" append="off"/>
Nov 29 20:21:09 user nova-compute[75356]:     </serial>
Nov 29 20:21:09 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:21:09 user nova-compute[75356]:     <video>
Nov 29 20:21:09 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:21:09 user nova-compute[75356]:     </video>
Nov 29 20:21:09 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:21:09 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:21:09 user nova-compute[75356]:     </rng>
Nov 29 20:21:09 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:21:09 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:21:09 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:21:09 user nova-compute[75356]:     </memballoon>
Nov 29 20:21:09 user nova-compute[75356]:   </devices>
Nov 29 20:21:09 user nova-compute[75356]: </domain>
Nov 29 20:21:09 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:21:09 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Instance destroyed successfully.
Nov 29 20:21:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] No VIF found with MAC fa:16:3e:6b:b2:4e, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:21:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] No VIF found with MAC fa:16:3e:b0:e6:d6, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:21:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-940bfb26-45d7-4be1-a3ad-241601f1b1da tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.190s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:10 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Successfully updated port: bd24c38c-a857-4b18-9d9b-55f692288c5f {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:21:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "refresh_cache-3584b853-567c-4dd2-ae4f-3ff074074137" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:21:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquired lock "refresh_cache-3584b853-567c-4dd2-ae4f-3ff074074137" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:21:10 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:21:10 user nova-compute[75356]: DEBUG nova.compute.manager [req-e625f831-1f82-4b52-9be6-1140c4b38b1f req-73b5d86e-eb94-4eef-8907-9f83472229c8 service nova] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Received event network-changed-bd24c38c-a857-4b18-9d9b-55f692288c5f {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:21:10 user nova-compute[75356]: DEBUG nova.compute.manager [req-e625f831-1f82-4b52-9be6-1140c4b38b1f req-73b5d86e-eb94-4eef-8907-9f83472229c8 service nova] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Refreshing instance network info cache due to event network-changed-bd24c38c-a857-4b18-9d9b-55f692288c5f. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:21:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e625f831-1f82-4b52-9be6-1140c4b38b1f req-73b5d86e-eb94-4eef-8907-9f83472229c8 service nova] Acquiring lock "refresh_cache-3584b853-567c-4dd2-ae4f-3ff074074137" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:21:10 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Updating instance_info_cache with network_info: [{"id": "bd24c38c-a857-4b18-9d9b-55f692288c5f", "address": "fa:16:3e:db:49:9b", "network": {"id": "c1768664-edc2-4213-80e3-64f7600eeb75", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688549704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85535b509efe4dbb81c372f9031faac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd24c38c-a8", "ovs_interfaceid": "bd24c38c-a857-4b18-9d9b-55f692288c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Releasing lock "refresh_cache-3584b853-567c-4dd2-ae4f-3ff074074137" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Instance network_info: |[{"id": "bd24c38c-a857-4b18-9d9b-55f692288c5f", "address": "fa:16:3e:db:49:9b", "network": {"id": "c1768664-edc2-4213-80e3-64f7600eeb75", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688549704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85535b509efe4dbb81c372f9031faac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd24c38c-a8", "ovs_interfaceid": "bd24c38c-a857-4b18-9d9b-55f692288c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e625f831-1f82-4b52-9be6-1140c4b38b1f req-73b5d86e-eb94-4eef-8907-9f83472229c8 service nova] Acquired lock "refresh_cache-3584b853-567c-4dd2-ae4f-3ff074074137" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.network.neutron [req-e625f831-1f82-4b52-9be6-1140c4b38b1f req-73b5d86e-eb94-4eef-8907-9f83472229c8 service nova] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Refreshing network info cache for port bd24c38c-a857-4b18-9d9b-55f692288c5f {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Start _get_guest_xml network_info=[{"id": "bd24c38c-a857-4b18-9d9b-55f692288c5f", "address": "fa:16:3e:db:49:9b", "network": {"id": "c1768664-edc2-4213-80e3-64f7600eeb75", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688549704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85535b509efe4dbb81c372f9031faac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd24c38c-a8", "ovs_interfaceid": "bd24c38c-a857-4b18-9d9b-55f692288c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:21:11 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:21:11 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:21:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1086938846',display_name='tempest-VolumesSnapshotTestJSON-instance-1086938846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1086938846',id=16,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV7S9osvaBvhuweeuKkdxH56jbjNcEBHmb6gaSr6ReHMEwa0LcCct9HZb53jwXecv/95RLtWmtafJlcPGg4YAjJR7p1zPQiTyBPWvt+xxx286V7nz+04ZF4Nk+AM/ir3w==',key_name='tempest-keypair-1838781217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85535b509efe4dbb81c372f9031faac0',ramdisk_id='',reservation_id='r-tcg1c5m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-740377086',owner_user_name='tempest-VolumesSnapshotTestJSON-740377086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:21:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc9deaf0a28f4afaad9e42ecc448a23d',uuid=3584b853-567c-4dd2-ae4f-3ff074074137,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd24c38c-a857-4b18-9d9b-55f692288c5f", "address": "fa:16:3e:db:49:9b", "network": {"id": "c1768664-edc2-4213-80e3-64f7600eeb75", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688549704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85535b509efe4dbb81c372f9031faac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd24c38c-a8", "ovs_interfaceid": "bd24c38c-a857-4b18-9d9b-55f692288c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Converting VIF {"id": "bd24c38c-a857-4b18-9d9b-55f692288c5f", "address": "fa:16:3e:db:49:9b", "network": {"id": "c1768664-edc2-4213-80e3-64f7600eeb75", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688549704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85535b509efe4dbb81c372f9031faac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd24c38c-a8", "ovs_interfaceid": "bd24c38c-a857-4b18-9d9b-55f692288c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:49:9b,bridge_name='br-int',has_traffic_filtering=True,id=bd24c38c-a857-4b18-9d9b-55f692288c5f,network=Network(c1768664-edc2-4213-80e3-64f7600eeb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd24c38c-a8') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.objects.instance [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lazy-loading 'pci_devices' on Instance uuid 3584b853-567c-4dd2-ae4f-3ff074074137 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:21:11 user nova-compute[75356]:   <uuid>3584b853-567c-4dd2-ae4f-3ff074074137</uuid>
Nov 29 20:21:11 user nova-compute[75356]:   <name>instance-00000010</name>
Nov 29 20:21:11 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:21:11 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:21:11 user nova-compute[75356]:   <metadata>
Nov 29 20:21:11 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:21:11 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:21:11 user nova-compute[75356]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1086938846</nova:name>
Nov 29 20:21:11 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:21:11</nova:creationTime>
Nov 29 20:21:11 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:21:11 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:21:11 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:21:11 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:21:11 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:21:11 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:21:11 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:21:11 user nova-compute[75356]:       <nova:owner>
Nov 29 20:21:11 user nova-compute[75356]:         <nova:user uuid="dc9deaf0a28f4afaad9e42ecc448a23d">tempest-VolumesSnapshotTestJSON-740377086-project-member</nova:user>
Nov 29 20:21:11 user nova-compute[75356]:         <nova:project uuid="85535b509efe4dbb81c372f9031faac0">tempest-VolumesSnapshotTestJSON-740377086</nova:project>
Nov 29 20:21:11 user nova-compute[75356]:       </nova:owner>
Nov 29 20:21:11 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:21:11 user nova-compute[75356]:       <nova:ports>
Nov 29 20:21:11 user nova-compute[75356]:         <nova:port uuid="bd24c38c-a857-4b18-9d9b-55f692288c5f">
Nov 29 20:21:11 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 20:21:11 user nova-compute[75356]:         </nova:port>
Nov 29 20:21:11 user nova-compute[75356]:       </nova:ports>
Nov 29 20:21:11 user nova-compute[75356]:     </nova:instance>
Nov 29 20:21:11 user nova-compute[75356]:   </metadata>
Nov 29 20:21:11 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:21:11 user nova-compute[75356]:     <system>
Nov 29 20:21:11 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:21:11 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:21:11 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:21:11 user nova-compute[75356]:       <entry name="serial">3584b853-567c-4dd2-ae4f-3ff074074137</entry>
Nov 29 20:21:11 user nova-compute[75356]:       <entry name="uuid">3584b853-567c-4dd2-ae4f-3ff074074137</entry>
Nov 29 20:21:11 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:21:11 user nova-compute[75356]:     </system>
Nov 29 20:21:11 user nova-compute[75356]:   </sysinfo>
Nov 29 20:21:11 user nova-compute[75356]:   <os>
Nov 29 20:21:11 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:21:11 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:21:11 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:21:11 user nova-compute[75356]:   </os>
Nov 29 20:21:11 user nova-compute[75356]:   <features>
Nov 29 20:21:11 user nova-compute[75356]:     <acpi/>
Nov 29 20:21:11 user nova-compute[75356]:     <apic/>
Nov 29 20:21:11 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:21:11 user nova-compute[75356]:   </features>
Nov 29 20:21:11 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:21:11 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:21:11 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:21:11 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:21:11 user nova-compute[75356]:   </clock>
Nov 29 20:21:11 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:21:11 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:21:11 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:21:11 user nova-compute[75356]:   </cpu>
Nov 29 20:21:11 user nova-compute[75356]:   <devices>
Nov 29 20:21:11 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:21:11 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:21:11 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/disk"/>
Nov 29 20:21:11 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:21:11 user nova-compute[75356]:     </disk>
Nov 29 20:21:11 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:21:11 user nova-compute[75356]:       <mac address="fa:16:3e:db:49:9b"/>
Nov 29 20:21:11 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:21:11 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:21:11 user nova-compute[75356]:       <target dev="tapbd24c38c-a8"/>
Nov 29 20:21:11 user nova-compute[75356]:     </interface>
Nov 29 20:21:11 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:21:11 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/console.log" append="off"/>
Nov 29 20:21:11 user nova-compute[75356]:     </serial>
Nov 29 20:21:11 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:21:11 user nova-compute[75356]:     <video>
Nov 29 20:21:11 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:21:11 user nova-compute[75356]:     </video>
Nov 29 20:21:11 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:21:11 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:21:11 user nova-compute[75356]:     </rng>
Nov 29 20:21:11 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:21:11 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:21:11 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:21:11 user nova-compute[75356]:     </memballoon>
Nov 29 20:21:11 user nova-compute[75356]:   </devices>
Nov 29 20:21:11 user nova-compute[75356]: </domain>
Nov 29 20:21:11 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:21:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1086938846',display_name='tempest-VolumesSnapshotTestJSON-instance-1086938846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1086938846',id=16,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV7S9osvaBvhuweeuKkdxH56jbjNcEBHmb6gaSr6ReHMEwa0LcCct9HZb53jwXecv/95RLtWmtafJlcPGg4YAjJR7p1zPQiTyBPWvt+xxx286V7nz+04ZF4Nk+AM/ir3w==',key_name='tempest-keypair-1838781217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85535b509efe4dbb81c372f9031faac0',ramdisk_id='',reservation_id='r-tcg1c5m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-740377086',owner_user_name='tempest-VolumesSnapshotTestJSON-740377086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:21:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc9deaf0a28f4afaad9e42ecc448a23d',uuid=3584b853-567c-4dd2-ae4f-3ff074074137,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd24c38c-a857-4b18-9d9b-55f692288c5f", "address": "fa:16:3e:db:49:9b", "network": {"id": "c1768664-edc2-4213-80e3-64f7600eeb75", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688549704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85535b509efe4dbb81c372f9031faac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd24c38c-a8", "ovs_interfaceid": "bd24c38c-a857-4b18-9d9b-55f692288c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Converting VIF {"id": "bd24c38c-a857-4b18-9d9b-55f692288c5f", "address": "fa:16:3e:db:49:9b", "network": {"id": "c1768664-edc2-4213-80e3-64f7600eeb75", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688549704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85535b509efe4dbb81c372f9031faac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd24c38c-a8", "ovs_interfaceid": "bd24c38c-a857-4b18-9d9b-55f692288c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:49:9b,bridge_name='br-int',has_traffic_filtering=True,id=bd24c38c-a857-4b18-9d9b-55f692288c5f,network=Network(c1768664-edc2-4213-80e3-64f7600eeb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd24c38c-a8') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG os_vif [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:49:9b,bridge_name='br-int',has_traffic_filtering=True,id=bd24c38c-a857-4b18-9d9b-55f692288c5f,network=Network(c1768664-edc2-4213-80e3-64f7600eeb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd24c38c-a8') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6061f2de-1a45-5d42-b6ea-3e490815671f', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd24c38c-a8, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd24c38c-a8, col_values=(('qos', UUID('64512a0b-1ada-435a-81e2-be9ccdc64ed2')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd24c38c-a8, col_values=(('external_ids', {'iface-id': 'bd24c38c-a857-4b18-9d9b-55f692288c5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:49:9b', 'vm-uuid': '3584b853-567c-4dd2-ae4f-3ff074074137'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:11 user nova-compute[75356]: INFO os_vif [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:49:9b,bridge_name='br-int',has_traffic_filtering=True,id=bd24c38c-a857-4b18-9d9b-55f692288c5f,network=Network(c1768664-edc2-4213-80e3-64f7600eeb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd24c38c-a8')
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] No VIF found with MAC fa:16:3e:db:49:9b, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.compute.manager [req-ec9781d1-c1b9-4d06-851b-6becb4892d7b req-ed078863-9afb-42b7-85c6-44411333c7ac service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received event network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ec9781d1-c1b9-4d06-851b-6becb4892d7b req-ed078863-9afb-42b7-85c6-44411333c7ac service nova] Acquiring lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ec9781d1-c1b9-4d06-851b-6becb4892d7b req-ed078863-9afb-42b7-85c6-44411333c7ac service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ec9781d1-c1b9-4d06-851b-6becb4892d7b req-ed078863-9afb-42b7-85c6-44411333c7ac service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:11 user nova-compute[75356]: DEBUG nova.compute.manager [req-ec9781d1-c1b9-4d06-851b-6becb4892d7b req-ed078863-9afb-42b7-85c6-44411333c7ac service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] No waiting events found dispatching network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:21:11 user nova-compute[75356]: WARNING nova.compute.manager [req-ec9781d1-c1b9-4d06-851b-6becb4892d7b req-ed078863-9afb-42b7-85c6-44411333c7ac service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received unexpected event network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e for instance with vm_state active and task_state rescuing.
Nov 29 20:21:12 user nova-compute[75356]: DEBUG nova.network.neutron [req-e625f831-1f82-4b52-9be6-1140c4b38b1f req-73b5d86e-eb94-4eef-8907-9f83472229c8 service nova] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Updated VIF entry in instance network info cache for port bd24c38c-a857-4b18-9d9b-55f692288c5f. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:21:12 user nova-compute[75356]: DEBUG nova.network.neutron [req-e625f831-1f82-4b52-9be6-1140c4b38b1f req-73b5d86e-eb94-4eef-8907-9f83472229c8 service nova] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Updating instance_info_cache with network_info: [{"id": "bd24c38c-a857-4b18-9d9b-55f692288c5f", "address": "fa:16:3e:db:49:9b", "network": {"id": "c1768664-edc2-4213-80e3-64f7600eeb75", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688549704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85535b509efe4dbb81c372f9031faac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd24c38c-a8", "ovs_interfaceid": "bd24c38c-a857-4b18-9d9b-55f692288c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:21:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e625f831-1f82-4b52-9be6-1140c4b38b1f req-73b5d86e-eb94-4eef-8907-9f83472229c8 service nova] Releasing lock "refresh_cache-3584b853-567c-4dd2-ae4f-3ff074074137" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:21:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:13 user nova-compute[75356]: DEBUG nova.compute.manager [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Stashing vm_state: active {{(pid=75356) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 29 20:21:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:21:13 user nova-compute[75356]: INFO nova.compute.claims [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Claim successful on node user
Nov 29 20:21:14 user nova-compute[75356]: DEBUG nova.compute.manager [req-a17a1906-818f-4ac5-9597-796ea015fd27 req-4a88d258-4608-4d2d-98b3-8581d98e4fce service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received event network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:21:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a17a1906-818f-4ac5-9597-796ea015fd27 req-4a88d258-4608-4d2d-98b3-8581d98e4fce service nova] Acquiring lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a17a1906-818f-4ac5-9597-796ea015fd27 req-4a88d258-4608-4d2d-98b3-8581d98e4fce service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a17a1906-818f-4ac5-9597-796ea015fd27 req-4a88d258-4608-4d2d-98b3-8581d98e4fce service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:14 user nova-compute[75356]: DEBUG nova.compute.manager [req-a17a1906-818f-4ac5-9597-796ea015fd27 req-4a88d258-4608-4d2d-98b3-8581d98e4fce service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] No waiting events found dispatching network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:21:14 user nova-compute[75356]: WARNING nova.compute.manager [req-a17a1906-818f-4ac5-9597-796ea015fd27 req-4a88d258-4608-4d2d-98b3-8581d98e4fce service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received unexpected event network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e for instance with vm_state active and task_state rescuing.
Nov 29 20:21:14 user nova-compute[75356]: INFO nova.compute.resource_tracker [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Updating resource usage from migration a3c2ad02-b4f9-4432-b3c4-eed1ba5b1b92
Nov 29 20:21:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:14 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:21:14 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:21:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.922s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:14 user nova-compute[75356]: INFO nova.compute.manager [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Migrating
Nov 29 20:21:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:21:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:21:14 user nova-compute[75356]: INFO nova.compute.rpcapi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 29 20:21:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:21:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:21:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquired lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:21:14 user nova-compute[75356]: DEBUG nova.network.neutron [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:21:15 user nova-compute[75356]: DEBUG nova.network.neutron [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Updating instance_info_cache with network_info: [{"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:21:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Releasing lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:21:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-b09b6fe2-fc96-4ad0-8bcc-695b3372b578 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:21:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Starting migrate_disk_and_power_off {{(pid=75356) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 29 20:21:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:21:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:21:15 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Instance spawned successfully.
Nov 29 20:21:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-11501e02-6cd7-4377-913c-e484198715a6 req-5f39bd20-3f9f-4813-bf07-4a4853f133d1 service nova] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Received event network-vif-plugged-bd24c38c-a857-4b18-9d9b-55f692288c5f {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-11501e02-6cd7-4377-913c-e484198715a6 req-5f39bd20-3f9f-4813-bf07-4a4853f133d1 service nova] Acquiring lock "3584b853-567c-4dd2-ae4f-3ff074074137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-11501e02-6cd7-4377-913c-e484198715a6 req-5f39bd20-3f9f-4813-bf07-4a4853f133d1 service nova] Lock "3584b853-567c-4dd2-ae4f-3ff074074137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-11501e02-6cd7-4377-913c-e484198715a6 req-5f39bd20-3f9f-4813-bf07-4a4853f133d1 service nova] Lock "3584b853-567c-4dd2-ae4f-3ff074074137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-11501e02-6cd7-4377-913c-e484198715a6 req-5f39bd20-3f9f-4813-bf07-4a4853f133d1 service nova] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] No waiting events found dispatching network-vif-plugged-bd24c38c-a857-4b18-9d9b-55f692288c5f {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:21:16 user nova-compute[75356]: WARNING nova.compute.manager [req-11501e02-6cd7-4377-913c-e484198715a6 req-5f39bd20-3f9f-4813-bf07-4a4853f133d1 service nova] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Received unexpected event network-vif-plugged-bd24c38c-a857-4b18-9d9b-55f692288c5f for instance with vm_state building and task_state spawning.
Nov 29 20:21:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-11501e02-6cd7-4377-913c-e484198715a6 req-5f39bd20-3f9f-4813-bf07-4a4853f133d1 service nova] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Received event network-vif-plugged-bd24c38c-a857-4b18-9d9b-55f692288c5f {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-11501e02-6cd7-4377-913c-e484198715a6 req-5f39bd20-3f9f-4813-bf07-4a4853f133d1 service nova] Acquiring lock "3584b853-567c-4dd2-ae4f-3ff074074137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-11501e02-6cd7-4377-913c-e484198715a6 req-5f39bd20-3f9f-4813-bf07-4a4853f133d1 service nova] Lock "3584b853-567c-4dd2-ae4f-3ff074074137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-11501e02-6cd7-4377-913c-e484198715a6 req-5f39bd20-3f9f-4813-bf07-4a4853f133d1 service nova] Lock "3584b853-567c-4dd2-ae4f-3ff074074137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-11501e02-6cd7-4377-913c-e484198715a6 req-5f39bd20-3f9f-4813-bf07-4a4853f133d1 service nova] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] No waiting events found dispatching network-vif-plugged-bd24c38c-a857-4b18-9d9b-55f692288c5f {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:21:16 user nova-compute[75356]: WARNING nova.compute.manager [req-11501e02-6cd7-4377-913c-e484198715a6 req-5f39bd20-3f9f-4813-bf07-4a4853f133d1 service nova] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Received unexpected event network-vif-plugged-bd24c38c-a857-4b18-9d9b-55f692288c5f for instance with vm_state building and task_state spawning.
Nov 29 20:21:16 user nova-compute[75356]: INFO nova.compute.manager [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Took 7.51 seconds to spawn the instance on the hypervisor.
Nov 29 20:21:16 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-420e9e52-5140-49e8-a612-5044816bdcec req-86d3c61e-0a85-417d-97fb-cfd3b3ec06e8 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received event network-vif-unplugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-420e9e52-5140-49e8-a612-5044816bdcec req-86d3c61e-0a85-417d-97fb-cfd3b3ec06e8 service nova] Acquiring lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-420e9e52-5140-49e8-a612-5044816bdcec req-86d3c61e-0a85-417d-97fb-cfd3b3ec06e8 service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-420e9e52-5140-49e8-a612-5044816bdcec req-86d3c61e-0a85-417d-97fb-cfd3b3ec06e8 service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-420e9e52-5140-49e8-a612-5044816bdcec req-86d3c61e-0a85-417d-97fb-cfd3b3ec06e8 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] No waiting events found dispatching network-vif-unplugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:21:16 user nova-compute[75356]: WARNING nova.compute.manager [req-420e9e52-5140-49e8-a612-5044816bdcec req-86d3c61e-0a85-417d-97fb-cfd3b3ec06e8 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received unexpected event network-vif-unplugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e for instance with vm_state active and task_state resize_migrating.
Nov 29 20:21:16 user nova-compute[75356]: INFO nova.compute.manager [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Took 8.92 seconds to build instance.
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ef1e6821-2a02-4e2f-ade0-6a7543aae73a tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "3584b853-567c-4dd2-ae4f-3ff074074137" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.060s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:16 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Instance destroyed successfully.
Nov 29 20:21:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2075887638',display_name='tempest-ServerActionsTestOtherB-server-2075887638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2075887638',id=5,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqmwjesnBZKKmMOP1nU5mLLaxgxAYrWKpY6AKu2j/L1exH/XrbvTGFuJ5hCGjIGc6yFau1HY0D/HH/XuWjDf7bDrvpfXRmVeDF3iS6kjnnvyZ4TUUiMwhiV4HxFj8NX1w==',key_name='tempest-keypair-1339068574',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:17:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='19fa4a7548454fc4a29a625b0c819c9c',ramdisk_id='',reservation_id='r-pzj88ta7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-403173210',owner_user_name='tempest-ServerActionsTestOtherB-403173210-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e5a895cde3741d0a48cb06922ad80f8',uuid=96cbbbdb-e1cc-49da-9a9f-5b83031b235b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1795107623-network", "vif_mac": "fa:16:3e:b0:e6:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Converting VIF {"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1795107623-network", "vif_mac": "fa:16:3e:b0:e6:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:e6:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf5b9476-92db-4a94-bcdd-485ba68a4d1e,network=Network(d5185e2d-1e16-408d-91cf-3c494b84cd52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5b9476-92') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG os_vif [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:e6:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf5b9476-92db-4a94-bcdd-485ba68a4d1e,network=Network(d5185e2d-1e16-408d-91cf-3c494b84cd52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5b9476-92') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf5b9476-92, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dfb0a6bb-e851-4fc8-9338-fd890a0e8255) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:21:16 user nova-compute[75356]: INFO os_vif [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:e6:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf5b9476-92db-4a94-bcdd-485ba68a4d1e,network=Network(d5185e2d-1e16-408d-91cf-3c494b84cd52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5b9476-92')
Nov 29 20:21:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKteoRvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:21:16 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:21:16 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b38eeca-8690-4a13-b0b6-46659a470a61]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:21:16 user nova-compute[75356]: No targets found.
Nov 29 20:21:16 user nova-compute[75356]: iSNS:
Nov 29 20:21:16 user nova-compute[75356]: No targets found.
Nov 29 20:21:16 user nova-compute[75356]: STATIC:
Nov 29 20:21:16 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7
Nov 29 20:21:16 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:21:16 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:21:16 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:21:16 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:21:16 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:21:16 user nova-compute[75356]: FIRMWARE:
Nov 29 20:21:16 user nova-compute[75356]: No targets found.
Nov 29 20:21:16 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:21:16 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:21:16 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e23614-2ec6-42ac-ac72-8ab510a0fd4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b071305c-056f-4350-a65d-44a435f92feb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:21:16 user nova-compute[75356]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:21:16 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:21:16 user nova-compute[75356]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:21:16 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e443ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7'): ({'sdc'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Removing single pathed devices sdc {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[814c2adb-24b5-4442-8a8a-c9f938dab187]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8a56d1-feb4-44e9-8cf4-b8f543336f46]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Flushing IO for device /dev/sdc {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e4ec80-1ac3-45e4-8ae6-de08cd95b4c8]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef46605-30c2-492a-8abb-12f19b59fea8]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[56780b41-450a-4458-b546-04e7289191ce]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcefaf9-0d46-416f-9c05-057ab9165250]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260]
Nov 29 20:21:17 user nova-compute[75356]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260] successful.
Nov 29 20:21:17 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a900ff59-0ee1-4aef-a8af-299625361100]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:21:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] <== disconnect_volume: return (358ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:21:17 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:21:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:17 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:21:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b_resize/disk /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] CMD "cp -r /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b_resize/disk /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk" returned: 0 in 0.423s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b_resize/disk.info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk.info {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] CMD "cp -r /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b_resize/disk.info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk.info" returned: 0 in 0.034s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-f7b67cfc-a6c5-4e5b-8633-6c5b40988b39 req-bccf639a-971c-44f0-8e30-15fad077c597 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received event network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:21:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f7b67cfc-a6c5-4e5b-8633-6c5b40988b39 req-bccf639a-971c-44f0-8e30-15fad077c597 service nova] Acquiring lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f7b67cfc-a6c5-4e5b-8633-6c5b40988b39 req-bccf639a-971c-44f0-8e30-15fad077c597 service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f7b67cfc-a6c5-4e5b-8633-6c5b40988b39 req-bccf639a-971c-44f0-8e30-15fad077c597 service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-f7b67cfc-a6c5-4e5b-8633-6c5b40988b39 req-bccf639a-971c-44f0-8e30-15fad077c597 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] No waiting events found dispatching network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:21:18 user nova-compute[75356]: WARNING nova.compute.manager [req-f7b67cfc-a6c5-4e5b-8633-6c5b40988b39 req-bccf639a-971c-44f0-8e30-15fad077c597 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received unexpected event network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e for instance with vm_state active and task_state resize_migrating.
Nov 29 20:21:19 user nova-compute[75356]: DEBUG nova.network.neutron [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Port bf5b9476-92db-4a94-bcdd-485ba68a4d1e binding to destination host user is already ACTIVE {{(pid=75356) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 20:21:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:21:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquired lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:21:19 user nova-compute[75356]: DEBUG nova.network.neutron [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:21:19 user nova-compute[75356]: DEBUG nova.network.neutron [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Updating instance_info_cache with network_info: [{"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:21:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Releasing lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:21:20 user nova-compute[75356]: DEBUG os_brick.utils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:21:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:20 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[639144d7-5140-4837-a712-07c82d85f3ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:20 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d19bec7-00d5-4935-b20f-60cf9aca5f35]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:20 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9302a21-a523-49d3-8a2e-adf7c7fdeb26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:20 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bb1e11-9955-455d-be48-ecd76a04f020]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:21:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:21:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:21:20 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:21:20 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e22de4-d0e4-4814-a805-860c974b5989]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:21:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:21:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:21:20 user nova-compute[75356]: DEBUG os_brick.utils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:21:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Starting finish_migration {{(pid=75356) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 29 20:21:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Instance directory exists: not creating {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 20:21:29 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Creating image(s)
Nov 29 20:21:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.224s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:29 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk. size=21474836480 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:21:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk 21474836480 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk 21474836480" returned: 0 in 0.181s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Did not create local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Ensure instance console log exists: /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Start _get_guest_xml network_info=[{"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1795107623-network", "vif_mac": "fa:16:3e:b0:e6:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKteoRvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '96cbbbdb-e1cc-49da-9a9f-5b83031b235b', 'attached_at': '2023-11-29T20:21:29.000000', 'detached_at': '', 'volume_id': '4a07443e-a368-43b5-90b0-e96c00dc86a7', 'serial': '4a07443e-a368-43b5-90b0-e96c00dc86a7'}, 'attachment_id': 'f918e338-7a0c-4058-8da8-10fbfc0f20df', 'volume_type': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:21:30 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:21:30 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:21:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKteoRvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:21:30 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:21:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:21:30 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:21:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:21:30 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5ec962-8eb5-4ed9-ad12-374ec74df282]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:21:30 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[64af06c9-5c19-4afa-875b-ed577b5d84ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7] added
Nov 29 20:21:30 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[60342661-5d92-4fd8-b1a9-0079939868da]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ebb5ae-f437-4449-9e70-32ce2745efa0]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wKteoRvT {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wKteoRvT" returned: 0 in 0.053s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1432dcf-c7b2-4009-b804-72f3e0f706af]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wKteoRvT'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef57916e-d687-40da-8be8-0f555cdb47fe]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bb7914-3ab8-4e8b-926e-aa725fcfacee]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:21:30 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:21:30 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.160s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a543f3-c223-4abc-920b-57c93034190a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260]
Nov 29 20:21:30 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260] successful.
Nov 29 20:21:30 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe20ed1c-a9ee-4799-b87a-12fbdcb02278]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbc6c34-a218-4d0d-9543-443886b38bbf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:21:30 user nova-compute[75356]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:21:30 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:21:30 user nova-compute[75356]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:21:30 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.496s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c97ba4e-cab0-416f-a927-d37e50a42f4d]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:30 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: None {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKteoRvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.532s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] <== connect_volume: return (1533ms) {'type': 'block', 'scsi_wwn': '26238613931613235', 'path': '/dev/sdc'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238613931613235', 'path': '/dev/sdc'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2075887638',display_name='tempest-ServerActionsTestOtherB-server-2075887638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2075887638',id=5,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqmwjesnBZKKmMOP1nU5mLLaxgxAYrWKpY6AKu2j/L1exH/XrbvTGFuJ5hCGjIGc6yFau1HY0D/HH/XuWjDf7bDrvpfXRmVeDF3iS6kjnnvyZ4TUUiMwhiV4HxFj8NX1w==',key_name='tempest-keypair-1339068574',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:17:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='19fa4a7548454fc4a29a625b0c819c9c',ramdisk_id='',reservation_id='r-pzj88ta7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-403173210',owner_user_name='tempest-ServerActionsTestOtherB-403173210-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:21:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e5a895cde3741d0a48cb06922ad80f8',uuid=96cbbbdb-e1cc-49da-9a9f-5b83031b235b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1795107623-network", "vif_mac": "fa:16:3e:b0:e6:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Converting VIF {"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1795107623-network", "vif_mac": "fa:16:3e:b0:e6:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:e6:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf5b9476-92db-4a94-bcdd-485ba68a4d1e,network=Network(d5185e2d-1e16-408d-91cf-3c494b84cd52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5b9476-92') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:21:31 user nova-compute[75356]:   <uuid>96cbbbdb-e1cc-49da-9a9f-5b83031b235b</uuid>
Nov 29 20:21:31 user nova-compute[75356]:   <name>instance-00000005</name>
Nov 29 20:21:31 user nova-compute[75356]:   <memory>2097152</memory>
Nov 29 20:21:31 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:21:31 user nova-compute[75356]:   <metadata>
Nov 29 20:21:31 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:21:31 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:21:31 user nova-compute[75356]:       <nova:name>tempest-ServerActionsTestOtherB-server-2075887638</nova:name>
Nov 29 20:21:31 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:21:30</nova:creationTime>
Nov 29 20:21:31 user nova-compute[75356]:       <nova:flavor name="m1.small">
Nov 29 20:21:31 user nova-compute[75356]:         <nova:memory>2048</nova:memory>
Nov 29 20:21:31 user nova-compute[75356]:         <nova:disk>20</nova:disk>
Nov 29 20:21:31 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:21:31 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:21:31 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:21:31 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:21:31 user nova-compute[75356]:       <nova:owner>
Nov 29 20:21:31 user nova-compute[75356]:         <nova:user uuid="9e5a895cde3741d0a48cb06922ad80f8">tempest-ServerActionsTestOtherB-403173210-project-member</nova:user>
Nov 29 20:21:31 user nova-compute[75356]:         <nova:project uuid="19fa4a7548454fc4a29a625b0c819c9c">tempest-ServerActionsTestOtherB-403173210</nova:project>
Nov 29 20:21:31 user nova-compute[75356]:       </nova:owner>
Nov 29 20:21:31 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:21:31 user nova-compute[75356]:       <nova:ports>
Nov 29 20:21:31 user nova-compute[75356]:         <nova:port uuid="bf5b9476-92db-4a94-bcdd-485ba68a4d1e">
Nov 29 20:21:31 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 20:21:31 user nova-compute[75356]:         </nova:port>
Nov 29 20:21:31 user nova-compute[75356]:       </nova:ports>
Nov 29 20:21:31 user nova-compute[75356]:     </nova:instance>
Nov 29 20:21:31 user nova-compute[75356]:   </metadata>
Nov 29 20:21:31 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:21:31 user nova-compute[75356]:     <system>
Nov 29 20:21:31 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:21:31 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:21:31 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:21:31 user nova-compute[75356]:       <entry name="serial">96cbbbdb-e1cc-49da-9a9f-5b83031b235b</entry>
Nov 29 20:21:31 user nova-compute[75356]:       <entry name="uuid">96cbbbdb-e1cc-49da-9a9f-5b83031b235b</entry>
Nov 29 20:21:31 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:21:31 user nova-compute[75356]:     </system>
Nov 29 20:21:31 user nova-compute[75356]:   </sysinfo>
Nov 29 20:21:31 user nova-compute[75356]:   <os>
Nov 29 20:21:31 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:21:31 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:21:31 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:21:31 user nova-compute[75356]:   </os>
Nov 29 20:21:31 user nova-compute[75356]:   <features>
Nov 29 20:21:31 user nova-compute[75356]:     <acpi/>
Nov 29 20:21:31 user nova-compute[75356]:     <apic/>
Nov 29 20:21:31 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:21:31 user nova-compute[75356]:   </features>
Nov 29 20:21:31 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:21:31 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:21:31 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:21:31 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:21:31 user nova-compute[75356]:   </clock>
Nov 29 20:21:31 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:21:31 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:21:31 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:21:31 user nova-compute[75356]:   </cpu>
Nov 29 20:21:31 user nova-compute[75356]:   <devices>
Nov 29 20:21:31 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:21:31 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:21:31 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk"/>
Nov 29 20:21:31 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:21:31 user nova-compute[75356]:     </disk>
Nov 29 20:21:31 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:21:31 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:21:31 user nova-compute[75356]:       <source dev="/dev/sdc"/>
Nov 29 20:21:31 user nova-compute[75356]:       <target dev="vdb" bus="virtio"/>
Nov 29 20:21:31 user nova-compute[75356]:       <serial>4a07443e-a368-43b5-90b0-e96c00dc86a7</serial>
Nov 29 20:21:31 user nova-compute[75356]:     </disk>
Nov 29 20:21:31 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:21:31 user nova-compute[75356]:       <mac address="fa:16:3e:b0:e6:d6"/>
Nov 29 20:21:31 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:21:31 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:21:31 user nova-compute[75356]:       <target dev="tapbf5b9476-92"/>
Nov 29 20:21:31 user nova-compute[75356]:     </interface>
Nov 29 20:21:31 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:21:31 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/console.log" append="off"/>
Nov 29 20:21:31 user nova-compute[75356]:     </serial>
Nov 29 20:21:31 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:21:31 user nova-compute[75356]:     <video>
Nov 29 20:21:31 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:21:31 user nova-compute[75356]:     </video>
Nov 29 20:21:31 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:21:31 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:21:31 user nova-compute[75356]:     </rng>
Nov 29 20:21:31 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:21:31 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:21:31 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:21:31 user nova-compute[75356]:     </memballoon>
Nov 29 20:21:31 user nova-compute[75356]:   </devices>
Nov 29 20:21:31 user nova-compute[75356]: </domain>
Nov 29 20:21:31 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2075887638',display_name='tempest-ServerActionsTestOtherB-server-2075887638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2075887638',id=5,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqmwjesnBZKKmMOP1nU5mLLaxgxAYrWKpY6AKu2j/L1exH/XrbvTGFuJ5hCGjIGc6yFau1HY0D/HH/XuWjDf7bDrvpfXRmVeDF3iS6kjnnvyZ4TUUiMwhiV4HxFj8NX1w==',key_name='tempest-keypair-1339068574',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:17:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='19fa4a7548454fc4a29a625b0c819c9c',ramdisk_id='',reservation_id='r-pzj88ta7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-403173210',owner_user_name='tempest-ServerActionsTestOtherB-403173210-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:21:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e5a895cde3741d0a48cb06922ad80f8',uuid=96cbbbdb-e1cc-49da-9a9f-5b83031b235b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1795107623-network", "vif_mac": "fa:16:3e:b0:e6:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Converting VIF {"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1795107623-network", "vif_mac": "fa:16:3e:b0:e6:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:e6:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf5b9476-92db-4a94-bcdd-485ba68a4d1e,network=Network(d5185e2d-1e16-408d-91cf-3c494b84cd52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5b9476-92') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG os_vif [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:e6:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf5b9476-92db-4a94-bcdd-485ba68a4d1e,network=Network(d5185e2d-1e16-408d-91cf-3c494b84cd52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5b9476-92') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c105df8-1b1c-5775-a139-20745adc70e0', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf5b9476-92, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf5b9476-92, col_values=(('qos', UUID('5bd3170f-6b25-4a7a-9fa7-e3c0c2e9bb7a')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf5b9476-92, col_values=(('external_ids', {'iface-id': 'bf5b9476-92db-4a94-bcdd-485ba68a4d1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:e6:d6', 'vm-uuid': '96cbbbdb-e1cc-49da-9a9f-5b83031b235b'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:21:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:31 user nova-compute[75356]: INFO os_vif [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:e6:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf5b9476-92db-4a94-bcdd-485ba68a4d1e,network=Network(d5185e2d-1e16-408d-91cf-3c494b84cd52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5b9476-92')
Nov 29 20:21:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:21:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:21:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] No VIF found with MAC fa:16:3e:b0:e6:d6, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:21:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:33 user nova-compute[75356]: DEBUG nova.compute.manager [req-d667ce58-9c83-4e34-8ce8-400bdad58edb req-8a9e702c-7489-4d04-998a-08ca1f923976 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received event network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:21:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d667ce58-9c83-4e34-8ce8-400bdad58edb req-8a9e702c-7489-4d04-998a-08ca1f923976 service nova] Acquiring lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d667ce58-9c83-4e34-8ce8-400bdad58edb req-8a9e702c-7489-4d04-998a-08ca1f923976 service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d667ce58-9c83-4e34-8ce8-400bdad58edb req-8a9e702c-7489-4d04-998a-08ca1f923976 service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:33 user nova-compute[75356]: DEBUG nova.compute.manager [req-d667ce58-9c83-4e34-8ce8-400bdad58edb req-8a9e702c-7489-4d04-998a-08ca1f923976 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] No waiting events found dispatching network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:21:33 user nova-compute[75356]: WARNING nova.compute.manager [req-d667ce58-9c83-4e34-8ce8-400bdad58edb req-8a9e702c-7489-4d04-998a-08ca1f923976 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received unexpected event network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e for instance with vm_state active and task_state resize_finish.
Nov 29 20:21:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:35 user nova-compute[75356]: DEBUG nova.compute.manager [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:21:35 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Instance running successfully.
Nov 29 20:21:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Failed to set time: agent not configured {{(pid=75356) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 29 20:21:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-50a913bf-3e72-4e94-8da1-d4570c0056e4 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] finish_migration finished successfully. {{(pid=75356) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 29 20:21:36 user nova-compute[75356]: DEBUG nova.compute.manager [req-86ea1a95-3be2-4125-b981-51cde4de1785 req-e9aae4dc-710a-4433-aec1-f4cb17a3b174 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received event network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:21:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-86ea1a95-3be2-4125-b981-51cde4de1785 req-e9aae4dc-710a-4433-aec1-f4cb17a3b174 service nova] Acquiring lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-86ea1a95-3be2-4125-b981-51cde4de1785 req-e9aae4dc-710a-4433-aec1-f4cb17a3b174 service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-86ea1a95-3be2-4125-b981-51cde4de1785 req-e9aae4dc-710a-4433-aec1-f4cb17a3b174 service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:36 user nova-compute[75356]: DEBUG nova.compute.manager [req-86ea1a95-3be2-4125-b981-51cde4de1785 req-e9aae4dc-710a-4433-aec1-f4cb17a3b174 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] No waiting events found dispatching network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:21:36 user nova-compute[75356]: WARNING nova.compute.manager [req-86ea1a95-3be2-4125-b981-51cde4de1785 req-e9aae4dc-710a-4433-aec1-f4cb17a3b174 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received unexpected event network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e for instance with vm_state active and task_state resize_finish.
Nov 29 20:21:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Acquiring lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:40 user nova-compute[75356]: DEBUG nova.compute.manager [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:21:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:40 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:21:40 user nova-compute[75356]: INFO nova.compute.claims [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Claim successful on node user
Nov 29 20:21:40 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:21:40 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:21:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:40 user nova-compute[75356]: DEBUG nova.compute.manager [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:21:40 user nova-compute[75356]: DEBUG nova.compute.manager [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:21:40 user nova-compute[75356]: DEBUG nova.network.neutron [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:21:40 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:21:40 user nova-compute[75356]: DEBUG nova.compute.manager [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:21:41 user nova-compute[75356]: DEBUG nova.policy [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61fe161c9d75442d9a189a35f78048f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca028c7723a1409e84ee22bbb14c3bc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:21:41 user nova-compute[75356]: DEBUG nova.compute.manager [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:21:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:21:41 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Creating image(s)
Nov 29 20:21:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "/opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "/opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.194s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.204s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk 1073741824" returned: 0 in 0.061s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.223s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:41 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:21:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:42 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Cannot resize image /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:21:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:21:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Ensure instance console log exists: /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:21:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:42 user nova-compute[75356]: DEBUG nova.network.neutron [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Successfully created port: dbd23e2b-e6d6-4942-9b2f-3db29d312a85 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:21:43 user nova-compute[75356]: DEBUG nova.network.neutron [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Successfully updated port: dbd23e2b-e6d6-4942-9b2f-3db29d312a85 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:21:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Acquiring lock "refresh_cache-0f9149e4-424b-42af-bd25-19d1cc7c0635" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:21:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Acquired lock "refresh_cache-0f9149e4-424b-42af-bd25-19d1cc7c0635" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:21:43 user nova-compute[75356]: DEBUG nova.network.neutron [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:21:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-e8647dcd-6fbe-48df-bcb5-6cc72b7234de req-02884fd2-6379-4442-8177-573f0c452748 service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Received event network-changed-dbd23e2b-e6d6-4942-9b2f-3db29d312a85 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:21:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-e8647dcd-6fbe-48df-bcb5-6cc72b7234de req-02884fd2-6379-4442-8177-573f0c452748 service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Refreshing instance network info cache due to event network-changed-dbd23e2b-e6d6-4942-9b2f-3db29d312a85. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:21:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e8647dcd-6fbe-48df-bcb5-6cc72b7234de req-02884fd2-6379-4442-8177-573f0c452748 service nova] Acquiring lock "refresh_cache-0f9149e4-424b-42af-bd25-19d1cc7c0635" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:21:43 user nova-compute[75356]: DEBUG nova.network.neutron [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.network.neutron [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Updating instance_info_cache with network_info: [{"id": "dbd23e2b-e6d6-4942-9b2f-3db29d312a85", "address": "fa:16:3e:b4:21:8a", "network": {"id": "19745e07-fd6f-4ae7-8f23-3000120764e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1773897841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca028c7723a1409e84ee22bbb14c3bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd23e2b-e6", "ovs_interfaceid": "dbd23e2b-e6d6-4942-9b2f-3db29d312a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Releasing lock "refresh_cache-0f9149e4-424b-42af-bd25-19d1cc7c0635" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.compute.manager [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Instance network_info: |[{"id": "dbd23e2b-e6d6-4942-9b2f-3db29d312a85", "address": "fa:16:3e:b4:21:8a", "network": {"id": "19745e07-fd6f-4ae7-8f23-3000120764e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1773897841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca028c7723a1409e84ee22bbb14c3bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd23e2b-e6", "ovs_interfaceid": "dbd23e2b-e6d6-4942-9b2f-3db29d312a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e8647dcd-6fbe-48df-bcb5-6cc72b7234de req-02884fd2-6379-4442-8177-573f0c452748 service nova] Acquired lock "refresh_cache-0f9149e4-424b-42af-bd25-19d1cc7c0635" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.network.neutron [req-e8647dcd-6fbe-48df-bcb5-6cc72b7234de req-02884fd2-6379-4442-8177-573f0c452748 service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Refreshing network info cache for port dbd23e2b-e6d6-4942-9b2f-3db29d312a85 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Start _get_guest_xml network_info=[{"id": "dbd23e2b-e6d6-4942-9b2f-3db29d312a85", "address": "fa:16:3e:b4:21:8a", "network": {"id": "19745e07-fd6f-4ae7-8f23-3000120764e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1773897841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca028c7723a1409e84ee22bbb14c3bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd23e2b-e6", "ovs_interfaceid": "dbd23e2b-e6d6-4942-9b2f-3db29d312a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:21:44 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:21:44 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:21:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-600507886',display_name='tempest-TestServerVolumeAttachmentScenario-server-600507886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-600507886',id=17,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFik+39RHiSL4lnSnsypkiiHCrlSUI6mwr3P2XGwxhEHae7mM8huI4DCIE8l+KE2H2ACBN/6+3P8B4lavm4NM1fjoh+DjffdY20pBmZ8644UeFbrp+JLCcMQuRIqSmp75Q==',key_name='tempest-keypair-1397786442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca028c7723a1409e84ee22bbb14c3bc1',ramdisk_id='',reservation_id='r-hfhp9ux6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1320914633',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1320914633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61fe161c9d75442d9a189a35f78048f8',uuid=0f9149e4-424b-42af-bd25-19d1cc7c0635,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbd23e2b-e6d6-4942-9b2f-3db29d312a85", "address": "fa:16:3e:b4:21:8a", "network": {"id": "19745e07-fd6f-4ae7-8f23-3000120764e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1773897841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca028c7723a1409e84ee22bbb14c3bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd23e2b-e6", "ovs_interfaceid": "dbd23e2b-e6d6-4942-9b2f-3db29d312a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Converting VIF {"id": "dbd23e2b-e6d6-4942-9b2f-3db29d312a85", "address": "fa:16:3e:b4:21:8a", "network": {"id": "19745e07-fd6f-4ae7-8f23-3000120764e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1773897841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca028c7723a1409e84ee22bbb14c3bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd23e2b-e6", "ovs_interfaceid": "dbd23e2b-e6d6-4942-9b2f-3db29d312a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:21:8a,bridge_name='br-int',has_traffic_filtering=True,id=dbd23e2b-e6d6-4942-9b2f-3db29d312a85,network=Network(19745e07-fd6f-4ae7-8f23-3000120764e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd23e2b-e6') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.objects.instance [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f9149e4-424b-42af-bd25-19d1cc7c0635 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:21:44 user nova-compute[75356]:   <uuid>0f9149e4-424b-42af-bd25-19d1cc7c0635</uuid>
Nov 29 20:21:44 user nova-compute[75356]:   <name>instance-00000011</name>
Nov 29 20:21:44 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:21:44 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:21:44 user nova-compute[75356]:   <metadata>
Nov 29 20:21:44 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:21:44 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:21:44 user nova-compute[75356]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-600507886</nova:name>
Nov 29 20:21:44 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:21:44</nova:creationTime>
Nov 29 20:21:44 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:21:44 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:21:44 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:21:44 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:21:44 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:21:44 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:21:44 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:21:44 user nova-compute[75356]:       <nova:owner>
Nov 29 20:21:44 user nova-compute[75356]:         <nova:user uuid="61fe161c9d75442d9a189a35f78048f8">tempest-TestServerVolumeAttachmentScenario-1320914633-project-member</nova:user>
Nov 29 20:21:44 user nova-compute[75356]:         <nova:project uuid="ca028c7723a1409e84ee22bbb14c3bc1">tempest-TestServerVolumeAttachmentScenario-1320914633</nova:project>
Nov 29 20:21:44 user nova-compute[75356]:       </nova:owner>
Nov 29 20:21:44 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:21:44 user nova-compute[75356]:       <nova:ports>
Nov 29 20:21:44 user nova-compute[75356]:         <nova:port uuid="dbd23e2b-e6d6-4942-9b2f-3db29d312a85">
Nov 29 20:21:44 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 20:21:44 user nova-compute[75356]:         </nova:port>
Nov 29 20:21:44 user nova-compute[75356]:       </nova:ports>
Nov 29 20:21:44 user nova-compute[75356]:     </nova:instance>
Nov 29 20:21:44 user nova-compute[75356]:   </metadata>
Nov 29 20:21:44 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:21:44 user nova-compute[75356]:     <system>
Nov 29 20:21:44 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:21:44 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:21:44 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:21:44 user nova-compute[75356]:       <entry name="serial">0f9149e4-424b-42af-bd25-19d1cc7c0635</entry>
Nov 29 20:21:44 user nova-compute[75356]:       <entry name="uuid">0f9149e4-424b-42af-bd25-19d1cc7c0635</entry>
Nov 29 20:21:44 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:21:44 user nova-compute[75356]:     </system>
Nov 29 20:21:44 user nova-compute[75356]:   </sysinfo>
Nov 29 20:21:44 user nova-compute[75356]:   <os>
Nov 29 20:21:44 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:21:44 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:21:44 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:21:44 user nova-compute[75356]:   </os>
Nov 29 20:21:44 user nova-compute[75356]:   <features>
Nov 29 20:21:44 user nova-compute[75356]:     <acpi/>
Nov 29 20:21:44 user nova-compute[75356]:     <apic/>
Nov 29 20:21:44 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:21:44 user nova-compute[75356]:   </features>
Nov 29 20:21:44 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:21:44 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:21:44 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:21:44 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:21:44 user nova-compute[75356]:   </clock>
Nov 29 20:21:44 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:21:44 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:21:44 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:21:44 user nova-compute[75356]:   </cpu>
Nov 29 20:21:44 user nova-compute[75356]:   <devices>
Nov 29 20:21:44 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:21:44 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:21:44 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk"/>
Nov 29 20:21:44 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:21:44 user nova-compute[75356]:     </disk>
Nov 29 20:21:44 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:21:44 user nova-compute[75356]:       <mac address="fa:16:3e:b4:21:8a"/>
Nov 29 20:21:44 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:21:44 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:21:44 user nova-compute[75356]:       <target dev="tapdbd23e2b-e6"/>
Nov 29 20:21:44 user nova-compute[75356]:     </interface>
Nov 29 20:21:44 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:21:44 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/console.log" append="off"/>
Nov 29 20:21:44 user nova-compute[75356]:     </serial>
Nov 29 20:21:44 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:21:44 user nova-compute[75356]:     <video>
Nov 29 20:21:44 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:21:44 user nova-compute[75356]:     </video>
Nov 29 20:21:44 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:21:44 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:21:44 user nova-compute[75356]:     </rng>
Nov 29 20:21:44 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:21:44 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:21:44 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:21:44 user nova-compute[75356]:     </memballoon>
Nov 29 20:21:44 user nova-compute[75356]:   </devices>
Nov 29 20:21:44 user nova-compute[75356]: </domain>
Nov 29 20:21:44 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:21:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-600507886',display_name='tempest-TestServerVolumeAttachmentScenario-server-600507886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-600507886',id=17,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFik+39RHiSL4lnSnsypkiiHCrlSUI6mwr3P2XGwxhEHae7mM8huI4DCIE8l+KE2H2ACBN/6+3P8B4lavm4NM1fjoh+DjffdY20pBmZ8644UeFbrp+JLCcMQuRIqSmp75Q==',key_name='tempest-keypair-1397786442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca028c7723a1409e84ee22bbb14c3bc1',ramdisk_id='',reservation_id='r-hfhp9ux6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1320914633',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1320914633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61fe161c9d75442d9a189a35f78048f8',uuid=0f9149e4-424b-42af-bd25-19d1cc7c0635,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbd23e2b-e6d6-4942-9b2f-3db29d312a85", "address": "fa:16:3e:b4:21:8a", "network": {"id": "19745e07-fd6f-4ae7-8f23-3000120764e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1773897841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca028c7723a1409e84ee22bbb14c3bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd23e2b-e6", "ovs_interfaceid": "dbd23e2b-e6d6-4942-9b2f-3db29d312a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Converting VIF {"id": "dbd23e2b-e6d6-4942-9b2f-3db29d312a85", "address": "fa:16:3e:b4:21:8a", "network": {"id": "19745e07-fd6f-4ae7-8f23-3000120764e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1773897841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca028c7723a1409e84ee22bbb14c3bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd23e2b-e6", "ovs_interfaceid": "dbd23e2b-e6d6-4942-9b2f-3db29d312a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:21:8a,bridge_name='br-int',has_traffic_filtering=True,id=dbd23e2b-e6d6-4942-9b2f-3db29d312a85,network=Network(19745e07-fd6f-4ae7-8f23-3000120764e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd23e2b-e6') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG os_vif [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:21:8a,bridge_name='br-int',has_traffic_filtering=True,id=dbd23e2b-e6d6-4942-9b2f-3db29d312a85,network=Network(19745e07-fd6f-4ae7-8f23-3000120764e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd23e2b-e6') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd7f20b1-b9ef-5940-b8b4-289e5b278cdf', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbd23e2b-e6, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdbd23e2b-e6, col_values=(('qos', UUID('da9e8ff7-94f4-47ca-ae7b-e069731c2e02')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdbd23e2b-e6, col_values=(('external_ids', {'iface-id': 'dbd23e2b-e6d6-4942-9b2f-3db29d312a85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:21:8a', 'vm-uuid': '0f9149e4-424b-42af-bd25-19d1cc7c0635'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:44 user nova-compute[75356]: INFO os_vif [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:21:8a,bridge_name='br-int',has_traffic_filtering=True,id=dbd23e2b-e6d6-4942-9b2f-3db29d312a85,network=Network(19745e07-fd6f-4ae7-8f23-3000120764e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd23e2b-e6')
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:21:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] No VIF found with MAC fa:16:3e:b4:21:8a, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:21:45 user nova-compute[75356]: DEBUG nova.network.neutron [req-e8647dcd-6fbe-48df-bcb5-6cc72b7234de req-02884fd2-6379-4442-8177-573f0c452748 service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Updated VIF entry in instance network info cache for port dbd23e2b-e6d6-4942-9b2f-3db29d312a85. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:21:45 user nova-compute[75356]: DEBUG nova.network.neutron [req-e8647dcd-6fbe-48df-bcb5-6cc72b7234de req-02884fd2-6379-4442-8177-573f0c452748 service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Updating instance_info_cache with network_info: [{"id": "dbd23e2b-e6d6-4942-9b2f-3db29d312a85", "address": "fa:16:3e:b4:21:8a", "network": {"id": "19745e07-fd6f-4ae7-8f23-3000120764e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1773897841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca028c7723a1409e84ee22bbb14c3bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd23e2b-e6", "ovs_interfaceid": "dbd23e2b-e6d6-4942-9b2f-3db29d312a85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:21:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e8647dcd-6fbe-48df-bcb5-6cc72b7234de req-02884fd2-6379-4442-8177-573f0c452748 service nova] Releasing lock "refresh_cache-0f9149e4-424b-42af-bd25-19d1cc7c0635" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:21:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:48 user nova-compute[75356]: DEBUG nova.compute.manager [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:21:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:21:48 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Instance spawned successfully.
Nov 29 20:21:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:21:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:21:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:21:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:21:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:21:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:21:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:21:48 user nova-compute[75356]: INFO nova.compute.manager [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Took 7.78 seconds to spawn the instance on the hypervisor.
Nov 29 20:21:48 user nova-compute[75356]: DEBUG nova.compute.manager [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:21:49 user nova-compute[75356]: INFO nova.compute.manager [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Took 8.75 seconds to build instance.
Nov 29 20:21:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-69ae43c3-1f98-41dd-ad2b-abad8823f848 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.875s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:50 user nova-compute[75356]: DEBUG nova.compute.manager [req-7b7149d0-d03b-4ebc-9e0c-8e5ab1e1342f req-c904c2ec-fb7b-4671-b3c5-e74e68e3d503 service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Received event network-vif-plugged-dbd23e2b-e6d6-4942-9b2f-3db29d312a85 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:21:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7b7149d0-d03b-4ebc-9e0c-8e5ab1e1342f req-c904c2ec-fb7b-4671-b3c5-e74e68e3d503 service nova] Acquiring lock "0f9149e4-424b-42af-bd25-19d1cc7c0635-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7b7149d0-d03b-4ebc-9e0c-8e5ab1e1342f req-c904c2ec-fb7b-4671-b3c5-e74e68e3d503 service nova] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7b7149d0-d03b-4ebc-9e0c-8e5ab1e1342f req-c904c2ec-fb7b-4671-b3c5-e74e68e3d503 service nova] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:50 user nova-compute[75356]: DEBUG nova.compute.manager [req-7b7149d0-d03b-4ebc-9e0c-8e5ab1e1342f req-c904c2ec-fb7b-4671-b3c5-e74e68e3d503 service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] No waiting events found dispatching network-vif-plugged-dbd23e2b-e6d6-4942-9b2f-3db29d312a85 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:21:50 user nova-compute[75356]: WARNING nova.compute.manager [req-7b7149d0-d03b-4ebc-9e0c-8e5ab1e1342f req-c904c2ec-fb7b-4671-b3c5-e74e68e3d503 service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Received unexpected event network-vif-plugged-dbd23e2b-e6d6-4942-9b2f-3db29d312a85 for instance with vm_state active and task_state None.
Nov 29 20:21:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:52 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:21:52 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:21:52 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:21:52 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:21:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:52 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:21:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:52 user nova-compute[75356]: DEBUG nova.compute.manager [req-7590e552-aa43-4fa4-8e90-838dd8628425 req-6cefe43c-76f6-4cae-a8c4-e4af4716195e service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Received event network-vif-plugged-dbd23e2b-e6d6-4942-9b2f-3db29d312a85 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:21:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7590e552-aa43-4fa4-8e90-838dd8628425 req-6cefe43c-76f6-4cae-a8c4-e4af4716195e service nova] Acquiring lock "0f9149e4-424b-42af-bd25-19d1cc7c0635-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7590e552-aa43-4fa4-8e90-838dd8628425 req-6cefe43c-76f6-4cae-a8c4-e4af4716195e service nova] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7590e552-aa43-4fa4-8e90-838dd8628425 req-6cefe43c-76f6-4cae-a8c4-e4af4716195e service nova] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:52 user nova-compute[75356]: DEBUG nova.compute.manager [req-7590e552-aa43-4fa4-8e90-838dd8628425 req-6cefe43c-76f6-4cae-a8c4-e4af4716195e service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] No waiting events found dispatching network-vif-plugged-dbd23e2b-e6d6-4942-9b2f-3db29d312a85 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:21:52 user nova-compute[75356]: WARNING nova.compute.manager [req-7590e552-aa43-4fa4-8e90-838dd8628425 req-6cefe43c-76f6-4cae-a8c4-e4af4716195e service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Received unexpected event network-vif-plugged-dbd23e2b-e6d6-4942-9b2f-3db29d312a85 for instance with vm_state active and task_state None.
Nov 29 20:21:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:52 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:21:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f3a04c-4259-4ead-9fd2-65d4651fee4b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f3a04c-4259-4ead-9fd2-65d4651fee4b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f3a04c-4259-4ead-9fd2-65d4651fee4b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68f3a04c-4259-4ead-9fd2-65d4651fee4b/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:21:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Acquiring lock "7d27c88e-5de8-4401-aa9d-d88643b478b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:57 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:21:57 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:21:57 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=7609MB free_disk=25.278934478759766GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:21:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:57 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:21:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:58 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Applying migration context for instance 96cbbbdb-e1cc-49da-9a9f-5b83031b235b as it has an incoming, in-progress migration a3c2ad02-b4f9-4432-b3c4-eed1ba5b1b92. Migration status is finished {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 20:21:58 user nova-compute[75356]: INFO nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Updating resource usage from migration a3c2ad02-b4f9-4432-b3c4-eed1ba5b1b92
Nov 29 20:21:58 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 9751c435-4d10-46dc-86e7-39d40e8209d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:21:58 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0b59517a-c467-432a-a73a-d1460c1574e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:21:58 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:21:58 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 972e22c1-bd85-4507-9166-ace3fce8e698 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:21:58 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 68f3a04c-4259-4ead-9fd2-65d4651fee4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:21:58 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 36ec2327-b376-49e4-8592-b2a077b79043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:21:58 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 3584b853-567c-4dd2-ae4f-3ff074074137 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:21:58 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Migration a3c2ad02-b4f9-4432-b3c4-eed1ba5b1b92 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 20:21:58 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 96cbbbdb-e1cc-49da-9a9f-5b83031b235b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:21:58 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0f9149e4-424b-42af-bd25-19d1cc7c0635 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:21:58 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 7d27c88e-5de8-4401-aa9d-d88643b478b9 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 29 20:21:58 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:21:58 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:21:58 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:21:58 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:21:58 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:21:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.876s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.713s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:58 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:21:58 user nova-compute[75356]: INFO nova.compute.claims [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Claim successful on node user
Nov 29 20:21:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.708s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "db0826f0-5fdc-47a8-ae36-5059844980c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "db0826f0-5fdc-47a8-ae36-5059844980c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG nova.compute.manager [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG nova.network.neutron [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:21:59 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:21:59 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:21:59 user nova-compute[75356]: INFO nova.compute.claims [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Claim successful on node user
Nov 29 20:21:59 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:21:59 user nova-compute[75356]: INFO nova.virt.block_device [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Booting with volume 0150af0a-0981-4423-8a10-f67ac89c4061 at /dev/vda
Nov 29 20:21:59 user nova-compute[75356]: DEBUG os_brick.utils [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff7d03c-53c7-4ffb-b1f7-802923ac2642]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG nova.policy [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69e09bd9b3774a6ebe0459412b688216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '509329256df34ff9b00d01614064ff91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c4834b-66c0-4714-b434-d7797b858dbe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[806f7fde-ad6e-4856-add4-8cfb772b06d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[65981888-dfa7-46d5-a13d-9e5e2cd2693a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:21:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:22:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:22:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:22:00 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:22:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[540164b4-839c-4914-950d-0ea41e54976a]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:22:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:22:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:22:00 user nova-compute[75356]: DEBUG os_brick.utils [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:22:00 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Updating existing volume attachment record: c01b55b4-85ec-4a31-8560-d434a431ec14 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:22:00 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:22:00 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:22:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.755s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:22:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:22:00 user nova-compute[75356]: DEBUG nova.network.neutron [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:22:00 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:22:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:22:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:22:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:22:00 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Creating image(s)
Nov 29 20:22:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "/opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "/opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "/opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:00 user nova-compute[75356]: DEBUG nova.policy [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e395b4248b794d65915edf2d23bbbeaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed33acdfd5f48b9967d1dd68c261d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.243s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.227s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk 1073741824" returned: 0 in 0.057s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Updating instance_info_cache with network_info: [{"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.204s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Cannot resize image /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Ensure instance console log exists: /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:02 user nova-compute[75356]: DEBUG nova.network.neutron [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Successfully created port: fdc58621-94e8-4c85-bafb-a51ecd40720b {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:22:02 user nova-compute[75356]: DEBUG nova.network.neutron [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Successfully created port: 56560c36-ae98-45b9-9179-fd4dc2a689dc {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:22:04 user nova-compute[75356]: DEBUG nova.network.neutron [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Successfully updated port: fdc58621-94e8-4c85-bafb-a51ecd40720b {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:22:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Acquiring lock "refresh_cache-7d27c88e-5de8-4401-aa9d-d88643b478b9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:22:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Acquired lock "refresh_cache-7d27c88e-5de8-4401-aa9d-d88643b478b9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:22:04 user nova-compute[75356]: DEBUG nova.network.neutron [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:22:04 user nova-compute[75356]: DEBUG nova.compute.manager [req-8672dcea-c0c3-48bb-b12b-0a5f531177c2 req-cd1a6054-9a75-4063-8697-e0f8f8be55f6 service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Received event network-changed-fdc58621-94e8-4c85-bafb-a51ecd40720b {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:22:04 user nova-compute[75356]: DEBUG nova.compute.manager [req-8672dcea-c0c3-48bb-b12b-0a5f531177c2 req-cd1a6054-9a75-4063-8697-e0f8f8be55f6 service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Refreshing instance network info cache due to event network-changed-fdc58621-94e8-4c85-bafb-a51ecd40720b. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:22:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-8672dcea-c0c3-48bb-b12b-0a5f531177c2 req-cd1a6054-9a75-4063-8697-e0f8f8be55f6 service nova] Acquiring lock "refresh_cache-7d27c88e-5de8-4401-aa9d-d88643b478b9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:22:04 user nova-compute[75356]: DEBUG nova.network.neutron [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:22:04 user nova-compute[75356]: DEBUG nova.network.neutron [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Successfully updated port: 56560c36-ae98-45b9-9179-fd4dc2a689dc {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:22:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "refresh_cache-db0826f0-5fdc-47a8-ae36-5059844980c9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:22:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquired lock "refresh_cache-db0826f0-5fdc-47a8-ae36-5059844980c9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:22:04 user nova-compute[75356]: DEBUG nova.network.neutron [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:22:04 user nova-compute[75356]: DEBUG nova.network.neutron [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:22:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:04 user nova-compute[75356]: DEBUG nova.network.neutron [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Updating instance_info_cache with network_info: [{"id": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "address": "fa:16:3e:ba:30:23", "network": {"id": "a667657a-11b6-40b9-a2e8-f50c41d49b34", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355155956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509329256df34ff9b00d01614064ff91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc58621-94", "ovs_interfaceid": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:22:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Releasing lock "refresh_cache-7d27c88e-5de8-4401-aa9d-d88643b478b9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:22:04 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Instance network_info: |[{"id": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "address": "fa:16:3e:ba:30:23", "network": {"id": "a667657a-11b6-40b9-a2e8-f50c41d49b34", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355155956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509329256df34ff9b00d01614064ff91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc58621-94", "ovs_interfaceid": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:22:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-8672dcea-c0c3-48bb-b12b-0a5f531177c2 req-cd1a6054-9a75-4063-8697-e0f8f8be55f6 service nova] Acquired lock "refresh_cache-7d27c88e-5de8-4401-aa9d-d88643b478b9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:22:04 user nova-compute[75356]: DEBUG nova.network.neutron [req-8672dcea-c0c3-48bb-b12b-0a5f531177c2 req-cd1a6054-9a75-4063-8697-e0f8f8be55f6 service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Refreshing network info cache for port fdc58621-94e8-4c85-bafb-a51ecd40720b {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.network.neutron [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Updating instance_info_cache with network_info: [{"id": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "address": "fa:16:3e:80:ff:16", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56560c36-ae", "ovs_interfaceid": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Releasing lock "refresh_cache-db0826f0-5fdc-47a8-ae36-5059844980c9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.compute.manager [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Instance network_info: |[{"id": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "address": "fa:16:3e:80:ff:16", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56560c36-ae", "ovs_interfaceid": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Start _get_guest_xml network_info=[{"id": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "address": "fa:16:3e:80:ff:16", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56560c36-ae", "ovs_interfaceid": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:22:05 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:22:05 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:21:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-403842688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-403842688',id=19,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bed33acdfd5f48b9967d1dd68c261d78',ramdisk_id='',reservation_id='r-c9n0vkyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2041863686',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:22:01Z,user_data=None,user_id='e395b4248b794d65915edf2d23bbbeaf',uuid=db0826f0-5fdc-47a8-ae36-5059844980c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "address": "fa:16:3e:80:ff:16", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56560c36-ae", "ovs_interfaceid": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Converting VIF {"id": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "address": "fa:16:3e:80:ff:16", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56560c36-ae", "ovs_interfaceid": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:ff:16,bridge_name='br-int',has_traffic_filtering=True,id=56560c36-ae98-45b9-9179-fd4dc2a689dc,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56560c36-ae') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.objects.instance [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lazy-loading 'pci_devices' on Instance uuid db0826f0-5fdc-47a8-ae36-5059844980c9 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:22:05 user nova-compute[75356]:   <uuid>db0826f0-5fdc-47a8-ae36-5059844980c9</uuid>
Nov 29 20:22:05 user nova-compute[75356]:   <name>instance-00000013</name>
Nov 29 20:22:05 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:22:05 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:22:05 user nova-compute[75356]:   <metadata>
Nov 29 20:22:05 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:22:05 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:22:05 user nova-compute[75356]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-403842688</nova:name>
Nov 29 20:22:05 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:22:05</nova:creationTime>
Nov 29 20:22:05 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:22:05 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:22:05 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:22:05 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:22:05 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:22:05 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:22:05 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:22:05 user nova-compute[75356]:       <nova:owner>
Nov 29 20:22:05 user nova-compute[75356]:         <nova:user uuid="e395b4248b794d65915edf2d23bbbeaf">tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member</nova:user>
Nov 29 20:22:05 user nova-compute[75356]:         <nova:project uuid="bed33acdfd5f48b9967d1dd68c261d78">tempest-ServerBootFromVolumeStableRescueTest-2041863686</nova:project>
Nov 29 20:22:05 user nova-compute[75356]:       </nova:owner>
Nov 29 20:22:05 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:22:05 user nova-compute[75356]:       <nova:ports>
Nov 29 20:22:05 user nova-compute[75356]:         <nova:port uuid="56560c36-ae98-45b9-9179-fd4dc2a689dc">
Nov 29 20:22:05 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 20:22:05 user nova-compute[75356]:         </nova:port>
Nov 29 20:22:05 user nova-compute[75356]:       </nova:ports>
Nov 29 20:22:05 user nova-compute[75356]:     </nova:instance>
Nov 29 20:22:05 user nova-compute[75356]:   </metadata>
Nov 29 20:22:05 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:22:05 user nova-compute[75356]:     <system>
Nov 29 20:22:05 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:22:05 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:22:05 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:22:05 user nova-compute[75356]:       <entry name="serial">db0826f0-5fdc-47a8-ae36-5059844980c9</entry>
Nov 29 20:22:05 user nova-compute[75356]:       <entry name="uuid">db0826f0-5fdc-47a8-ae36-5059844980c9</entry>
Nov 29 20:22:05 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:22:05 user nova-compute[75356]:     </system>
Nov 29 20:22:05 user nova-compute[75356]:   </sysinfo>
Nov 29 20:22:05 user nova-compute[75356]:   <os>
Nov 29 20:22:05 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:22:05 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:22:05 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:22:05 user nova-compute[75356]:   </os>
Nov 29 20:22:05 user nova-compute[75356]:   <features>
Nov 29 20:22:05 user nova-compute[75356]:     <acpi/>
Nov 29 20:22:05 user nova-compute[75356]:     <apic/>
Nov 29 20:22:05 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:22:05 user nova-compute[75356]:   </features>
Nov 29 20:22:05 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:22:05 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:22:05 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:22:05 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:22:05 user nova-compute[75356]:   </clock>
Nov 29 20:22:05 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:22:05 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:22:05 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:22:05 user nova-compute[75356]:   </cpu>
Nov 29 20:22:05 user nova-compute[75356]:   <devices>
Nov 29 20:22:05 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:22:05 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:22:05 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk"/>
Nov 29 20:22:05 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:22:05 user nova-compute[75356]:     </disk>
Nov 29 20:22:05 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:22:05 user nova-compute[75356]:       <mac address="fa:16:3e:80:ff:16"/>
Nov 29 20:22:05 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:22:05 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:22:05 user nova-compute[75356]:       <target dev="tap56560c36-ae"/>
Nov 29 20:22:05 user nova-compute[75356]:     </interface>
Nov 29 20:22:05 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:22:05 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/console.log" append="off"/>
Nov 29 20:22:05 user nova-compute[75356]:     </serial>
Nov 29 20:22:05 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:22:05 user nova-compute[75356]:     <video>
Nov 29 20:22:05 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:22:05 user nova-compute[75356]:     </video>
Nov 29 20:22:05 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:22:05 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:22:05 user nova-compute[75356]:     </rng>
Nov 29 20:22:05 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:22:05 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:22:05 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:22:05 user nova-compute[75356]:     </memballoon>
Nov 29 20:22:05 user nova-compute[75356]:   </devices>
Nov 29 20:22:05 user nova-compute[75356]: </domain>
Nov 29 20:22:05 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:21:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-403842688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-403842688',id=19,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bed33acdfd5f48b9967d1dd68c261d78',ramdisk_id='',reservation_id='r-c9n0vkyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2041863686',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:22:01Z,user_data=None,user_id='e395b4248b794d65915edf2d23bbbeaf',uuid=db0826f0-5fdc-47a8-ae36-5059844980c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "address": "fa:16:3e:80:ff:16", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56560c36-ae", "ovs_interfaceid": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Converting VIF {"id": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "address": "fa:16:3e:80:ff:16", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56560c36-ae", "ovs_interfaceid": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:ff:16,bridge_name='br-int',has_traffic_filtering=True,id=56560c36-ae98-45b9-9179-fd4dc2a689dc,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56560c36-ae') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG os_vif [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:ff:16,bridge_name='br-int',has_traffic_filtering=True,id=56560c36-ae98-45b9-9179-fd4dc2a689dc,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56560c36-ae') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd684d952-0294-59f6-84ec-c1fd133a825c', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56560c36-ae, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56560c36-ae, col_values=(('qos', UUID('ec787d5d-2605-4d77-b864-2c9ea97f1c1d')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56560c36-ae, col_values=(('external_ids', {'iface-id': '56560c36-ae98-45b9-9179-fd4dc2a689dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:ff:16', 'vm-uuid': 'db0826f0-5fdc-47a8-ae36-5059844980c9'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:05 user nova-compute[75356]: INFO os_vif [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:ff:16,bridge_name='br-int',has_traffic_filtering=True,id=56560c36-ae98-45b9-9179-fd4dc2a689dc,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56560c36-ae')
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:22:05 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] No VIF found with MAC fa:16:3e:80:ff:16, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:22:06 user nova-compute[75356]: DEBUG nova.network.neutron [req-8672dcea-c0c3-48bb-b12b-0a5f531177c2 req-cd1a6054-9a75-4063-8697-e0f8f8be55f6 service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Updated VIF entry in instance network info cache for port fdc58621-94e8-4c85-bafb-a51ecd40720b. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:22:06 user nova-compute[75356]: DEBUG nova.network.neutron [req-8672dcea-c0c3-48bb-b12b-0a5f531177c2 req-cd1a6054-9a75-4063-8697-e0f8f8be55f6 service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Updating instance_info_cache with network_info: [{"id": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "address": "fa:16:3e:ba:30:23", "network": {"id": "a667657a-11b6-40b9-a2e8-f50c41d49b34", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355155956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509329256df34ff9b00d01614064ff91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc58621-94", "ovs_interfaceid": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:22:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-8672dcea-c0c3-48bb-b12b-0a5f531177c2 req-cd1a6054-9a75-4063-8697-e0f8f8be55f6 service nova] Releasing lock "refresh_cache-7d27c88e-5de8-4401-aa9d-d88643b478b9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:22:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-d96c17ab-c3e4-4f0a-90b0-7b338da06a1a req-db8d6736-d5ba-47ec-b08b-c0dd334159fd service nova] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Received event network-changed-56560c36-ae98-45b9-9179-fd4dc2a689dc {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:22:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-d96c17ab-c3e4-4f0a-90b0-7b338da06a1a req-db8d6736-d5ba-47ec-b08b-c0dd334159fd service nova] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Refreshing instance network info cache due to event network-changed-56560c36-ae98-45b9-9179-fd4dc2a689dc. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:22:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d96c17ab-c3e4-4f0a-90b0-7b338da06a1a req-db8d6736-d5ba-47ec-b08b-c0dd334159fd service nova] Acquiring lock "refresh_cache-db0826f0-5fdc-47a8-ae36-5059844980c9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:22:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d96c17ab-c3e4-4f0a-90b0-7b338da06a1a req-db8d6736-d5ba-47ec-b08b-c0dd334159fd service nova] Acquired lock "refresh_cache-db0826f0-5fdc-47a8-ae36-5059844980c9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:22:06 user nova-compute[75356]: DEBUG nova.network.neutron [req-d96c17ab-c3e4-4f0a-90b0-7b338da06a1a req-db8d6736-d5ba-47ec-b08b-c0dd334159fd service nova] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Refreshing network info cache for port 56560c36-ae98-45b9-9179-fd4dc2a689dc {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:22:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:06 user nova-compute[75356]: DEBUG nova.network.neutron [req-d96c17ab-c3e4-4f0a-90b0-7b338da06a1a req-db8d6736-d5ba-47ec-b08b-c0dd334159fd service nova] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Updated VIF entry in instance network info cache for port 56560c36-ae98-45b9-9179-fd4dc2a689dc. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:22:06 user nova-compute[75356]: DEBUG nova.network.neutron [req-d96c17ab-c3e4-4f0a-90b0-7b338da06a1a req-db8d6736-d5ba-47ec-b08b-c0dd334159fd service nova] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Updating instance_info_cache with network_info: [{"id": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "address": "fa:16:3e:80:ff:16", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56560c36-ae", "ovs_interfaceid": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:22:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d96c17ab-c3e4-4f0a-90b0-7b338da06a1a req-db8d6736-d5ba-47ec-b08b-c0dd334159fd service nova] Releasing lock "refresh_cache-db0826f0-5fdc-47a8-ae36-5059844980c9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:22:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-23e6833c-0973-4c59-95e1-fa9ba091a5df req-1303ce32-3a29-438e-97c0-996534ac89c3 service nova] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Received event network-vif-plugged-56560c36-ae98-45b9-9179-fd4dc2a689dc {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:22:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-23e6833c-0973-4c59-95e1-fa9ba091a5df req-1303ce32-3a29-438e-97c0-996534ac89c3 service nova] Acquiring lock "db0826f0-5fdc-47a8-ae36-5059844980c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-23e6833c-0973-4c59-95e1-fa9ba091a5df req-1303ce32-3a29-438e-97c0-996534ac89c3 service nova] Lock "db0826f0-5fdc-47a8-ae36-5059844980c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-23e6833c-0973-4c59-95e1-fa9ba091a5df req-1303ce32-3a29-438e-97c0-996534ac89c3 service nova] Lock "db0826f0-5fdc-47a8-ae36-5059844980c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-23e6833c-0973-4c59-95e1-fa9ba091a5df req-1303ce32-3a29-438e-97c0-996534ac89c3 service nova] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] No waiting events found dispatching network-vif-plugged-56560c36-ae98-45b9-9179-fd4dc2a689dc {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:22:07 user nova-compute[75356]: WARNING nova.compute.manager [req-23e6833c-0973-4c59-95e1-fa9ba091a5df req-1303ce32-3a29-438e-97c0-996534ac89c3 service nova] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Received unexpected event network-vif-plugged-56560c36-ae98-45b9-9179-fd4dc2a689dc for instance with vm_state building and task_state spawning.
Nov 29 20:22:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.compute.manager [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:22:09 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Instance spawned successfully.
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:22:09 user nova-compute[75356]: INFO nova.compute.manager [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Took 8.54 seconds to spawn the instance on the hypervisor.
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.compute.manager [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:22:09 user nova-compute[75356]: INFO nova.compute.manager [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Took 9.82 seconds to build instance.
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-25dc339b-4433-48b7-b25e-11500f155e0f tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "db0826f0-5fdc-47a8-ae36-5059844980c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.033s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.compute.manager [req-14bb6978-4ba5-42d5-9205-e89595b1b0f6 req-d77637bd-c680-4ce7-91ed-ab28e383b895 service nova] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Received event network-vif-plugged-56560c36-ae98-45b9-9179-fd4dc2a689dc {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-14bb6978-4ba5-42d5-9205-e89595b1b0f6 req-d77637bd-c680-4ce7-91ed-ab28e383b895 service nova] Acquiring lock "db0826f0-5fdc-47a8-ae36-5059844980c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-14bb6978-4ba5-42d5-9205-e89595b1b0f6 req-d77637bd-c680-4ce7-91ed-ab28e383b895 service nova] Lock "db0826f0-5fdc-47a8-ae36-5059844980c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-14bb6978-4ba5-42d5-9205-e89595b1b0f6 req-d77637bd-c680-4ce7-91ed-ab28e383b895 service nova] Lock "db0826f0-5fdc-47a8-ae36-5059844980c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.compute.manager [req-14bb6978-4ba5-42d5-9205-e89595b1b0f6 req-d77637bd-c680-4ce7-91ed-ab28e383b895 service nova] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] No waiting events found dispatching network-vif-plugged-56560c36-ae98-45b9-9179-fd4dc2a689dc {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:22:09 user nova-compute[75356]: WARNING nova.compute.manager [req-14bb6978-4ba5-42d5-9205-e89595b1b0f6 req-d77637bd-c680-4ce7-91ed-ab28e383b895 service nova] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Received unexpected event network-vif-plugged-56560c36-ae98-45b9-9179-fd4dc2a689dc for instance with vm_state active and task_state None.
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:22:09 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Creating image(s)
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Did not create local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Ensure instance console log exists: /opt/stack/data/nova/instances/7d27c88e-5de8-4401-aa9d-d88643b478b9/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Start _get_guest_xml network_info=[{"id": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "address": "fa:16:3e:ba:30:23", "network": {"id": "a667657a-11b6-40b9-a2e8-f50c41d49b34", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355155956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509329256df34ff9b00d01614064ff91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc58621-94", "ovs_interfaceid": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JlIeiaCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7d27c88e-5de8-4401-aa9d-d88643b478b9', 'attached_at': '', 'detached_at': '', 'volume_id': '0150af0a-0981-4423-8a10-f67ac89c4061', 'serial': '0150af0a-0981-4423-8a10-f67ac89c4061'}, 'attachment_id': 'c01b55b4-85ec-4a31-8560-d434a431ec14', 'volume_type': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:22:09 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:22:09 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JlIeiaCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:22:09 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:22:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:22:09 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:22:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:22:09 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43bfc5d-50a9-4068-87c8-ffe6de0ff91e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:22:09 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e15fea2-694b-4e4a-b43c-38b4a20b072f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061] added
Nov 29 20:22:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c091fb55-04e7-40e0-ad98-8dfc3e5fb946]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d98d8a1-8475-40f2-87a6-c037b71d06a9]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JlIeiaCP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JlIeiaCP" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fcae81-ddda-499b-97e9-0310028b77e0]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JlIeiaCP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d083fc84-b719-4859-b29e-b7953c4e52b3]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[800949d4-eef4-41a6-860f-3e725646a3d8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:22:09 user nova-compute[75356]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:22:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:22:09 user nova-compute[75356]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:22:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[524e284f-d61c-4aba-a807-4d524ce09901]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061, portal: 172.16.0.220,3260]
Nov 29 20:22:10 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061, portal: 172.16.0.220,3260] successful.
Nov 29 20:22:10 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:22:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fd9d13-6bf7-4c10-a260-d5249c1ebe8c]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:22:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6aa9ea-1755-4801-9981-077d79a93716]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:22:10 user nova-compute[75356]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:22:10 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:22:10 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:22:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:22:10 user nova-compute[75356]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:22:10 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:22:10 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:22:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:22:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:22:10 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:22:10 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:22:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8729798-8586-473f-926e-ea71bc134fac]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:10 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:22:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JlIeiaCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:22:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23538643362316236', 'path': '/dev/sdd'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538643362316236', 'path': '/dev/sdd'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:21:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1912060011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1912060011',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp9h0sV8HqQQKrm9wRP86I0faDw7r9ov+BDsQBXkVs0aZuFJR32OVgyV5IeyoX7630/1HeOKAYpIohIRYAB/skYr0un2YHRwxSgPbrAhWys2tztVnD2rtF1IOLaH5rQSg==',key_name='tempest-keypair-416274752',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='509329256df34ff9b00d01614064ff91',ramdisk_id='',reservation_id='r-vk1q32sk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-829836017',owner_user_name='tempest-ServerActionsV293TestJSON-829836017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:22:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69e09bd9b3774a6ebe0459412b688216',uuid=7d27c88e-5de8-4401-aa9d-d88643b478b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "address": "fa:16:3e:ba:30:23", "network": {"id": "a667657a-11b6-40b9-a2e8-f50c41d49b34", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355155956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509329256df34ff9b00d01614064ff91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc58621-94", "ovs_interfaceid": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Converting VIF {"id": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "address": "fa:16:3e:ba:30:23", "network": {"id": "a667657a-11b6-40b9-a2e8-f50c41d49b34", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355155956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509329256df34ff9b00d01614064ff91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc58621-94", "ovs_interfaceid": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:30:23,bridge_name='br-int',has_traffic_filtering=True,id=fdc58621-94e8-4c85-bafb-a51ecd40720b,network=Network(a667657a-11b6-40b9-a2e8-f50c41d49b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc58621-94') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG nova.objects.instance [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d27c88e-5de8-4401-aa9d-d88643b478b9 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:22:11 user nova-compute[75356]:   <uuid>7d27c88e-5de8-4401-aa9d-d88643b478b9</uuid>
Nov 29 20:22:11 user nova-compute[75356]:   <name>instance-00000012</name>
Nov 29 20:22:11 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:22:11 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:22:11 user nova-compute[75356]:   <metadata>
Nov 29 20:22:11 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:22:11 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:22:11 user nova-compute[75356]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1912060011</nova:name>
Nov 29 20:22:11 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:22:09</nova:creationTime>
Nov 29 20:22:11 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:22:11 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:22:11 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:22:11 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:22:11 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:22:11 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:22:11 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:22:11 user nova-compute[75356]:       <nova:owner>
Nov 29 20:22:11 user nova-compute[75356]:         <nova:user uuid="69e09bd9b3774a6ebe0459412b688216">tempest-ServerActionsV293TestJSON-829836017-project-member</nova:user>
Nov 29 20:22:11 user nova-compute[75356]:         <nova:project uuid="509329256df34ff9b00d01614064ff91">tempest-ServerActionsV293TestJSON-829836017</nova:project>
Nov 29 20:22:11 user nova-compute[75356]:       </nova:owner>
Nov 29 20:22:11 user nova-compute[75356]:       <nova:ports>
Nov 29 20:22:11 user nova-compute[75356]:         <nova:port uuid="fdc58621-94e8-4c85-bafb-a51ecd40720b">
Nov 29 20:22:11 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 20:22:11 user nova-compute[75356]:         </nova:port>
Nov 29 20:22:11 user nova-compute[75356]:       </nova:ports>
Nov 29 20:22:11 user nova-compute[75356]:     </nova:instance>
Nov 29 20:22:11 user nova-compute[75356]:   </metadata>
Nov 29 20:22:11 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:22:11 user nova-compute[75356]:     <system>
Nov 29 20:22:11 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:22:11 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:22:11 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:22:11 user nova-compute[75356]:       <entry name="serial">7d27c88e-5de8-4401-aa9d-d88643b478b9</entry>
Nov 29 20:22:11 user nova-compute[75356]:       <entry name="uuid">7d27c88e-5de8-4401-aa9d-d88643b478b9</entry>
Nov 29 20:22:11 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:22:11 user nova-compute[75356]:     </system>
Nov 29 20:22:11 user nova-compute[75356]:   </sysinfo>
Nov 29 20:22:11 user nova-compute[75356]:   <os>
Nov 29 20:22:11 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:22:11 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:22:11 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:22:11 user nova-compute[75356]:   </os>
Nov 29 20:22:11 user nova-compute[75356]:   <features>
Nov 29 20:22:11 user nova-compute[75356]:     <acpi/>
Nov 29 20:22:11 user nova-compute[75356]:     <apic/>
Nov 29 20:22:11 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:22:11 user nova-compute[75356]:   </features>
Nov 29 20:22:11 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:22:11 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:22:11 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:22:11 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:22:11 user nova-compute[75356]:   </clock>
Nov 29 20:22:11 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:22:11 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:22:11 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:22:11 user nova-compute[75356]:   </cpu>
Nov 29 20:22:11 user nova-compute[75356]:   <devices>
Nov 29 20:22:11 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:22:11 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:22:11 user nova-compute[75356]:       <source dev="/dev/sdd"/>
Nov 29 20:22:11 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:22:11 user nova-compute[75356]:       <serial>0150af0a-0981-4423-8a10-f67ac89c4061</serial>
Nov 29 20:22:11 user nova-compute[75356]:     </disk>
Nov 29 20:22:11 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:22:11 user nova-compute[75356]:       <mac address="fa:16:3e:ba:30:23"/>
Nov 29 20:22:11 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:22:11 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:22:11 user nova-compute[75356]:       <target dev="tapfdc58621-94"/>
Nov 29 20:22:11 user nova-compute[75356]:     </interface>
Nov 29 20:22:11 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:22:11 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/7d27c88e-5de8-4401-aa9d-d88643b478b9/console.log" append="off"/>
Nov 29 20:22:11 user nova-compute[75356]:     </serial>
Nov 29 20:22:11 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:22:11 user nova-compute[75356]:     <video>
Nov 29 20:22:11 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:22:11 user nova-compute[75356]:     </video>
Nov 29 20:22:11 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:22:11 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:22:11 user nova-compute[75356]:     </rng>
Nov 29 20:22:11 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:22:11 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:22:11 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:22:11 user nova-compute[75356]:     </memballoon>
Nov 29 20:22:11 user nova-compute[75356]:   </devices>
Nov 29 20:22:11 user nova-compute[75356]: </domain>
Nov 29 20:22:11 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:21:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1912060011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1912060011',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp9h0sV8HqQQKrm9wRP86I0faDw7r9ov+BDsQBXkVs0aZuFJR32OVgyV5IeyoX7630/1HeOKAYpIohIRYAB/skYr0un2YHRwxSgPbrAhWys2tztVnD2rtF1IOLaH5rQSg==',key_name='tempest-keypair-416274752',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='509329256df34ff9b00d01614064ff91',ramdisk_id='',reservation_id='r-vk1q32sk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-829836017',owner_user_name='tempest-ServerActionsV293TestJSON-829836017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:22:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69e09bd9b3774a6ebe0459412b688216',uuid=7d27c88e-5de8-4401-aa9d-d88643b478b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "address": "fa:16:3e:ba:30:23", "network": {"id": "a667657a-11b6-40b9-a2e8-f50c41d49b34", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355155956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509329256df34ff9b00d01614064ff91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc58621-94", "ovs_interfaceid": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Converting VIF {"id": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "address": "fa:16:3e:ba:30:23", "network": {"id": "a667657a-11b6-40b9-a2e8-f50c41d49b34", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355155956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509329256df34ff9b00d01614064ff91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc58621-94", "ovs_interfaceid": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:30:23,bridge_name='br-int',has_traffic_filtering=True,id=fdc58621-94e8-4c85-bafb-a51ecd40720b,network=Network(a667657a-11b6-40b9-a2e8-f50c41d49b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc58621-94') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG os_vif [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:30:23,bridge_name='br-int',has_traffic_filtering=True,id=fdc58621-94e8-4c85-bafb-a51ecd40720b,network=Network(a667657a-11b6-40b9-a2e8-f50c41d49b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc58621-94') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb8f721b-c8a9-5306-85f0-195d04afa395', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfdc58621-94, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfdc58621-94, col_values=(('qos', UUID('f0ec66b1-7bdb-425b-9ee3-e63f33a61959')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfdc58621-94, col_values=(('external_ids', {'iface-id': 'fdc58621-94e8-4c85-bafb-a51ecd40720b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:30:23', 'vm-uuid': '7d27c88e-5de8-4401-aa9d-d88643b478b9'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:11 user nova-compute[75356]: INFO os_vif [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:30:23,bridge_name='br-int',has_traffic_filtering=True,id=fdc58621-94e8-4c85-bafb-a51ecd40720b,network=Network(a667657a-11b6-40b9-a2e8-f50c41d49b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc58621-94')
Nov 29 20:22:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:22:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] No VIF found with MAC fa:16:3e:ba:30:23, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:22:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-2210744c-6b9b-4987-84b6-b05a388de983 req-0c7d9899-7f8a-4c7d-89e8-dad2c2051397 service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Received event network-vif-plugged-fdc58621-94e8-4c85-bafb-a51ecd40720b {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:22:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2210744c-6b9b-4987-84b6-b05a388de983 req-0c7d9899-7f8a-4c7d-89e8-dad2c2051397 service nova] Acquiring lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2210744c-6b9b-4987-84b6-b05a388de983 req-0c7d9899-7f8a-4c7d-89e8-dad2c2051397 service nova] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2210744c-6b9b-4987-84b6-b05a388de983 req-0c7d9899-7f8a-4c7d-89e8-dad2c2051397 service nova] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-2210744c-6b9b-4987-84b6-b05a388de983 req-0c7d9899-7f8a-4c7d-89e8-dad2c2051397 service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] No waiting events found dispatching network-vif-plugged-fdc58621-94e8-4c85-bafb-a51ecd40720b {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:22:13 user nova-compute[75356]: WARNING nova.compute.manager [req-2210744c-6b9b-4987-84b6-b05a388de983 req-0c7d9899-7f8a-4c7d-89e8-dad2c2051397 service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Received unexpected event network-vif-plugged-fdc58621-94e8-4c85-bafb-a51ecd40720b for instance with vm_state building and task_state spawning.
Nov 29 20:22:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "7982934b-8c0f-4403-8607-2a2679070e02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "7982934b-8c0f-4403-8607-2a2679070e02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:22:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:22:14 user nova-compute[75356]: INFO nova.compute.claims [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Claim successful on node user
Nov 29 20:22:15 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.649s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:22:15 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Instance spawned successfully.
Nov 29 20:22:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-3c1a30ac-34ed-437a-8412-d6cb79d1016e req-8be52e15-3fd1-4a62-b5d7-b95168224804 service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Received event network-vif-plugged-fdc58621-94e8-4c85-bafb-a51ecd40720b {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3c1a30ac-34ed-437a-8412-d6cb79d1016e req-8be52e15-3fd1-4a62-b5d7-b95168224804 service nova] Acquiring lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3c1a30ac-34ed-437a-8412-d6cb79d1016e req-8be52e15-3fd1-4a62-b5d7-b95168224804 service nova] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3c1a30ac-34ed-437a-8412-d6cb79d1016e req-8be52e15-3fd1-4a62-b5d7-b95168224804 service nova] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-3c1a30ac-34ed-437a-8412-d6cb79d1016e req-8be52e15-3fd1-4a62-b5d7-b95168224804 service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] No waiting events found dispatching network-vif-plugged-fdc58621-94e8-4c85-bafb-a51ecd40720b {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:22:15 user nova-compute[75356]: WARNING nova.compute.manager [req-3c1a30ac-34ed-437a-8412-d6cb79d1016e req-8be52e15-3fd1-4a62-b5d7-b95168224804 service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Received unexpected event network-vif-plugged-fdc58621-94e8-4c85-bafb-a51ecd40720b for instance with vm_state building and task_state spawning.
Nov 29 20:22:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG nova.network.neutron [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:22:15 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:22:15 user nova-compute[75356]: INFO nova.compute.manager [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Took 6.02 seconds to spawn the instance on the hypervisor.
Nov 29 20:22:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG nova.policy [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecc96706ae3140ce8816c0e78e116d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e99301081a4158bc9d188e2f796350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:22:15 user nova-compute[75356]: INFO nova.compute.manager [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Took 17.93 seconds to build instance.
Nov 29 20:22:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:22:15 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Creating image(s)
Nov 29 20:22:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "/opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "/opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "/opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8667b20b-ade1-4761-bca2-96b52e9f3028 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.128s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.199s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.202s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk 1073741824" returned: 0 in 0.070s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.285s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:16 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:22:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:16 user nova-compute[75356]: DEBUG nova.network.neutron [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Successfully created port: 2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:22:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:16 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Cannot resize image /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:22:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:22:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Ensure instance console log exists: /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:22:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:17 user nova-compute[75356]: DEBUG nova.network.neutron [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Successfully updated port: 2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:22:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "refresh_cache-7982934b-8c0f-4403-8607-2a2679070e02" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:22:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquired lock "refresh_cache-7982934b-8c0f-4403-8607-2a2679070e02" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:22:17 user nova-compute[75356]: DEBUG nova.network.neutron [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:22:17 user nova-compute[75356]: DEBUG nova.network.neutron [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:22:17 user nova-compute[75356]: DEBUG nova.compute.manager [req-0c98774b-80c0-4f4b-9a7a-090e1dac44d1 req-4424f136-1329-4cee-b74a-5794ec35dbb7 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received event network-changed-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:22:17 user nova-compute[75356]: DEBUG nova.compute.manager [req-0c98774b-80c0-4f4b-9a7a-090e1dac44d1 req-4424f136-1329-4cee-b74a-5794ec35dbb7 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Refreshing instance network info cache due to event network-changed-2273063c-59ad-4c22-baac-b35f81cddd68. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:22:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0c98774b-80c0-4f4b-9a7a-090e1dac44d1 req-4424f136-1329-4cee-b74a-5794ec35dbb7 service nova] Acquiring lock "refresh_cache-7982934b-8c0f-4403-8607-2a2679070e02" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:22:17 user nova-compute[75356]: DEBUG nova.network.neutron [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Updating instance_info_cache with network_info: [{"id": "2273063c-59ad-4c22-baac-b35f81cddd68", "address": "fa:16:3e:3f:8c:d9", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2273063c-59", "ovs_interfaceid": "2273063c-59ad-4c22-baac-b35f81cddd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:22:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Releasing lock "refresh_cache-7982934b-8c0f-4403-8607-2a2679070e02" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:22:17 user nova-compute[75356]: DEBUG nova.compute.manager [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Instance network_info: |[{"id": "2273063c-59ad-4c22-baac-b35f81cddd68", "address": "fa:16:3e:3f:8c:d9", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2273063c-59", "ovs_interfaceid": "2273063c-59ad-4c22-baac-b35f81cddd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:22:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0c98774b-80c0-4f4b-9a7a-090e1dac44d1 req-4424f136-1329-4cee-b74a-5794ec35dbb7 service nova] Acquired lock "refresh_cache-7982934b-8c0f-4403-8607-2a2679070e02" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:22:17 user nova-compute[75356]: DEBUG nova.network.neutron [req-0c98774b-80c0-4f4b-9a7a-090e1dac44d1 req-4424f136-1329-4cee-b74a-5794ec35dbb7 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Refreshing network info cache for port 2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:22:17 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Start _get_guest_xml network_info=[{"id": "2273063c-59ad-4c22-baac-b35f81cddd68", "address": "fa:16:3e:3f:8c:d9", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2273063c-59", "ovs_interfaceid": "2273063c-59ad-4c22-baac-b35f81cddd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:22:17 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:22:17 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-859860773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-859860773',id=20,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB61jWQLvhl105AL/kOrG2alsz/RIWF011SgEudyJwJKmlKy4g4wrMvyGGcKLeZjIEL23ogtBjthvwquYW/ZXfCmfVBm47cAiaZ3AkaXj9dYDhiFzXqQnT7zoPPd4sjddA==',key_name='tempest-keypair-1095450286',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71e99301081a4158bc9d188e2f796350',ramdisk_id='',reservation_id='r-5mvrbzg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1538416601',owner_user_name='tempest-AttachVolumeShelveTestJSON-1538416601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:22:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecc96706ae3140ce8816c0e78e116d7d',uuid=7982934b-8c0f-4403-8607-2a2679070e02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2273063c-59ad-4c22-baac-b35f81cddd68", "address": "fa:16:3e:3f:8c:d9", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2273063c-59", "ovs_interfaceid": "2273063c-59ad-4c22-baac-b35f81cddd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converting VIF {"id": "2273063c-59ad-4c22-baac-b35f81cddd68", "address": "fa:16:3e:3f:8c:d9", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2273063c-59", "ovs_interfaceid": "2273063c-59ad-4c22-baac-b35f81cddd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:8c:d9,bridge_name='br-int',has_traffic_filtering=True,id=2273063c-59ad-4c22-baac-b35f81cddd68,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2273063c-59') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.objects.instance [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lazy-loading 'pci_devices' on Instance uuid 7982934b-8c0f-4403-8607-2a2679070e02 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:22:18 user nova-compute[75356]:   <uuid>7982934b-8c0f-4403-8607-2a2679070e02</uuid>
Nov 29 20:22:18 user nova-compute[75356]:   <name>instance-00000014</name>
Nov 29 20:22:18 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:22:18 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:22:18 user nova-compute[75356]:   <metadata>
Nov 29 20:22:18 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:22:18 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:22:18 user nova-compute[75356]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-859860773</nova:name>
Nov 29 20:22:18 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:22:17</nova:creationTime>
Nov 29 20:22:18 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:22:18 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:22:18 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:22:18 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:22:18 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:22:18 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:22:18 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:22:18 user nova-compute[75356]:       <nova:owner>
Nov 29 20:22:18 user nova-compute[75356]:         <nova:user uuid="ecc96706ae3140ce8816c0e78e116d7d">tempest-AttachVolumeShelveTestJSON-1538416601-project-member</nova:user>
Nov 29 20:22:18 user nova-compute[75356]:         <nova:project uuid="71e99301081a4158bc9d188e2f796350">tempest-AttachVolumeShelveTestJSON-1538416601</nova:project>
Nov 29 20:22:18 user nova-compute[75356]:       </nova:owner>
Nov 29 20:22:18 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:22:18 user nova-compute[75356]:       <nova:ports>
Nov 29 20:22:18 user nova-compute[75356]:         <nova:port uuid="2273063c-59ad-4c22-baac-b35f81cddd68">
Nov 29 20:22:18 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 20:22:18 user nova-compute[75356]:         </nova:port>
Nov 29 20:22:18 user nova-compute[75356]:       </nova:ports>
Nov 29 20:22:18 user nova-compute[75356]:     </nova:instance>
Nov 29 20:22:18 user nova-compute[75356]:   </metadata>
Nov 29 20:22:18 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:22:18 user nova-compute[75356]:     <system>
Nov 29 20:22:18 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:22:18 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:22:18 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:22:18 user nova-compute[75356]:       <entry name="serial">7982934b-8c0f-4403-8607-2a2679070e02</entry>
Nov 29 20:22:18 user nova-compute[75356]:       <entry name="uuid">7982934b-8c0f-4403-8607-2a2679070e02</entry>
Nov 29 20:22:18 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:22:18 user nova-compute[75356]:     </system>
Nov 29 20:22:18 user nova-compute[75356]:   </sysinfo>
Nov 29 20:22:18 user nova-compute[75356]:   <os>
Nov 29 20:22:18 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:22:18 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:22:18 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:22:18 user nova-compute[75356]:   </os>
Nov 29 20:22:18 user nova-compute[75356]:   <features>
Nov 29 20:22:18 user nova-compute[75356]:     <acpi/>
Nov 29 20:22:18 user nova-compute[75356]:     <apic/>
Nov 29 20:22:18 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:22:18 user nova-compute[75356]:   </features>
Nov 29 20:22:18 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:22:18 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:22:18 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:22:18 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:22:18 user nova-compute[75356]:   </clock>
Nov 29 20:22:18 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:22:18 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:22:18 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:22:18 user nova-compute[75356]:   </cpu>
Nov 29 20:22:18 user nova-compute[75356]:   <devices>
Nov 29 20:22:18 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:22:18 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:22:18 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk"/>
Nov 29 20:22:18 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:22:18 user nova-compute[75356]:     </disk>
Nov 29 20:22:18 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:22:18 user nova-compute[75356]:       <mac address="fa:16:3e:3f:8c:d9"/>
Nov 29 20:22:18 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:22:18 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:22:18 user nova-compute[75356]:       <target dev="tap2273063c-59"/>
Nov 29 20:22:18 user nova-compute[75356]:     </interface>
Nov 29 20:22:18 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:22:18 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/console.log" append="off"/>
Nov 29 20:22:18 user nova-compute[75356]:     </serial>
Nov 29 20:22:18 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:22:18 user nova-compute[75356]:     <video>
Nov 29 20:22:18 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:22:18 user nova-compute[75356]:     </video>
Nov 29 20:22:18 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:22:18 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:22:18 user nova-compute[75356]:     </rng>
Nov 29 20:22:18 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:22:18 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:22:18 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:22:18 user nova-compute[75356]:     </memballoon>
Nov 29 20:22:18 user nova-compute[75356]:   </devices>
Nov 29 20:22:18 user nova-compute[75356]: </domain>
Nov 29 20:22:18 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-859860773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-859860773',id=20,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB61jWQLvhl105AL/kOrG2alsz/RIWF011SgEudyJwJKmlKy4g4wrMvyGGcKLeZjIEL23ogtBjthvwquYW/ZXfCmfVBm47cAiaZ3AkaXj9dYDhiFzXqQnT7zoPPd4sjddA==',key_name='tempest-keypair-1095450286',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71e99301081a4158bc9d188e2f796350',ramdisk_id='',reservation_id='r-5mvrbzg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1538416601',owner_user_name='tempest-AttachVolumeShelveTestJSON-1538416601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:22:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecc96706ae3140ce8816c0e78e116d7d',uuid=7982934b-8c0f-4403-8607-2a2679070e02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2273063c-59ad-4c22-baac-b35f81cddd68", "address": "fa:16:3e:3f:8c:d9", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2273063c-59", "ovs_interfaceid": "2273063c-59ad-4c22-baac-b35f81cddd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converting VIF {"id": "2273063c-59ad-4c22-baac-b35f81cddd68", "address": "fa:16:3e:3f:8c:d9", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2273063c-59", "ovs_interfaceid": "2273063c-59ad-4c22-baac-b35f81cddd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:8c:d9,bridge_name='br-int',has_traffic_filtering=True,id=2273063c-59ad-4c22-baac-b35f81cddd68,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2273063c-59') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG os_vif [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:8c:d9,bridge_name='br-int',has_traffic_filtering=True,id=2273063c-59ad-4c22-baac-b35f81cddd68,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2273063c-59') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c1366a0-b27b-5498-b084-8196baff2097', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2273063c-59, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2273063c-59, col_values=(('qos', UUID('60662d5e-4249-4374-ac7c-efa121d19ef6')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2273063c-59, col_values=(('external_ids', {'iface-id': '2273063c-59ad-4c22-baac-b35f81cddd68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:8c:d9', 'vm-uuid': '7982934b-8c0f-4403-8607-2a2679070e02'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:18 user nova-compute[75356]: INFO os_vif [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:8c:d9,bridge_name='br-int',has_traffic_filtering=True,id=2273063c-59ad-4c22-baac-b35f81cddd68,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2273063c-59')
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] No VIF found with MAC fa:16:3e:3f:8c:d9, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.network.neutron [req-0c98774b-80c0-4f4b-9a7a-090e1dac44d1 req-4424f136-1329-4cee-b74a-5794ec35dbb7 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Updated VIF entry in instance network info cache for port 2273063c-59ad-4c22-baac-b35f81cddd68. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG nova.network.neutron [req-0c98774b-80c0-4f4b-9a7a-090e1dac44d1 req-4424f136-1329-4cee-b74a-5794ec35dbb7 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Updating instance_info_cache with network_info: [{"id": "2273063c-59ad-4c22-baac-b35f81cddd68", "address": "fa:16:3e:3f:8c:d9", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2273063c-59", "ovs_interfaceid": "2273063c-59ad-4c22-baac-b35f81cddd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:22:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0c98774b-80c0-4f4b-9a7a-090e1dac44d1 req-4424f136-1329-4cee-b74a-5794ec35dbb7 service nova] Releasing lock "refresh_cache-7982934b-8c0f-4403-8607-2a2679070e02" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:22:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-ac5b537c-59a6-407f-b58a-f485923c94c4 req-9e0884f5-96bc-48bc-b49e-87d01e15a389 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received event network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:22:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ac5b537c-59a6-407f-b58a-f485923c94c4 req-9e0884f5-96bc-48bc-b49e-87d01e15a389 service nova] Acquiring lock "7982934b-8c0f-4403-8607-2a2679070e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ac5b537c-59a6-407f-b58a-f485923c94c4 req-9e0884f5-96bc-48bc-b49e-87d01e15a389 service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ac5b537c-59a6-407f-b58a-f485923c94c4 req-9e0884f5-96bc-48bc-b49e-87d01e15a389 service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-ac5b537c-59a6-407f-b58a-f485923c94c4 req-9e0884f5-96bc-48bc-b49e-87d01e15a389 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] No waiting events found dispatching network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:22:20 user nova-compute[75356]: WARNING nova.compute.manager [req-ac5b537c-59a6-407f-b58a-f485923c94c4 req-9e0884f5-96bc-48bc-b49e-87d01e15a389 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received unexpected event network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 for instance with vm_state building and task_state spawning.
Nov 29 20:22:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "68f3a04c-4259-4ead-9fd2-65d4651fee4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "68f3a04c-4259-4ead-9fd2-65d4651fee4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "68f3a04c-4259-4ead-9fd2-65d4651fee4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "68f3a04c-4259-4ead-9fd2-65d4651fee4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "68f3a04c-4259-4ead-9fd2-65d4651fee4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:21 user nova-compute[75356]: INFO nova.compute.manager [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Terminating instance
Nov 29 20:22:21 user nova-compute[75356]: DEBUG nova.compute.manager [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:22:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:22 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Instance destroyed successfully.
Nov 29 20:22:22 user nova-compute[75356]: DEBUG nova.objects.instance [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lazy-loading 'resources' on Instance uuid 68f3a04c-4259-4ead-9fd2-65d4651fee4b {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:20:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1691522379',display_name='tempest-VolumesAdminNegativeTest-server-1691522379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1691522379',id=14,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:20:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2e9eb99ca1b4dddb0075e78847b980b',ramdisk_id='',reservation_id='r-5i65o6yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1603071749',owner_user_name='tempest-VolumesAdminNegativeTest-1603071749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:20:29Z,user_data=None,user_id='91cd534885224b259429518c575b82e7',uuid=68f3a04c-4259-4ead-9fd2-65d4651fee4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f1cd6cc-489d-47c0-a112-119d74b216d9", "address": "fa:16:3e:3a:83:bd", "network": {"id": "4e1439ac-1b43-4407-997e-6ac5b6a0066f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2125172073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2e9eb99ca1b4dddb0075e78847b980b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1cd6cc-48", "ovs_interfaceid": "0f1cd6cc-489d-47c0-a112-119d74b216d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Converting VIF {"id": "0f1cd6cc-489d-47c0-a112-119d74b216d9", "address": "fa:16:3e:3a:83:bd", "network": {"id": "4e1439ac-1b43-4407-997e-6ac5b6a0066f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2125172073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2e9eb99ca1b4dddb0075e78847b980b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1cd6cc-48", "ovs_interfaceid": "0f1cd6cc-489d-47c0-a112-119d74b216d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:83:bd,bridge_name='br-int',has_traffic_filtering=True,id=0f1cd6cc-489d-47c0-a112-119d74b216d9,network=Network(4e1439ac-1b43-4407-997e-6ac5b6a0066f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f1cd6cc-48') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG os_vif [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:83:bd,bridge_name='br-int',has_traffic_filtering=True,id=0f1cd6cc-489d-47c0-a112-119d74b216d9,network=Network(4e1439ac-1b43-4407-997e-6ac5b6a0066f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f1cd6cc-48') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f1cd6cc-48, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c895b5a-b6d6-4f8c-b5f7-4a376b7e711e) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:22 user nova-compute[75356]: INFO os_vif [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:83:bd,bridge_name='br-int',has_traffic_filtering=True,id=0f1cd6cc-489d-47c0-a112-119d74b216d9,network=Network(4e1439ac-1b43-4407-997e-6ac5b6a0066f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f1cd6cc-48')
Nov 29 20:22:22 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Deleting instance files /opt/stack/data/nova/instances/68f3a04c-4259-4ead-9fd2-65d4651fee4b_del
Nov 29 20:22:22 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Deletion of /opt/stack/data/nova/instances/68f3a04c-4259-4ead-9fd2-65d4651fee4b_del complete
Nov 29 20:22:22 user nova-compute[75356]: DEBUG nova.compute.manager [req-5bccee65-d330-43de-8123-d80019d60c27 req-b1a96262-70c3-434a-9baa-d7c67e632f58 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received event network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5bccee65-d330-43de-8123-d80019d60c27 req-b1a96262-70c3-434a-9baa-d7c67e632f58 service nova] Acquiring lock "7982934b-8c0f-4403-8607-2a2679070e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5bccee65-d330-43de-8123-d80019d60c27 req-b1a96262-70c3-434a-9baa-d7c67e632f58 service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5bccee65-d330-43de-8123-d80019d60c27 req-b1a96262-70c3-434a-9baa-d7c67e632f58 service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG nova.compute.manager [req-5bccee65-d330-43de-8123-d80019d60c27 req-b1a96262-70c3-434a-9baa-d7c67e632f58 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] No waiting events found dispatching network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:22:22 user nova-compute[75356]: WARNING nova.compute.manager [req-5bccee65-d330-43de-8123-d80019d60c27 req-b1a96262-70c3-434a-9baa-d7c67e632f58 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received unexpected event network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 for instance with vm_state building and task_state spawning.
Nov 29 20:22:22 user nova-compute[75356]: DEBUG nova.compute.manager [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:22:22 user nova-compute[75356]: INFO nova.compute.manager [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 29 20:22:22 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:22:22 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Instance spawned successfully.
Nov 29 20:22:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:22:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:22:22 user nova-compute[75356]: INFO nova.compute.manager [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Took 6.69 seconds to spawn the instance on the hypervisor.
Nov 29 20:22:22 user nova-compute[75356]: DEBUG nova.compute.manager [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:22:22 user nova-compute[75356]: INFO nova.compute.manager [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Took 7.86 seconds to build instance.
Nov 29 20:22:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da9f469c-321c-4ef5-be99-1d9d92ab6199 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "7982934b-8c0f-4403-8607-2a2679070e02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.014s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:23 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:22:23 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Took 0.91 seconds to deallocate network for instance.
Nov 29 20:22:23 user nova-compute[75356]: DEBUG nova.compute.manager [req-01e14f75-0efb-49fe-b67a-964d7b21ddac req-72538b7b-2cc1-4de9-9156-af68278ae930 service nova] [instance: 68f3a04c-4259-4ead-9fd2-65d4651fee4b] Received event network-vif-deleted-0f1cd6cc-489d-47c0-a112-119d74b216d9 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:22:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:24 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:22:24 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:22:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.684s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:24 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Deleted allocations for instance 68f3a04c-4259-4ead-9fd2-65d4651fee4b
Nov 29 20:22:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-97698a6b-a942-4f1a-8826-f404d9154ca5 tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "68f3a04c-4259-4ead-9fd2-65d4651fee4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.862s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:42 user nova-compute[75356]: DEBUG nova.compute.manager [req-5daa2a7e-c241-450e-92ad-d0f01318c33c req-1ce903dd-5678-4c24-ae81-0a0e133af183 service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Received event network-changed-b592a6b3-336d-4af0-ac33-8aa5f050fe9e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:22:42 user nova-compute[75356]: DEBUG nova.compute.manager [req-5daa2a7e-c241-450e-92ad-d0f01318c33c req-1ce903dd-5678-4c24-ae81-0a0e133af183 service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Refreshing instance network info cache due to event network-changed-b592a6b3-336d-4af0-ac33-8aa5f050fe9e. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:22:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5daa2a7e-c241-450e-92ad-d0f01318c33c req-1ce903dd-5678-4c24-ae81-0a0e133af183 service nova] Acquiring lock "refresh_cache-36ec2327-b376-49e4-8592-b2a077b79043" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:22:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5daa2a7e-c241-450e-92ad-d0f01318c33c req-1ce903dd-5678-4c24-ae81-0a0e133af183 service nova] Acquired lock "refresh_cache-36ec2327-b376-49e4-8592-b2a077b79043" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:22:42 user nova-compute[75356]: DEBUG nova.network.neutron [req-5daa2a7e-c241-450e-92ad-d0f01318c33c req-1ce903dd-5678-4c24-ae81-0a0e133af183 service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Refreshing network info cache for port b592a6b3-336d-4af0-ac33-8aa5f050fe9e {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "36ec2327-b376-49e4-8592-b2a077b79043" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "36ec2327-b376-49e4-8592-b2a077b79043" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG nova.network.neutron [req-5daa2a7e-c241-450e-92ad-d0f01318c33c req-1ce903dd-5678-4c24-ae81-0a0e133af183 service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Updated VIF entry in instance network info cache for port b592a6b3-336d-4af0-ac33-8aa5f050fe9e. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG nova.network.neutron [req-5daa2a7e-c241-450e-92ad-d0f01318c33c req-1ce903dd-5678-4c24-ae81-0a0e133af183 service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Updating instance_info_cache with network_info: [{"id": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "address": "fa:16:3e:2c:f4:1f", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb592a6b3-33", "ovs_interfaceid": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG nova.objects.instance [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lazy-loading 'flavor' on Instance uuid 36ec2327-b376-49e4-8592-b2a077b79043 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5daa2a7e-c241-450e-92ad-d0f01318c33c req-1ce903dd-5678-4c24-ae81-0a0e133af183 service nova] Releasing lock "refresh_cache-36ec2327-b376-49e4-8592-b2a077b79043" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "36ec2327-b376-49e4-8592-b2a077b79043" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "36ec2327-b376-49e4-8592-b2a077b79043" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "36ec2327-b376-49e4-8592-b2a077b79043" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:43 user nova-compute[75356]: INFO nova.compute.manager [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Attaching volume c894c707-c3c7-4972-8a6d-d54fdc63f13f to /dev/vdb
Nov 29 20:22:43 user nova-compute[75356]: DEBUG os_brick.utils [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dac11aa-df21-4d74-92d4-0d7a4e1c39ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd39e6a-0291-486d-8686-ba372f0369c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[661d7789-5ec8-4b57-9306-b8c7a07b1d07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0699cb-52f8-4d02-b31c-28248b1c45b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:22:43 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:22:43 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc123e6b-454f-46b0-8b2a-b031ee702d62]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG os_brick.utils [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:22:43 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Updating existing volume attachment record: 2e946844-85d6-4194-adbe-ac468b4050af {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:22:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:49 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Acquiring lock "c99f437d-1733-4308-b09f-c02245f5a092" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Lock "c99f437d-1733-4308-b09f-c02245f5a092" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG nova.compute.manager [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:22:51 user nova-compute[75356]: INFO nova.compute.claims [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Claim successful on node user
Nov 29 20:22:51 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrgJDozc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:22:51 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:22:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:22:51 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:22:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:22:51 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:22:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f58d4e-bb34-45a3-8652-cbafa8df2d83]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:22:51 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4815f3aa-2efa-416a-b0cc-287338eed7e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f] added
Nov 29 20:22:51 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88f45ea-dc38-4c42-a555-e9d4d1ae2250]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53bff1e-4e16-4223-ad4b-c0c474222574]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrgJDozc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrgJDozc" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[229310fa-89e7-4606-a49c-64dccba3e6e5]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FrgJDozc'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b411be-78d5-49d7-bb4c-780b63e67037]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:22:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce41f57a-eb39-4e67-a88b-0f36066e846e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:22:52 user nova-compute[75356]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:22:52 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:22:52 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:22:52 user nova-compute[75356]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:22:52 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:22:52 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[188647ee-bf85-4cdc-8f4c-eeea64a403b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f, portal: 172.16.0.220,3260]
Nov 29 20:22:52 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f, portal: 172.16.0.220,3260] successful.
Nov 29 20:22:52 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f596063b-10e6-466a-82cf-7067fecd5379]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a057b6-0877-4c34-96ea-ff8fda817382]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:22:52 user nova-compute[75356]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:22:52 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:22:52 user nova-compute[75356]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:22:52 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:22:52 user nova-compute[75356]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:22:52 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:22:52 user nova-compute[75356]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:22:52 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab7d1ff-95e3-4adb-af9a-e54ea16e05b1]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrgJDozc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG nova.network.neutron [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:22:52 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:22:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG nova.policy [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9bb3aefef5bc4cceab390519d3011aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd915a019138451bb0fff462b8517c76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:52 user nova-compute[75356]: INFO nova.virt.block_device [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Booting with volume ec674ca2-2d24-41fb-a7f9-d680b501e26d at /dev/vda
Nov 29 20:22:52 user nova-compute[75356]: DEBUG os_brick.utils [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be274c5-22dc-4df7-96b7-ba050340a038]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0c20d5-bbe5-46f6-801f-2b98fb96c349]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa9ba30-e37e-4e31-8c6a-abc1c8a15791]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be8c762-8064-4af6-a13c-0784d3ab8589]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:22:52 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:22:52 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb52c72-8f6a-4a57-8bb9-d72766df4a5f]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG os_brick.utils [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:22:52 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Updating existing volume attachment record: e6c9dc5e-a5ea-4913-bea0-1d1d06bba179 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:22:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:22:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23833396566643237', 'path': '/dev/sde'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:22:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833396566643237', 'path': '/dev/sde'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:22:53 user nova-compute[75356]: DEBUG nova.objects.instance [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lazy-loading 'flavor' on Instance uuid 36ec2327-b376-49e4-8592-b2a077b79043 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:22:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:22:53 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:22:53 user nova-compute[75356]:   <source dev="/dev/sde"/>
Nov 29 20:22:53 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:22:53 user nova-compute[75356]:   <serial>c894c707-c3c7-4972-8a6d-d54fdc63f13f</serial>
Nov 29 20:22:53 user nova-compute[75356]: </disk>
Nov 29 20:22:53 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:22:53 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:22:53 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:22:53 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:22:53 user nova-compute[75356]: DEBUG nova.network.neutron [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Successfully created port: 14d91166-520f-4f3c-a8ba-0008a70cae0c {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:22:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:22:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:22:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] No VIF found with MAC fa:16:3e:2c:f4:1f, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:22:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-376ff8a6-2b5a-4dba-bd03-641ab60b0d3b tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "36ec2327-b376-49e4-8592-b2a077b79043" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.427s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:53 user nova-compute[75356]: DEBUG nova.network.neutron [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Successfully created port: 87341715-68d3-4550-ad6a-430a60748b48 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:22:54 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:22:54 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:22:54 user nova-compute[75356]: DEBUG nova.network.neutron [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Successfully created port: a8e6adda-b975-48ea-9406-f177c1bdd532 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:22:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-972e22c1-bd85-4507-9166-ace3fce8e698" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:22:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-972e22c1-bd85-4507-9166-ace3fce8e698" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:22:54 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:22:54 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Updating instance_info_cache with network_info: [{"id": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "address": "fa:16:3e:3b:bc:00", "network": {"id": "4e1439ac-1b43-4407-997e-6ac5b6a0066f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2125172073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2e9eb99ca1b4dddb0075e78847b980b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb6a771-e8", "ovs_interfaceid": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-972e22c1-bd85-4507-9166-ace3fce8e698" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:22:55 user nova-compute[75356]: INFO nova.compute.manager [None req-f542664c-a9ee-443e-8bd9-2fa351ae7e41 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Unrescuing
Nov 29 20:22:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f542664c-a9ee-443e-8bd9-2fa351ae7e41 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquiring lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f542664c-a9ee-443e-8bd9-2fa351ae7e41 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquired lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG nova.network.neutron [None req-f542664c-a9ee-443e-8bd9-2fa351ae7e41 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG nova.network.neutron [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Successfully created port: 9cbefb78-a46e-4d5c-b4f2-0d5cc8011e8c {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:22:55 user nova-compute[75356]: INFO nova.compute.manager [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Rebuilding instance
Nov 29 20:22:55 user nova-compute[75356]: DEBUG nova.compute.manager [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG nova.compute.manager [req-ed0e7fb8-88c6-42f1-b02b-f152f09f972d req-adbf6354-18ed-464c-8766-d3f3f8a283ce service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Received event network-vif-unplugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ed0e7fb8-88c6-42f1-b02b-f152f09f972d req-adbf6354-18ed-464c-8766-d3f3f8a283ce service nova] Acquiring lock "36ec2327-b376-49e4-8592-b2a077b79043-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ed0e7fb8-88c6-42f1-b02b-f152f09f972d req-adbf6354-18ed-464c-8766-d3f3f8a283ce service nova] Lock "36ec2327-b376-49e4-8592-b2a077b79043-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ed0e7fb8-88c6-42f1-b02b-f152f09f972d req-adbf6354-18ed-464c-8766-d3f3f8a283ce service nova] Lock "36ec2327-b376-49e4-8592-b2a077b79043-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG nova.compute.manager [req-ed0e7fb8-88c6-42f1-b02b-f152f09f972d req-adbf6354-18ed-464c-8766-d3f3f8a283ce service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] No waiting events found dispatching network-vif-unplugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:22:55 user nova-compute[75356]: WARNING nova.compute.manager [req-ed0e7fb8-88c6-42f1-b02b-f152f09f972d req-adbf6354-18ed-464c-8766-d3f3f8a283ce service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Received unexpected event network-vif-unplugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e for instance with vm_state active and task_state rebuilding.
Nov 29 20:22:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG nova.compute.manager [req-add78129-9d20-4d90-b7df-0035b41625f7 req-9c78ef8b-ceae-4a35-ae93-25ad9fd0f332 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received event network-changed-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG nova.compute.manager [req-add78129-9d20-4d90-b7df-0035b41625f7 req-9c78ef8b-ceae-4a35-ae93-25ad9fd0f332 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Refreshing instance network info cache due to event network-changed-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-add78129-9d20-4d90-b7df-0035b41625f7 req-9c78ef8b-ceae-4a35-ae93-25ad9fd0f332 service nova] Acquiring lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:56 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Instance destroyed successfully.
Nov 29 20:22:56 user nova-compute[75356]: INFO nova.compute.manager [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Detaching volume c894c707-c3c7-4972-8a6d-d54fdc63f13f
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG nova.network.neutron [None req-f542664c-a9ee-443e-8bd9-2fa351ae7e41 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Updating instance_info_cache with network_info: [{"id": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "address": "fa:16:3e:6b:b2:4e", "network": {"id": "27a8d395-36c8-4f27-89cf-f5019ccbf9a2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45448e5cb4e84c14b1114846a6ccbdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ec4756-3f", "ovs_interfaceid": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f542664c-a9ee-443e-8bd9-2fa351ae7e41 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Releasing lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG nova.objects.instance [None req-f542664c-a9ee-443e-8bd9-2fa351ae7e41 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lazy-loading 'flavor' on Instance uuid 28f5dcc3-db77-4c65-87af-e300f99d2be5 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-add78129-9d20-4d90-b7df-0035b41625f7 req-9c78ef8b-ceae-4a35-ae93-25ad9fd0f332 service nova] Acquired lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG nova.network.neutron [req-add78129-9d20-4d90-b7df-0035b41625f7 req-9c78ef8b-ceae-4a35-ae93-25ad9fd0f332 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Refreshing network info cache for port d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:22:56 user nova-compute[75356]: INFO nova.virt.block_device [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Attempting to driver detach volume c894c707-c3c7-4972-8a6d-d54fdc63f13f from mountpoint /dev/vdb
Nov 29 20:22:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Attempting to detach device vdb from instance 36ec2327-b376-49e4-8592-b2a077b79043 from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:22:56 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:22:56 user nova-compute[75356]:   <source dev="/dev/sde"/>
Nov 29 20:22:56 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:22:56 user nova-compute[75356]:   <serial>c894c707-c3c7-4972-8a6d-d54fdc63f13f</serial>
Nov 29 20:22:56 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:22:56 user nova-compute[75356]: </disk>
Nov 29 20:22:56 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:22:56 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Successfully detached device vdb from instance 36ec2327-b376-49e4-8592-b2a077b79043 from the persistent domain config.
Nov 29 20:22:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrgJDozc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:22:56 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 20:22:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e198aa1a-c9ba-49a4-8dcf-3ec56bb89cd0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:22:56 user nova-compute[75356]: No targets found.
Nov 29 20:22:56 user nova-compute[75356]: iSNS:
Nov 29 20:22:56 user nova-compute[75356]: No targets found.
Nov 29 20:22:56 user nova-compute[75356]: STATIC:
Nov 29 20:22:56 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7
Nov 29 20:22:56 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:22:56 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:22:56 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061
Nov 29 20:22:56 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:22:56 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:22:56 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f
Nov 29 20:22:56 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:22:56 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:22:56 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:22:56 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:22:56 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:22:56 user nova-compute[75356]: FIRMWARE:
Nov 29 20:22:56 user nova-compute[75356]: No targets found.
Nov 29 20:22:56 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:22:56 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:22:56 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c332b6eb-f71d-406a-9fdb-390ba6b79891]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e571c20-38d7-416d-9738-6c8caadb2e19]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:22:56 user nova-compute[75356]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:22:56 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:22:56 user nova-compute[75356]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:22:56 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:22:56 user nova-compute[75356]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:22:56 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:22:56 user nova-compute[75356]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:22:56 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e44c0af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f'): ({'sde'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Removing single pathed devices sde {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG nova.network.neutron [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Successfully created port: ff38dd75-d1cf-484b-9f90-d07dde95ec85 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[26796c8d-f709-47e1-aae5-9c2065a7c8a9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c482f6-2039-400a-adcc-fea0ff2a0141]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Flushing IO for device /dev/sde {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[053f4215-96aa-4cab-b03d-00c2e6b401af]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c226f481-cefc-4ff5-ab38-428c8308585f]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] SCSI volumes sde have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fe5d6d-bfb3-496d-b4c1-b05921956970]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c8a0eb-9a98-497d-8d12-ab2159fa2786]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f, portal: 172.16.0.220,3260]
Nov 29 20:22:57 user nova-compute[75356]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f, portal: 172.16.0.220,3260] successful.
Nov 29 20:22:57 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2689451-10a0-4a4c-8c75-c68022e5bf3f]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.452s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] <== disconnect_volume: return (453ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG nova.network.neutron [req-add78129-9d20-4d90-b7df-0035b41625f7 req-9c78ef8b-ceae-4a35-ae93-25ad9fd0f332 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Updated VIF entry in instance network info cache for port d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG nova.network.neutron [req-add78129-9d20-4d90-b7df-0035b41625f7 req-9c78ef8b-ceae-4a35-ae93-25ad9fd0f332 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Updating instance_info_cache with network_info: [{"id": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "address": "fa:16:3e:6b:b2:4e", "network": {"id": "27a8d395-36c8-4f27-89cf-f5019ccbf9a2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45448e5cb4e84c14b1114846a6ccbdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ec4756-3f", "ovs_interfaceid": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-add78129-9d20-4d90-b7df-0035b41625f7 req-9c78ef8b-ceae-4a35-ae93-25ad9fd0f332 service nova] Releasing lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:22:57 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Instance destroyed successfully.
Nov 29 20:22:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:57 user nova-compute[75356]: DEBUG nova.network.neutron [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Successfully updated port: 14d91166-520f-4f3c-a8ba-0008a70cae0c {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG nova.compute.manager [req-e2c83b3d-8228-4ce2-a13a-7bc136d4a0ea req-66d65aee-e01e-489d-a158-a92489da6abd service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Received event network-vif-plugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e2c83b3d-8228-4ce2-a13a-7bc136d4a0ea req-66d65aee-e01e-489d-a158-a92489da6abd service nova] Acquiring lock "36ec2327-b376-49e4-8592-b2a077b79043-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e2c83b3d-8228-4ce2-a13a-7bc136d4a0ea req-66d65aee-e01e-489d-a158-a92489da6abd service nova] Lock "36ec2327-b376-49e4-8592-b2a077b79043-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e2c83b3d-8228-4ce2-a13a-7bc136d4a0ea req-66d65aee-e01e-489d-a158-a92489da6abd service nova] Lock "36ec2327-b376-49e4-8592-b2a077b79043-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG nova.compute.manager [req-e2c83b3d-8228-4ce2-a13a-7bc136d4a0ea req-66d65aee-e01e-489d-a158-a92489da6abd service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] No waiting events found dispatching network-vif-plugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:22:58 user nova-compute[75356]: WARNING nova.compute.manager [req-e2c83b3d-8228-4ce2-a13a-7bc136d4a0ea req-66d65aee-e01e-489d-a158-a92489da6abd service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Received unexpected event network-vif-plugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e for instance with vm_state active and task_state rebuilding.
Nov 29 20:22:58 user nova-compute[75356]: DEBUG nova.compute.manager [req-2fb66ede-565c-4b88-a654-69db93c03d83 req-d617f0c5-73ad-4ba0-ac24-c0fd19d8513f service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Received event network-changed-14d91166-520f-4f3c-a8ba-0008a70cae0c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG nova.compute.manager [req-2fb66ede-565c-4b88-a654-69db93c03d83 req-d617f0c5-73ad-4ba0-ac24-c0fd19d8513f service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Refreshing instance network info cache due to event network-changed-14d91166-520f-4f3c-a8ba-0008a70cae0c. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2fb66ede-565c-4b88-a654-69db93c03d83 req-d617f0c5-73ad-4ba0-ac24-c0fd19d8513f service nova] Acquiring lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2fb66ede-565c-4b88-a654-69db93c03d83 req-d617f0c5-73ad-4ba0-ac24-c0fd19d8513f service nova] Acquired lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG nova.network.neutron [req-2fb66ede-565c-4b88-a654-69db93c03d83 req-d617f0c5-73ad-4ba0-ac24-c0fd19d8513f service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Refreshing network info cache for port 14d91166-520f-4f3c-a8ba-0008a70cae0c {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG nova.network.neutron [req-2fb66ede-565c-4b88-a654-69db93c03d83 req-d617f0c5-73ad-4ba0-ac24-c0fd19d8513f service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:22:58 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Instance destroyed successfully.
Nov 29 20:22:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2086140812',display_name='tempest-ServerActionsTestOtherA-server-959033318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2086140812',id=15,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkT9y7rrd/Y5ebvEZ6un5mDuYkh3taeh/2CNWnRGvskqEqjhBdlrCLi3cPcBtL8QdOGFvHh7tZcM81p1N+u4M88CWgTrMXsWASi0tU/5YZzvvrfG6YTm/WptIWFFOdngQ==',key_name='tempest-keypair-24359724',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:21:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8b14efb1a4d34a3db7a51bd79234b86b',ramdisk_id='',reservation_id='r-8udz7yf5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1000495362',owner_user_name='tempest-ServerActionsTestOtherA-1000495362-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:22:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc7cfc71d0c448cbbe8d42f8b617d8b',uuid=36ec2327-b376-49e4-8592-b2a077b79043,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "address": "fa:16:3e:2c:f4:1f", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb592a6b3-33", "ovs_interfaceid": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converting VIF {"id": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "address": "fa:16:3e:2c:f4:1f", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb592a6b3-33", "ovs_interfaceid": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:f4:1f,bridge_name='br-int',has_traffic_filtering=True,id=b592a6b3-336d-4af0-ac33-8aa5f050fe9e,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb592a6b3-33') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_vif [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:f4:1f,bridge_name='br-int',has_traffic_filtering=True,id=b592a6b3-336d-4af0-ac33-8aa5f050fe9e,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb592a6b3-33') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb592a6b3-33, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG nova.compute.manager [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received event network-changed-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG nova.compute.manager [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Refreshing instance network info cache due to event network-changed-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] Acquiring lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] Acquired lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG nova.network.neutron [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Refreshing network info cache for port d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd5386d5-ad09-476e-9e51-ac12b17544e8) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:58 user nova-compute[75356]: INFO os_vif [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:f4:1f,bridge_name='br-int',has_traffic_filtering=True,id=b592a6b3-336d-4af0-ac33-8aa5f050fe9e,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb592a6b3-33')
Nov 29 20:22:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrgJDozc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:22:58 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e847eb-d87b-4abc-99d0-72b3c2d29225]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:22:58 user nova-compute[75356]: No targets found.
Nov 29 20:22:58 user nova-compute[75356]: iSNS:
Nov 29 20:22:58 user nova-compute[75356]: No targets found.
Nov 29 20:22:58 user nova-compute[75356]: STATIC:
Nov 29 20:22:58 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7
Nov 29 20:22:58 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:22:58 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:22:58 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061
Nov 29 20:22:58 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:22:58 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:22:58 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:22:58 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:22:58 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:22:58 user nova-compute[75356]: FIRMWARE:
Nov 29 20:22:58 user nova-compute[75356]: No targets found.
Nov 29 20:22:58 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:22:58 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:22:58 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "3584b853-567c-4dd2-ae4f-3ff074074137" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "3584b853-567c-4dd2-ae4f-3ff074074137" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf08564-16f3-4a8a-ba30-62981319f628]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG nova.objects.instance [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lazy-loading 'flavor' on Instance uuid 3584b853-567c-4dd2-ae4f-3ff074074137 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:58 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Ignoring supplied device name: /dev/vdb
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a520b70-fb01-4f2c-82dc-92893308b6b8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:22:58 user nova-compute[75356]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:22:58 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:22:58 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:22:58 user nova-compute[75356]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:22:58 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:22:58 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e422e560>, {}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Disconnecting from: [] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.136s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] <== disconnect_volume: return (140ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:22:58 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Deleting instance files /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043_del
Nov 29 20:22:58 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Deletion of /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043_del complete
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "3584b853-567c-4dd2-ae4f-3ff074074137" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG nova.network.neutron [req-2fb66ede-565c-4b88-a654-69db93c03d83 req-d617f0c5-73ad-4ba0-ac24-c0fd19d8513f service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:22:58 user nova-compute[75356]: INFO nova.virt.block_device [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Booting with volume c894c707-c3c7-4972-8a6d-d54fdc63f13f at /dev/vdb
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "3584b853-567c-4dd2-ae4f-3ff074074137" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "3584b853-567c-4dd2-ae4f-3ff074074137" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:58 user nova-compute[75356]: INFO nova.compute.manager [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Attaching volume 666acfe8-575a-47c8-9d8b-160fd478283c to /dev/vdb
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2fb66ede-565c-4b88-a654-69db93c03d83 req-d617f0c5-73ad-4ba0-ac24-c0fd19d8513f service nova] Releasing lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.utils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.utils [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b00913-a0e9-4958-ba5a-3820c1325a90]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a72ec2d-c43c-4595-ba8c-f98abfc5f4a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[67aa7d7a-29c5-4f19-85ba-7409b7b90944]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[defce9d1-9b72-4332-ba6b-3b99df2ea8ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2f6182-fa85-4e35-806c-5b9c9cc5674a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad40bc80-21e2-4fa0-a64f-a66f376281d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ee8731-6cd4-449e-8a45-08f445b6cfcc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[313386ba-4868-4611-b1f6-bb5abed265c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:22:58 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f230a0-7253-41b3-a4b9-1c6512fdccd7]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.utils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] <== get_connector_properties: return (219ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Updating existing volume attachment record: 0aec50e6-1346-4d72-a2d4-06282d73b3ff {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:22:58 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:22:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ac2759-1830-49d2-ba97-976d7ac54be8]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG os_brick.utils [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] <== get_connector_properties: return (261ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:22:58 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Updating existing volume attachment record: 399a46cb-502e-4ade-9a3c-8ab2bd3fdf91 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG nova.network.neutron [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Successfully updated port: 6df7e515-67dd-4949-b2b9-8d166cf37900 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG nova.network.neutron [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Updated VIF entry in instance network info cache for port d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG nova.network.neutron [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Updating instance_info_cache with network_info: [{"id": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "address": "fa:16:3e:6b:b2:4e", "network": {"id": "27a8d395-36c8-4f27-89cf-f5019ccbf9a2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45448e5cb4e84c14b1114846a6ccbdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ec4756-3f", "ovs_interfaceid": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] Releasing lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received event network-vif-unplugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] Acquiring lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] No waiting events found dispatching network-vif-unplugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:22:59 user nova-compute[75356]: WARNING nova.compute.manager [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received unexpected event network-vif-unplugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e for instance with vm_state rescued and task_state unrescuing.
Nov 29 20:22:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received event network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] Acquiring lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] No waiting events found dispatching network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:22:59 user nova-compute[75356]: WARNING nova.compute.manager [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received unexpected event network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e for instance with vm_state rescued and task_state unrescuing.
Nov 29 20:22:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Received event network-changed-bd24c38c-a857-4b18-9d9b-55f692288c5f {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Refreshing instance network info cache due to event network-changed-bd24c38c-a857-4b18-9d9b-55f692288c5f. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] Acquiring lock "refresh_cache-3584b853-567c-4dd2-ae4f-3ff074074137" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] Acquired lock "refresh_cache-3584b853-567c-4dd2-ae4f-3ff074074137" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG nova.network.neutron [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Refreshing network info cache for port bd24c38c-a857-4b18-9d9b-55f692288c5f {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:22:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:00 user nova-compute[75356]: DEBUG nova.network.neutron [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Updated VIF entry in instance network info cache for port bd24c38c-a857-4b18-9d9b-55f692288c5f. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:23:00 user nova-compute[75356]: DEBUG nova.network.neutron [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Updating instance_info_cache with network_info: [{"id": "bd24c38c-a857-4b18-9d9b-55f692288c5f", "address": "fa:16:3e:db:49:9b", "network": {"id": "c1768664-edc2-4213-80e3-64f7600eeb75", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688549704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85535b509efe4dbb81c372f9031faac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd24c38c-a8", "ovs_interfaceid": "bd24c38c-a857-4b18-9d9b-55f692288c5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:23:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9acea1d3-aa6c-4fbf-b3dd-a06d031a2cb6 req-2b299689-dd22-451c-b1e1-c3669a5c861e service nova] Releasing lock "refresh_cache-3584b853-567c-4dd2-ae4f-3ff074074137" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:23:00 user nova-compute[75356]: DEBUG nova.compute.manager [req-c6c28720-c559-4dc6-b32b-4a95def9dbfe req-52a11f64-ac0e-4f20-804a-ab7f76057ddc service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Received event network-changed-6df7e515-67dd-4949-b2b9-8d166cf37900 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:23:00 user nova-compute[75356]: DEBUG nova.compute.manager [req-c6c28720-c559-4dc6-b32b-4a95def9dbfe req-52a11f64-ac0e-4f20-804a-ab7f76057ddc service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Refreshing instance network info cache due to event network-changed-6df7e515-67dd-4949-b2b9-8d166cf37900. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:23:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c6c28720-c559-4dc6-b32b-4a95def9dbfe req-52a11f64-ac0e-4f20-804a-ab7f76057ddc service nova] Acquiring lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:23:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c6c28720-c559-4dc6-b32b-4a95def9dbfe req-52a11f64-ac0e-4f20-804a-ab7f76057ddc service nova] Acquired lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:23:00 user nova-compute[75356]: DEBUG nova.network.neutron [req-c6c28720-c559-4dc6-b32b-4a95def9dbfe req-52a11f64-ac0e-4f20-804a-ab7f76057ddc service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Refreshing network info cache for port 6df7e515-67dd-4949-b2b9-8d166cf37900 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:23:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:00 user nova-compute[75356]: DEBUG nova.network.neutron [req-c6c28720-c559-4dc6-b32b-4a95def9dbfe req-52a11f64-ac0e-4f20-804a-ab7f76057ddc service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:23:00 user nova-compute[75356]: DEBUG nova.network.neutron [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Successfully updated port: 6e167015-5089-43d5-9e1d-e5f16148b9e9 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:23:00 user nova-compute[75356]: DEBUG nova.compute.manager [req-b68ed2bd-5906-4849-b961-018193bfd043 req-16289a68-0fd4-4dee-b9a7-3672258cdb3b service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received event network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:23:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b68ed2bd-5906-4849-b961-018193bfd043 req-16289a68-0fd4-4dee-b9a7-3672258cdb3b service nova] Acquiring lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b68ed2bd-5906-4849-b961-018193bfd043 req-16289a68-0fd4-4dee-b9a7-3672258cdb3b service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b68ed2bd-5906-4849-b961-018193bfd043 req-16289a68-0fd4-4dee-b9a7-3672258cdb3b service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:00 user nova-compute[75356]: DEBUG nova.compute.manager [req-b68ed2bd-5906-4849-b961-018193bfd043 req-16289a68-0fd4-4dee-b9a7-3672258cdb3b service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] No waiting events found dispatching network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:23:00 user nova-compute[75356]: WARNING nova.compute.manager [req-b68ed2bd-5906-4849-b961-018193bfd043 req-16289a68-0fd4-4dee-b9a7-3672258cdb3b service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received unexpected event network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e for instance with vm_state rescued and task_state unrescuing.
Nov 29 20:23:00 user nova-compute[75356]: DEBUG nova.compute.manager [req-b68ed2bd-5906-4849-b961-018193bfd043 req-16289a68-0fd4-4dee-b9a7-3672258cdb3b service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received event network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:23:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b68ed2bd-5906-4849-b961-018193bfd043 req-16289a68-0fd4-4dee-b9a7-3672258cdb3b service nova] Acquiring lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b68ed2bd-5906-4849-b961-018193bfd043 req-16289a68-0fd4-4dee-b9a7-3672258cdb3b service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b68ed2bd-5906-4849-b961-018193bfd043 req-16289a68-0fd4-4dee-b9a7-3672258cdb3b service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:00 user nova-compute[75356]: DEBUG nova.compute.manager [req-b68ed2bd-5906-4849-b961-018193bfd043 req-16289a68-0fd4-4dee-b9a7-3672258cdb3b service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] No waiting events found dispatching network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:23:00 user nova-compute[75356]: WARNING nova.compute.manager [req-b68ed2bd-5906-4849-b961-018193bfd043 req-16289a68-0fd4-4dee-b9a7-3672258cdb3b service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received unexpected event network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e for instance with vm_state rescued and task_state unrescuing.
Nov 29 20:23:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.network.neutron [req-c6c28720-c559-4dc6-b32b-4a95def9dbfe req-52a11f64-ac0e-4f20-804a-ab7f76057ddc service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-78fb90e2-79e2-4773-a813-b932193c2308 req-8afe288e-b131-48fc-b52f-b75769c01983 service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Received event network-changed-6e167015-5089-43d5-9e1d-e5f16148b9e9 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-78fb90e2-79e2-4773-a813-b932193c2308 req-8afe288e-b131-48fc-b52f-b75769c01983 service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Refreshing instance network info cache due to event network-changed-6e167015-5089-43d5-9e1d-e5f16148b9e9. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-78fb90e2-79e2-4773-a813-b932193c2308 req-8afe288e-b131-48fc-b52f-b75769c01983 service nova] Acquiring lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.compute.manager [None req-f542664c-a9ee-443e-8bd9-2fa351ae7e41 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c6c28720-c559-4dc6-b32b-4a95def9dbfe req-52a11f64-ac0e-4f20-804a-ab7f76057ddc service nova] Releasing lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-78fb90e2-79e2-4773-a813-b932193c2308 req-8afe288e-b131-48fc-b52f-b75769c01983 service nova] Acquired lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.network.neutron [req-78fb90e2-79e2-4773-a813-b932193c2308 req-8afe288e-b131-48fc-b52f-b75769c01983 service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Refreshing network info cache for port 6e167015-5089-43d5-9e1d-e5f16148b9e9 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:23:02 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:23:02 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=7151MB free_disk=25.20541763305664GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:02 user nova-compute[75356]: INFO nova.virt.block_device [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Booting with volume 305f8a41-38c4-4f35-bd73-dd421cd1e14e at /dev/vdb
Nov 29 20:23:02 user nova-compute[75356]: DEBUG os_brick.utils [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Applying migration context for instance 96cbbbdb-e1cc-49da-9a9f-5b83031b235b as it has an incoming, in-progress migration a3c2ad02-b4f9-4432-b3c4-eed1ba5b1b92. Migration status is reverting {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 20:23:02 user nova-compute[75356]: INFO nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Updating resource usage from migration a3c2ad02-b4f9-4432-b3c4-eed1ba5b1b92
Nov 29 20:23:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a45dbaa-8694-46a0-9193-8af172bda9b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8020a9-4f72-4623-bcad-ca674b6732cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83efffe-c060-4826-ae4e-c8306a0c009d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1211bb81-4aaa-4f1b-a53b-f4a28b2e7e8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:23:02 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:23:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc41b454-2362-4a8e-a283-a01b37308206]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG os_brick.utils [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] <== get_connector_properties: return (227ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Updating existing volume attachment record: 00668850-0d6a-4c2d-8b7b-04faabbbc69d {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 9751c435-4d10-46dc-86e7-39d40e8209d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0b59517a-c467-432a-a73a-d1460c1574e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 972e22c1-bd85-4507-9166-ace3fce8e698 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 36ec2327-b376-49e4-8592-b2a077b79043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 3584b853-567c-4dd2-ae4f-3ff074074137 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Migration a3c2ad02-b4f9-4432-b3c4-eed1ba5b1b92 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 96cbbbdb-e1cc-49da-9a9f-5b83031b235b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0f9149e4-424b-42af-bd25-19d1cc7c0635 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 7d27c88e-5de8-4401-aa9d-d88643b478b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance db0826f0-5fdc-47a8-ae36-5059844980c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 7982934b-8c0f-4403-8607-2a2679070e02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance c99f437d-1733-4308-b09f-c02245f5a092 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing inventories for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Updating ProviderTree inventory for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Updating inventory in ProviderTree for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing aggregate associations for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a, aggregates: None {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing trait associations for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 20:23:02 user nova-compute[75356]: DEBUG nova.network.neutron [req-78fb90e2-79e2-4773-a813-b932193c2308 req-8afe288e-b131-48fc-b52f-b75769c01983 service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:23:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:03 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:23:03 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:23:03 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:23:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.073s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:03 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:23:03 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Cleaning up deleted instances {{(pid=75356) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 20:23:03 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] There are 0 instances to clean {{(pid=75356) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 20:23:03 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:23:03 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75356) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 20:23:03 user nova-compute[75356]: DEBUG nova.network.neutron [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Port bf5b9476-92db-4a94-bcdd-485ba68a4d1e binding to destination host user is already ACTIVE {{(pid=75356) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 20:23:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:23:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquired lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:23:03 user nova-compute[75356]: DEBUG nova.network.neutron [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:23:03 user nova-compute[75356]: DEBUG nova.network.neutron [req-78fb90e2-79e2-4773-a813-b932193c2308 req-8afe288e-b131-48fc-b52f-b75769c01983 service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:23:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-78fb90e2-79e2-4773-a813-b932193c2308 req-8afe288e-b131-48fc-b52f-b75769c01983 service nova] Releasing lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:23:03 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:23:03 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:23:03 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:23:03 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:23:03 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:23:04 user nova-compute[75356]: DEBUG nova.network.neutron [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Updating instance_info_cache with network_info: [{"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:23:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Releasing lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:23:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Creating tmpfile /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/tmpvzjmpudj to verify with other compute node that the instance is on the same shared storage. {{(pid=75356) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 29 20:23:04 user nova-compute[75356]: DEBUG nova.network.neutron [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Successfully updated port: 87341715-68d3-4550-ad6a-430a60748b48 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:23:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:04 user nova-compute[75356]: DEBUG nova.compute.manager [req-6be7e7a6-3321-49ab-9962-2eb1765891d5 req-5cc1ee24-5de1-4d94-ad09-d2fa5f1258c5 service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Received event network-changed-87341715-68d3-4550-ad6a-430a60748b48 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:23:04 user nova-compute[75356]: DEBUG nova.compute.manager [req-6be7e7a6-3321-49ab-9962-2eb1765891d5 req-5cc1ee24-5de1-4d94-ad09-d2fa5f1258c5 service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Refreshing instance network info cache due to event network-changed-87341715-68d3-4550-ad6a-430a60748b48. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:23:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6be7e7a6-3321-49ab-9962-2eb1765891d5 req-5cc1ee24-5de1-4d94-ad09-d2fa5f1258c5 service nova] Acquiring lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:23:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6be7e7a6-3321-49ab-9962-2eb1765891d5 req-5cc1ee24-5de1-4d94-ad09-d2fa5f1258c5 service nova] Acquired lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:23:04 user nova-compute[75356]: DEBUG nova.network.neutron [req-6be7e7a6-3321-49ab-9962-2eb1765891d5 req-5cc1ee24-5de1-4d94-ad09-d2fa5f1258c5 service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Refreshing network info cache for port 87341715-68d3-4550-ad6a-430a60748b48 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:23:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:04 user nova-compute[75356]: DEBUG nova.network.neutron [req-6be7e7a6-3321-49ab-9962-2eb1765891d5 req-5cc1ee24-5de1-4d94-ad09-d2fa5f1258c5 service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:23:04 user nova-compute[75356]: DEBUG nova.compute.manager [req-faa06f9b-e357-405d-9425-2242f7d3ff4f req-8a13ff71-fbf3-4131-b102-05ae5e0fc3b4 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received event network-vif-unplugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:23:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-faa06f9b-e357-405d-9425-2242f7d3ff4f req-8a13ff71-fbf3-4131-b102-05ae5e0fc3b4 service nova] Acquiring lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-faa06f9b-e357-405d-9425-2242f7d3ff4f req-8a13ff71-fbf3-4131-b102-05ae5e0fc3b4 service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-faa06f9b-e357-405d-9425-2242f7d3ff4f req-8a13ff71-fbf3-4131-b102-05ae5e0fc3b4 service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:04 user nova-compute[75356]: DEBUG nova.compute.manager [req-faa06f9b-e357-405d-9425-2242f7d3ff4f req-8a13ff71-fbf3-4131-b102-05ae5e0fc3b4 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] No waiting events found dispatching network-vif-unplugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:23:04 user nova-compute[75356]: WARNING nova.compute.manager [req-faa06f9b-e357-405d-9425-2242f7d3ff4f req-8a13ff71-fbf3-4131-b102-05ae5e0fc3b4 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received unexpected event network-vif-unplugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e for instance with vm_state resized and task_state resize_reverting.
Nov 29 20:23:05 user nova-compute[75356]: DEBUG nova.network.neutron [req-6be7e7a6-3321-49ab-9962-2eb1765891d5 req-5cc1ee24-5de1-4d94-ad09-d2fa5f1258c5 service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6be7e7a6-3321-49ab-9962-2eb1765891d5 req-5cc1ee24-5de1-4d94-ad09-d2fa5f1258c5 service nova] Releasing lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:23:05 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Instance destroyed successfully.
Nov 29 20:23:05 user nova-compute[75356]: DEBUG nova.objects.instance [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lazy-loading 'resources' on Instance uuid 96cbbbdb-e1cc-49da-9a9f-5b83031b235b {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2075887638',display_name='tempest-ServerActionsTestOtherB-server-2075887638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2075887638',id=5,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqmwjesnBZKKmMOP1nU5mLLaxgxAYrWKpY6AKu2j/L1exH/XrbvTGFuJ5hCGjIGc6yFau1HY0D/HH/XuWjDf7bDrvpfXRmVeDF3iS6kjnnvyZ4TUUiMwhiV4HxFj8NX1w==',key_name='tempest-keypair-1339068574',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:21:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19fa4a7548454fc4a29a625b0c819c9c',ramdisk_id='',reservation_id='r-pzj88ta7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-403173210',owner_user_name='tempest-ServerActionsTestOtherB-403173210-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:21:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e5a895cde3741d0a48cb06922ad80f8',uuid=96cbbbdb-e1cc-49da-9a9f-5b83031b235b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Converting VIF {"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:e6:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf5b9476-92db-4a94-bcdd-485ba68a4d1e,network=Network(d5185e2d-1e16-408d-91cf-3c494b84cd52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5b9476-92') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG os_vif [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:e6:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf5b9476-92db-4a94-bcdd-485ba68a4d1e,network=Network(d5185e2d-1e16-408d-91cf-3c494b84cd52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5b9476-92') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf5b9476-92, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5bd3170f-6b25-4a7a-9fa7-e3c0c2e9bb7a) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:23:05 user nova-compute[75356]: INFO os_vif [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:e6:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf5b9476-92db-4a94-bcdd-485ba68a4d1e,network=Network(d5185e2d-1e16-408d-91cf-3c494b84cd52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5b9476-92')
Nov 29 20:23:05 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKteoRvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:23:05 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:23:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f73cd7c-a6eb-4e25-a433-372cb9ed0cfc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:23:05 user nova-compute[75356]: No targets found.
Nov 29 20:23:05 user nova-compute[75356]: iSNS:
Nov 29 20:23:05 user nova-compute[75356]: No targets found.
Nov 29 20:23:05 user nova-compute[75356]: STATIC:
Nov 29 20:23:05 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7
Nov 29 20:23:05 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:23:05 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:23:05 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061
Nov 29 20:23:05 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:23:05 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:23:05 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:23:05 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:23:05 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:23:05 user nova-compute[75356]: FIRMWARE:
Nov 29 20:23:05 user nova-compute[75356]: No targets found.
Nov 29 20:23:05 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:23:05 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:23:05 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4277efb-341e-43dc-b401-2d995a59b797]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[64896249-f0d6-45a6-831d-d26dc3751e3f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:05 user nova-compute[75356]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:23:05 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:23:05 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:05 user nova-compute[75356]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:23:05 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:23:05 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e44e0670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7'): ({'sdc'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Removing single pathed devices sdc {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee17ce90-c0a0-4fba-b036-f797d40f1a2f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ffbefe-9cf9-469b-a9c7-cb4fa3c6700c]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Flushing IO for device /dev/sdc {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a31ee5e-b3d2-4fce-8111-ab16fdaa457d]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d4394a-b5a1-42e3-b668-9cc89fc474f9]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfc66b8-f31c-48a2-b257-cc0b9156f7ba]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG nova.network.neutron [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Successfully updated port: a8e6adda-b975-48ea-9406-f177c1bdd532 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[753e4f0f-d389-493f-a697-4f4e4bed3f44]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260]
Nov 29 20:23:05 user nova-compute[75356]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260] successful.
Nov 29 20:23:05 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[15174772-9459-4606-aba4-a55c32ae448a]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] <== disconnect_volume: return (355ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:23:05 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:23:06 user nova-compute[75356]: DEBUG nova.network.neutron [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Successfully updated port: 9cbefb78-a46e-4d5c-b4f2-0d5cc8011e8c {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:23:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-bd191183-4156-4326-ac6d-6416b4e6d14a req-3a910bb4-c929-494c-a476-040226f4c7d6 service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Received event network-changed-a8e6adda-b975-48ea-9406-f177c1bdd532 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:23:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-bd191183-4156-4326-ac6d-6416b4e6d14a req-3a910bb4-c929-494c-a476-040226f4c7d6 service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Refreshing instance network info cache due to event network-changed-a8e6adda-b975-48ea-9406-f177c1bdd532. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:23:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-bd191183-4156-4326-ac6d-6416b4e6d14a req-3a910bb4-c929-494c-a476-040226f4c7d6 service nova] Acquiring lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:23:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-bd191183-4156-4326-ac6d-6416b4e6d14a req-3a910bb4-c929-494c-a476-040226f4c7d6 service nova] Acquired lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:23:06 user nova-compute[75356]: DEBUG nova.network.neutron [req-bd191183-4156-4326-ac6d-6416b4e6d14a req-3a910bb4-c929-494c-a476-040226f4c7d6 service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Refreshing network info cache for port a8e6adda-b975-48ea-9406-f177c1bdd532 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:23:06 user nova-compute[75356]: DEBUG nova.network.neutron [req-bd191183-4156-4326-ac6d-6416b4e6d14a req-3a910bb4-c929-494c-a476-040226f4c7d6 service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:23:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-2d98eb47-7d96-4f8e-b31f-942a2c2a8191 req-e41c893c-f8b4-4f20-8bd3-a0ff7aeae344 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received event network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:23:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2d98eb47-7d96-4f8e-b31f-942a2c2a8191 req-e41c893c-f8b4-4f20-8bd3-a0ff7aeae344 service nova] Acquiring lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2d98eb47-7d96-4f8e-b31f-942a2c2a8191 req-e41c893c-f8b4-4f20-8bd3-a0ff7aeae344 service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2d98eb47-7d96-4f8e-b31f-942a2c2a8191 req-e41c893c-f8b4-4f20-8bd3-a0ff7aeae344 service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-2d98eb47-7d96-4f8e-b31f-942a2c2a8191 req-e41c893c-f8b4-4f20-8bd3-a0ff7aeae344 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] No waiting events found dispatching network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:23:06 user nova-compute[75356]: WARNING nova.compute.manager [req-2d98eb47-7d96-4f8e-b31f-942a2c2a8191 req-e41c893c-f8b4-4f20-8bd3-a0ff7aeae344 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received unexpected event network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e for instance with vm_state resized and task_state resize_reverting.
Nov 29 20:23:07 user nova-compute[75356]: DEBUG nova.network.neutron [req-bd191183-4156-4326-ac6d-6416b4e6d14a req-3a910bb4-c929-494c-a476-040226f4c7d6 service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-bd191183-4156-4326-ac6d-6416b4e6d14a req-3a910bb4-c929-494c-a476-040226f4c7d6 service nova] Releasing lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-bd191183-4156-4326-ac6d-6416b4e6d14a req-3a910bb4-c929-494c-a476-040226f4c7d6 service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Received event network-changed-9cbefb78-a46e-4d5c-b4f2-0d5cc8011e8c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-bd191183-4156-4326-ac6d-6416b4e6d14a req-3a910bb4-c929-494c-a476-040226f4c7d6 service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Refreshing instance network info cache due to event network-changed-9cbefb78-a46e-4d5c-b4f2-0d5cc8011e8c. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-bd191183-4156-4326-ac6d-6416b4e6d14a req-3a910bb4-c929-494c-a476-040226f4c7d6 service nova] Acquiring lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-bd191183-4156-4326-ac6d-6416b4e6d14a req-3a910bb4-c929-494c-a476-040226f4c7d6 service nova] Acquired lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG nova.network.neutron [req-bd191183-4156-4326-ac6d-6416b4e6d14a req-3a910bb4-c929-494c-a476-040226f4c7d6 service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Refreshing network info cache for port 9cbefb78-a46e-4d5c-b4f2-0d5cc8011e8c {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG nova.network.neutron [req-bd191183-4156-4326-ac6d-6416b4e6d14a req-3a910bb4-c929-494c-a476-040226f4c7d6 service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG nova.network.neutron [req-bd191183-4156-4326-ac6d-6416b4e6d14a req-3a910bb4-c929-494c-a476-040226f4c7d6 service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-bd191183-4156-4326-ac6d-6416b4e6d14a req-3a910bb4-c929-494c-a476-040226f4c7d6 service nova] Releasing lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG nova.network.neutron [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Successfully updated port: ff38dd75-d1cf-484b-9f90-d07dde95ec85 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Acquiring lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Acquired lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG nova.network.neutron [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG nova.network.neutron [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'waIcDgEV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:23:07 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:23:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:23:07 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:23:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:23:07 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:23:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d93405b-c2be-44ab-aa5a-5d8ef68f6620]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:23:07 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1517329a-4b1b-4f5a-bc39-65ed77671b32]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c] added
Nov 29 20:23:07 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7b7540-9df4-41f2-a832-2b648c3aa00a]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[72526550-f6f7-4e37-a480-f592f981984b]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v waIcDgEV {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v waIcDgEV" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c421a4e-b1bc-4680-9ecc-6462bd692848]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'waIcDgEV'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:23:08 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Creating image(s)
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "/opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "/opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "/opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c526a284-bf46-4411-a0be-c0d3d9f97253]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de098c6-1a16-4ad0-8f9c-8b379da9268f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:08 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:23:08 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:08 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:23:08 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf4c324-459c-41fd-93ba-a8c8fa471380]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c, portal: 172.16.0.220,3260]
Nov 29 20:23:08 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c, portal: 172.16.0.220,3260] successful.
Nov 29 20:23:08 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1de91e-ef10-4157-aba0-4014a4f39f8d]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d6a6df-c816-48e4-9eee-62614b2f31ab]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:08 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:23:08 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:08 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:08 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:23:08 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:08 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de47530-e747-4bfd-9cf5-9843bce70e54]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'waIcDgEV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.235s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.231s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-80712361-6ead-4d7f-9ee3-f97876d8493f req-00d99356-6109-49eb-b83f-3489076c1d4d service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Received event network-changed-ff38dd75-d1cf-484b-9f90-d07dde95ec85 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-80712361-6ead-4d7f-9ee3-f97876d8493f req-00d99356-6109-49eb-b83f-3489076c1d4d service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Refreshing instance network info cache due to event network-changed-ff38dd75-d1cf-484b-9f90-d07dde95ec85. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-80712361-6ead-4d7f-9ee3-f97876d8493f req-00d99356-6109-49eb-b83f-3489076c1d4d service nova] Acquiring lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk 1073741824" returned: 0 in 0.067s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.179s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:23:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Cannot resize image /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Ensure instance console log exists: /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Start _get_guest_xml network_info=[{"id": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "address": "fa:16:3e:2c:f4:1f", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb592a6b3-33", "ovs_interfaceid": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrgJDozc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '36ec2327-b376-49e4-8592-b2a077b79043', 'attached_at': '', 'detached_at': '', 'volume_id': 'c894c707-c3c7-4972-8a6d-d54fdc63f13f', 'serial': 'c894c707-c3c7-4972-8a6d-d54fdc63f13f'}, 'attachment_id': '0aec50e6-1346-4d72-a2d4-06282d73b3ff', 'volume_type': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.objects.instance [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lazy-loading 'migration_context' on Instance uuid 96cbbbdb-e1cc-49da-9a9f-5b83031b235b {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:23:09 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 20:23:09 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.objects.base [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Object Instance<96cbbbdb-e1cc-49da-9a9f-5b83031b235b> lazy-loaded attributes: resources,migration_context {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.objects.instance [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lazy-loading 'vcpu_model' on Instance uuid 36ec2327-b376-49e4-8592-b2a077b79043 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrgJDozc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:23:09 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.volume.cinder [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Update attachment failed for attachment 00668850-0d6a-4c2d-8b7b-04faabbbc69d. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-97079027-3cd9-4fe7-9840-7ccd85fb4d08) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-97079027-3cd9-4fe7-9840-7ccd85fb4d08)
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-97079027-3cd9-4fe7-9840-7ccd85fb4d08)
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092] Traceback (most recent call last):
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]     driver_block_device.attach_block_devices(
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]     _log_and_attach(device)
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]     bdm.attach(*attach_args, **attach_kwargs)
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]     ret_val = method(obj, context, *args, **kwargs)
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]     self._do_attach(context, instance, volume, volume_api,
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]     self._volume_attach(context, volume, connector, instance,
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]     connection_info = volume_api.attachment_update(
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]     res = method(self, ctx, *args, **kwargs)
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]     with excutils.save_and_reraise_exception():
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]     self.force_reraise()
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]     raise self.value
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]     context, '3.44', skip_version_check=True).attachments.update(
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]     return method.func(obj, *args, **kwargs)
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]     resp = self._update('/attachments/%s' % id, body)
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]     return self._cs_request(url, 'PUT', **kwargs)
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]     return self.request(url, method, **kwargs)
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092]     raise exceptions.from_response(resp, body)
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-97079027-3cd9-4fe7-9840-7ccd85fb4d08)
Nov 29 20:23:09 user nova-compute[75356]: ERROR nova.compute.manager [instance: c99f437d-1733-4308-b09f-c02245f5a092] 
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '23762396233306261', 'path': '/dev/sdc'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762396233306261', 'path': '/dev/sdc'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.194s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:23:09 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:23:09 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.objects.instance [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lazy-loading 'flavor' on Instance uuid 3584b853-567c-4dd2-ae4f-3ff074074137 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b153dd91-d80b-4f02-b163-24fc92aa540a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:23:09 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:23:09 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:23:09 user nova-compute[75356]:   <source dev="/dev/sdc"/>
Nov 29 20:23:09 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:23:09 user nova-compute[75356]:   <serial>666acfe8-575a-47c8-9d8b-160fd478283c</serial>
Nov 29 20:23:09 user nova-compute[75356]: </disk>
Nov 29 20:23:09 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[597bee62-43e8-4a13-97c8-140dadbb2f68]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f] added
Nov 29 20:23:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8defc205-0f3e-4c80-aa82-050e0dd73aa2]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbe8c9c-8e58-4d38-b5c8-736d6163c2cc]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrgJDozc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrgJDozc" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f281b0a6-381d-4cdb-9b3c-544c1410120f]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FrgJDozc'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3060be9-6ed1-4825-9765-f76fe4ed0e82]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6c6153-629e-4a74-b737-960ad1cb93ef]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:09 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:23:09 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:09 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:23:09 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.540s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c321f83-05c1-4c4b-ab88-a04b8ee76705]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f, portal: 172.16.0.220,3260]
Nov 29 20:23:09 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f, portal: 172.16.0.220,3260] successful.
Nov 29 20:23:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca75693-d61e-49e6-bf02-44414d907146]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f077fdd-a699-4b57-b218-1131181b0994]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:09 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:23:09 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:09 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:23:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:09 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:23:09 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:09 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:23:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd51c602-d962-4687-96e5-13da7f3ffd64]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrgJDozc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] No VIF found with MAC fa:16:3e:db:49:9b, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:23:09 user nova-compute[75356]: INFO nova.compute.manager [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Swapping old allocation on dict_keys(['5a24b660-3bbe-4ca7-ac25-69a2aeed184a']) held by migration a3c2ad02-b4f9-4432-b3c4-eed1ba5b1b92 for instance
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Overwriting current allocation {'allocations': {'5a24b660-3bbe-4ca7-ac25-69a2aeed184a': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 25}}, 'project_id': '19fa4a7548454fc4a29a625b0c819c9c', 'user_id': '9e5a895cde3741d0a48cb06922ad80f8', 'consumer_generation': 1} on consumer 96cbbbdb-e1cc-49da-9a9f-5b83031b235b {{(pid=75356) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG nova.network.neutron [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Updating instance_info_cache with network_info: [{"id": "14d91166-520f-4f3c-a8ba-0008a70cae0c", "address": "fa:16:3e:d0:84:3b", "network": {"id": "905102ba-0539-48a1-a9c6-512348c88108", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1752771129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14d91166-52", "ovs_interfaceid": "14d91166-520f-4f3c-a8ba-0008a70cae0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6df7e515-67dd-4949-b2b9-8d166cf37900", "address": "fa:16:3e:93:5a:7d", "network": {"id": "6c8c6411-67c6-4c63-be53-579e6de4de9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-151391836", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df7e515-67", "ovs_interfaceid": "6df7e515-67dd-4949-b2b9-8d166cf37900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e167015-5089-43d5-9e1d-e5f16148b9e9", "address": "fa:16:3e:2b:b7:fa", "network": {"id": "6c8c6411-67c6-4c63-be53-579e6de4de9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-151391836", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e167015-50", "ovs_interfaceid": "6e167015-5089-43d5-9e1d-e5f16148b9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "87341715-68d3-4550-ad6a-430a60748b48", "address": "fa:16:3e:96:b3:c2", "network": {"id": "6c8c6411-67c6-4c63-be53-579e6de4de9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-151391836", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87341715-68", "ovs_interfaceid": "87341715-68d3-4550-ad6a-430a60748b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a8e6adda-b975-48ea-9406-f177c1bdd532", "address": "fa:16:3e:51:6b:9d", "network": {"id": "6c8c6411-67c6-4c63-be53-579e6de4de9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-151391836", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8e6adda-b9", "ovs_interfaceid": "a8e6adda-b975-48ea-9406-f177c1bdd532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cbefb78-a46e-4d5c-b4f2-0d5cc8011e8c", "address": "fa:16:3e:7d:5d:cf", "network": {"id": "8f899b08-822a-4bcc-809a-de1946f3b3e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-47893288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cbefb78-a4", "ovs_interfaceid": "9cbefb78-a46e-4d5c-b4f2-0d5cc8011e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff38dd75-d1cf-484b-9f90-d07dde95ec85", "address": "fa:16:3e:fd:b8:cd", "network": {"id": "8f899b08-822a-4bcc-809a-de1946f3b3e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-47893288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff38dd75-d1", "ovs_interfaceid": "ff38dd75-d1cf-484b-9f90-d07dde95ec85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:23:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-68c74d45-3428-4cbf-bb6e-3d172e77901d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "3584b853-567c-4dd2-ae4f-3ff074074137" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.336s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Releasing lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.compute.manager [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Instance network_info: |[{"id": "14d91166-520f-4f3c-a8ba-0008a70cae0c", "address": "fa:16:3e:d0:84:3b", "network": {"id": "905102ba-0539-48a1-a9c6-512348c88108", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1752771129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14d91166-52", "ovs_interfaceid": "14d91166-520f-4f3c-a8ba-0008a70cae0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6df7e515-67dd-4949-b2b9-8d166cf37900", "address": "fa:16:3e:93:5a:7d", "network": {"id": "6c8c6411-67c6-4c63-be53-579e6de4de9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-151391836", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df7e515-67", "ovs_interfaceid": "6df7e515-67dd-4949-b2b9-8d166cf37900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e167015-5089-43d5-9e1d-e5f16148b9e9", "address": "fa:16:3e:2b:b7:fa", "network": {"id": "6c8c6411-67c6-4c63-be53-579e6de4de9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-151391836", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e167015-50", "ovs_interfaceid": "6e167015-5089-43d5-9e1d-e5f16148b9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "87341715-68d3-4550-ad6a-430a60748b48", "address": "fa:16:3e:96:b3:c2", "network": {"id": "6c8c6411-67c6-4c63-be53-579e6de4de9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-151391836", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87341715-68", "ovs_interfaceid": "87341715-68d3-4550-ad6a-430a60748b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a8e6adda-b975-48ea-9406-f177c1bdd532", "address": "fa:16:3e:51:6b:9d", "network": {"id": "6c8c6411-67c6-4c63-be53-579e6de4de9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-151391836", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8e6adda-b9", "ovs_interfaceid": "a8e6adda-b975-48ea-9406-f177c1bdd532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cbefb78-a46e-4d5c-b4f2-0d5cc8011e8c", "address": "fa:16:3e:7d:5d:cf", "network": {"id": "8f899b08-822a-4bcc-809a-de1946f3b3e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-47893288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cbefb78-a4", "ovs_interfaceid": "9cbefb78-a46e-4d5c-b4f2-0d5cc8011e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff38dd75-d1cf-484b-9f90-d07dde95ec85", "address": "fa:16:3e:fd:b8:cd", "network": {"id": "8f899b08-822a-4bcc-809a-de1946f3b3e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-47893288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff38dd75-d1", "ovs_interfaceid": "ff38dd75-d1cf-484b-9f90-d07dde95ec85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-80712361-6ead-4d7f-9ee3-f97876d8493f req-00d99356-6109-49eb-b83f-3489076c1d4d service nova] Acquired lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.neutron [req-80712361-6ead-4d7f-9ee3-f97876d8493f req-00d99356-6109-49eb-b83f-3489076c1d4d service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Refreshing network info cache for port ff38dd75-d1cf-484b-9f90-d07dde95ec85 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.compute.claims [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Aborting claim: <nova.compute.claims.Claim object at 0x7f8308703b20> {{(pid=75356) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquired lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.neutron [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.443s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.compute.manager [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Build of instance c99f437d-1733-4308-b09f-c02245f5a092 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-97079027-3cd9-4fe7-9840-7ccd85fb4d08) {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.compute.utils [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Build of instance c99f437d-1733-4308-b09f-c02245f5a092 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75356) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 29 20:23:10 user nova-compute[75356]: ERROR nova.compute.manager [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Build of instance c99f437d-1733-4308-b09f-c02245f5a092 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-97079027-3cd9-4fe7-9840-7ccd85fb4d08): nova.exception.BuildAbortException: Build of instance c99f437d-1733-4308-b09f-c02245f5a092 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-97079027-3cd9-4fe7-9840-7ccd85fb4d08)
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.compute.manager [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Unplugging VIFs for instance {{(pid=75356) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:22:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1547578313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1547578313',id=21,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBN9EYfYa2luWGK5FVcAW500YVlbrC72TjJdshWHl8k8N82PZkJKz4+cSkG1SJr/Ul99EML6KKP55FReI54/N2zbaxYEw4S4bETN7QwpkdTrqVMVlrnJg5bYQDjGwSb/aQ==',key_name='tempest-keypair-119229191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd915a019138451bb0fff462b8517c76',ramdisk_id='',reservation_id='r-ipb8i083',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1205623839',owner_user_name='tempest-TaggedBootDevicesTest-1205623839-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:22:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb3aefef5bc4cceab390519d3011aee',uuid=c99f437d-1733-4308-b09f-c02245f5a092,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14d91166-520f-4f3c-a8ba-0008a70cae0c", "address": "fa:16:3e:d0:84:3b", "network": {"id": "905102ba-0539-48a1-a9c6-512348c88108", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1752771129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14d91166-52", "ovs_interfaceid": "14d91166-520f-4f3c-a8ba-0008a70cae0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Converting VIF {"id": "14d91166-520f-4f3c-a8ba-0008a70cae0c", "address": "fa:16:3e:d0:84:3b", "network": {"id": "905102ba-0539-48a1-a9c6-512348c88108", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1752771129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14d91166-52", "ovs_interfaceid": "14d91166-520f-4f3c-a8ba-0008a70cae0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:84:3b,bridge_name='br-int',has_traffic_filtering=True,id=14d91166-520f-4f3c-a8ba-0008a70cae0c,network=Network(905102ba-0539-48a1-a9c6-512348c88108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14d91166-52') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG os_vif [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:84:3b,bridge_name='br-int',has_traffic_filtering=True,id=14d91166-520f-4f3c-a8ba-0008a70cae0c,network=Network(905102ba-0539-48a1-a9c6-512348c88108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14d91166-52') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14d91166-52, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:23:10 user nova-compute[75356]: INFO os_vif [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:84:3b,bridge_name='br-int',has_traffic_filtering=True,id=14d91166-520f-4f3c-a8ba-0008a70cae0c,network=Network(905102ba-0539-48a1-a9c6-512348c88108),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14d91166-52')
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:22:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1547578313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1547578313',id=21,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBN9EYfYa2luWGK5FVcAW500YVlbrC72TjJdshWHl8k8N82PZkJKz4+cSkG1SJr/Ul99EML6KKP55FReI54/N2zbaxYEw4S4bETN7QwpkdTrqVMVlrnJg5bYQDjGwSb/aQ==',key_name='tempest-keypair-119229191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd915a019138451bb0fff462b8517c76',ramdisk_id='',reservation_id='r-ipb8i083',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1205623839',owner_user_name='tempest-TaggedBootDevicesTest-1205623839-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:22:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb3aefef5bc4cceab390519d3011aee',uuid=c99f437d-1733-4308-b09f-c02245f5a092,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6df7e515-67dd-4949-b2b9-8d166cf37900", "address": "fa:16:3e:93:5a:7d", "network": {"id": "6c8c6411-67c6-4c63-be53-579e6de4de9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-151391836", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df7e515-67", "ovs_interfaceid": "6df7e515-67dd-4949-b2b9-8d166cf37900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Converting VIF {"id": "6df7e515-67dd-4949-b2b9-8d166cf37900", "address": "fa:16:3e:93:5a:7d", "network": {"id": "6c8c6411-67c6-4c63-be53-579e6de4de9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-151391836", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df7e515-67", "ovs_interfaceid": "6df7e515-67dd-4949-b2b9-8d166cf37900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:5a:7d,bridge_name='br-int',has_traffic_filtering=True,id=6df7e515-67dd-4949-b2b9-8d166cf37900,network=Network(6c8c6411-67c6-4c63-be53-579e6de4de9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6df7e515-67') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG os_vif [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:5a:7d,bridge_name='br-int',has_traffic_filtering=True,id=6df7e515-67dd-4949-b2b9-8d166cf37900,network=Network(6c8c6411-67c6-4c63-be53-579e6de4de9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6df7e515-67') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6df7e515-67, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:23:10 user nova-compute[75356]: INFO os_vif [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:5a:7d,bridge_name='br-int',has_traffic_filtering=True,id=6df7e515-67dd-4949-b2b9-8d166cf37900,network=Network(6c8c6411-67c6-4c63-be53-579e6de4de9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6df7e515-67')
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:22:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1547578313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1547578313',id=21,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBN9EYfYa2luWGK5FVcAW500YVlbrC72TjJdshWHl8k8N82PZkJKz4+cSkG1SJr/Ul99EML6KKP55FReI54/N2zbaxYEw4S4bETN7QwpkdTrqVMVlrnJg5bYQDjGwSb/aQ==',key_name='tempest-keypair-119229191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd915a019138451bb0fff462b8517c76',ramdisk_id='',reservation_id='r-ipb8i083',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1205623839',owner_user_name='tempest-TaggedBootDevicesTest-1205623839-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:22:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb3aefef5bc4cceab390519d3011aee',uuid=c99f437d-1733-4308-b09f-c02245f5a092,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e167015-5089-43d5-9e1d-e5f16148b9e9", "address": "fa:16:3e:2b:b7:fa", "network": {"id": "6c8c6411-67c6-4c63-be53-579e6de4de9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-151391836", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e167015-50", "ovs_interfaceid": "6e167015-5089-43d5-9e1d-e5f16148b9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Converting VIF {"id": "6e167015-5089-43d5-9e1d-e5f16148b9e9", "address": "fa:16:3e:2b:b7:fa", "network": {"id": "6c8c6411-67c6-4c63-be53-579e6de4de9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-151391836", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e167015-50", "ovs_interfaceid": "6e167015-5089-43d5-9e1d-e5f16148b9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:b7:fa,bridge_name='br-int',has_traffic_filtering=True,id=6e167015-5089-43d5-9e1d-e5f16148b9e9,network=Network(6c8c6411-67c6-4c63-be53-579e6de4de9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e167015-50') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG os_vif [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:b7:fa,bridge_name='br-int',has_traffic_filtering=True,id=6e167015-5089-43d5-9e1d-e5f16148b9e9,network=Network(6c8c6411-67c6-4c63-be53-579e6de4de9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e167015-50') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e167015-50, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:23:10 user nova-compute[75356]: INFO os_vif [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:b7:fa,bridge_name='br-int',has_traffic_filtering=True,id=6e167015-5089-43d5-9e1d-e5f16148b9e9,network=Network(6c8c6411-67c6-4c63-be53-579e6de4de9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e167015-50')
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:22:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1547578313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1547578313',id=21,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBN9EYfYa2luWGK5FVcAW500YVlbrC72TjJdshWHl8k8N82PZkJKz4+cSkG1SJr/Ul99EML6KKP55FReI54/N2zbaxYEw4S4bETN7QwpkdTrqVMVlrnJg5bYQDjGwSb/aQ==',key_name='tempest-keypair-119229191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd915a019138451bb0fff462b8517c76',ramdisk_id='',reservation_id='r-ipb8i083',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1205623839',owner_user_name='tempest-TaggedBootDevicesTest-1205623839-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:22:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb3aefef5bc4cceab390519d3011aee',uuid=c99f437d-1733-4308-b09f-c02245f5a092,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87341715-68d3-4550-ad6a-430a60748b48", "address": "fa:16:3e:96:b3:c2", "network": {"id": "6c8c6411-67c6-4c63-be53-579e6de4de9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-151391836", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87341715-68", "ovs_interfaceid": "87341715-68d3-4550-ad6a-430a60748b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Converting VIF {"id": "87341715-68d3-4550-ad6a-430a60748b48", "address": "fa:16:3e:96:b3:c2", "network": {"id": "6c8c6411-67c6-4c63-be53-579e6de4de9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-151391836", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87341715-68", "ovs_interfaceid": "87341715-68d3-4550-ad6a-430a60748b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:b3:c2,bridge_name='br-int',has_traffic_filtering=True,id=87341715-68d3-4550-ad6a-430a60748b48,network=Network(6c8c6411-67c6-4c63-be53-579e6de4de9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87341715-68') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG os_vif [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:b3:c2,bridge_name='br-int',has_traffic_filtering=True,id=87341715-68d3-4550-ad6a-430a60748b48,network=Network(6c8c6411-67c6-4c63-be53-579e6de4de9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87341715-68') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87341715-68, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:23:10 user nova-compute[75356]: INFO os_vif [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:b3:c2,bridge_name='br-int',has_traffic_filtering=True,id=87341715-68d3-4550-ad6a-430a60748b48,network=Network(6c8c6411-67c6-4c63-be53-579e6de4de9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87341715-68')
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:22:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1547578313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1547578313',id=21,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBN9EYfYa2luWGK5FVcAW500YVlbrC72TjJdshWHl8k8N82PZkJKz4+cSkG1SJr/Ul99EML6KKP55FReI54/N2zbaxYEw4S4bETN7QwpkdTrqVMVlrnJg5bYQDjGwSb/aQ==',key_name='tempest-keypair-119229191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd915a019138451bb0fff462b8517c76',ramdisk_id='',reservation_id='r-ipb8i083',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1205623839',owner_user_name='tempest-TaggedBootDevicesTest-1205623839-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:22:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb3aefef5bc4cceab390519d3011aee',uuid=c99f437d-1733-4308-b09f-c02245f5a092,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8e6adda-b975-48ea-9406-f177c1bdd532", "address": "fa:16:3e:51:6b:9d", "network": {"id": "6c8c6411-67c6-4c63-be53-579e6de4de9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-151391836", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8e6adda-b9", "ovs_interfaceid": "a8e6adda-b975-48ea-9406-f177c1bdd532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Converting VIF {"id": "a8e6adda-b975-48ea-9406-f177c1bdd532", "address": "fa:16:3e:51:6b:9d", "network": {"id": "6c8c6411-67c6-4c63-be53-579e6de4de9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-151391836", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8e6adda-b9", "ovs_interfaceid": "a8e6adda-b975-48ea-9406-f177c1bdd532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:6b:9d,bridge_name='br-int',has_traffic_filtering=True,id=a8e6adda-b975-48ea-9406-f177c1bdd532,network=Network(6c8c6411-67c6-4c63-be53-579e6de4de9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8e6adda-b9') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG os_vif [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:6b:9d,bridge_name='br-int',has_traffic_filtering=True,id=a8e6adda-b975-48ea-9406-f177c1bdd532,network=Network(6c8c6411-67c6-4c63-be53-579e6de4de9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8e6adda-b9') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8e6adda-b9, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:23:10 user nova-compute[75356]: INFO os_vif [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:6b:9d,bridge_name='br-int',has_traffic_filtering=True,id=a8e6adda-b975-48ea-9406-f177c1bdd532,network=Network(6c8c6411-67c6-4c63-be53-579e6de4de9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8e6adda-b9')
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:22:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1547578313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1547578313',id=21,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBN9EYfYa2luWGK5FVcAW500YVlbrC72TjJdshWHl8k8N82PZkJKz4+cSkG1SJr/Ul99EML6KKP55FReI54/N2zbaxYEw4S4bETN7QwpkdTrqVMVlrnJg5bYQDjGwSb/aQ==',key_name='tempest-keypair-119229191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd915a019138451bb0fff462b8517c76',ramdisk_id='',reservation_id='r-ipb8i083',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1205623839',owner_user_name='tempest-TaggedBootDevicesTest-1205623839-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:22:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb3aefef5bc4cceab390519d3011aee',uuid=c99f437d-1733-4308-b09f-c02245f5a092,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cbefb78-a46e-4d5c-b4f2-0d5cc8011e8c", "address": "fa:16:3e:7d:5d:cf", "network": {"id": "8f899b08-822a-4bcc-809a-de1946f3b3e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-47893288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cbefb78-a4", "ovs_interfaceid": "9cbefb78-a46e-4d5c-b4f2-0d5cc8011e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Converting VIF {"id": "9cbefb78-a46e-4d5c-b4f2-0d5cc8011e8c", "address": "fa:16:3e:7d:5d:cf", "network": {"id": "8f899b08-822a-4bcc-809a-de1946f3b3e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-47893288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cbefb78-a4", "ovs_interfaceid": "9cbefb78-a46e-4d5c-b4f2-0d5cc8011e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5d:cf,bridge_name='br-int',has_traffic_filtering=True,id=9cbefb78-a46e-4d5c-b4f2-0d5cc8011e8c,network=Network(8f899b08-822a-4bcc-809a-de1946f3b3e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cbefb78-a4') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG os_vif [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5d:cf,bridge_name='br-int',has_traffic_filtering=True,id=9cbefb78-a46e-4d5c-b4f2-0d5cc8011e8c,network=Network(8f899b08-822a-4bcc-809a-de1946f3b3e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cbefb78-a4') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cbefb78-a4, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:23:10 user nova-compute[75356]: INFO os_vif [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5d:cf,bridge_name='br-int',has_traffic_filtering=True,id=9cbefb78-a46e-4d5c-b4f2-0d5cc8011e8c,network=Network(8f899b08-822a-4bcc-809a-de1946f3b3e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cbefb78-a4')
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T20:22:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1547578313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1547578313',id=21,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBN9EYfYa2luWGK5FVcAW500YVlbrC72TjJdshWHl8k8N82PZkJKz4+cSkG1SJr/Ul99EML6KKP55FReI54/N2zbaxYEw4S4bETN7QwpkdTrqVMVlrnJg5bYQDjGwSb/aQ==',key_name='tempest-keypair-119229191',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd915a019138451bb0fff462b8517c76',ramdisk_id='',reservation_id='r-ipb8i083',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1205623839',owner_user_name='tempest-TaggedBootDevicesTest-1205623839-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:22:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb3aefef5bc4cceab390519d3011aee',uuid=c99f437d-1733-4308-b09f-c02245f5a092,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff38dd75-d1cf-484b-9f90-d07dde95ec85", "address": "fa:16:3e:fd:b8:cd", "network": {"id": "8f899b08-822a-4bcc-809a-de1946f3b3e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-47893288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff38dd75-d1", "ovs_interfaceid": "ff38dd75-d1cf-484b-9f90-d07dde95ec85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Converting VIF {"id": "ff38dd75-d1cf-484b-9f90-d07dde95ec85", "address": "fa:16:3e:fd:b8:cd", "network": {"id": "8f899b08-822a-4bcc-809a-de1946f3b3e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-47893288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff38dd75-d1", "ovs_interfaceid": "ff38dd75-d1cf-484b-9f90-d07dde95ec85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b8:cd,bridge_name='br-int',has_traffic_filtering=True,id=ff38dd75-d1cf-484b-9f90-d07dde95ec85,network=Network(8f899b08-822a-4bcc-809a-de1946f3b3e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff38dd75-d1') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG os_vif [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b8:cd,bridge_name='br-int',has_traffic_filtering=True,id=ff38dd75-d1cf-484b-9f90-d07dde95ec85,network=Network(8f899b08-822a-4bcc-809a-de1946f3b3e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff38dd75-d1') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff38dd75-d1, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:23:10 user nova-compute[75356]: INFO os_vif [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b8:cd,bridge_name='br-int',has_traffic_filtering=True,id=ff38dd75-d1cf-484b-9f90-d07dde95ec85,network=Network(8f899b08-822a-4bcc-809a-de1946f3b3e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff38dd75-d1')
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.compute.manager [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Unplugged VIFs for instance {{(pid=75356) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.compute.manager [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.neutron [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.neutron [req-80712361-6ead-4d7f-9ee3-f97876d8493f req-00d99356-6109-49eb-b83f-3489076c1d4d service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Updated VIF entry in instance network info cache for port ff38dd75-d1cf-484b-9f90-d07dde95ec85. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.neutron [req-80712361-6ead-4d7f-9ee3-f97876d8493f req-00d99356-6109-49eb-b83f-3489076c1d4d service nova] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Updating instance_info_cache with network_info: [{"id": "14d91166-520f-4f3c-a8ba-0008a70cae0c", "address": "fa:16:3e:d0:84:3b", "network": {"id": "905102ba-0539-48a1-a9c6-512348c88108", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1752771129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14d91166-52", "ovs_interfaceid": "14d91166-520f-4f3c-a8ba-0008a70cae0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6df7e515-67dd-4949-b2b9-8d166cf37900", "address": "fa:16:3e:93:5a:7d", "network": {"id": "6c8c6411-67c6-4c63-be53-579e6de4de9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-151391836", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6df7e515-67", "ovs_interfaceid": "6df7e515-67dd-4949-b2b9-8d166cf37900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e167015-5089-43d5-9e1d-e5f16148b9e9", "address": "fa:16:3e:2b:b7:fa", "network": {"id": "6c8c6411-67c6-4c63-be53-579e6de4de9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-151391836", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e167015-50", "ovs_interfaceid": "6e167015-5089-43d5-9e1d-e5f16148b9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "87341715-68d3-4550-ad6a-430a60748b48", "address": "fa:16:3e:96:b3:c2", "network": {"id": "6c8c6411-67c6-4c63-be53-579e6de4de9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-151391836", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87341715-68", "ovs_interfaceid": "87341715-68d3-4550-ad6a-430a60748b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a8e6adda-b975-48ea-9406-f177c1bdd532", "address": "fa:16:3e:51:6b:9d", "network": {"id": "6c8c6411-67c6-4c63-be53-579e6de4de9b", "bridge": "br-int", "label": "tempest-device-tagging-net1-151391836", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8e6adda-b9", "ovs_interfaceid": "a8e6adda-b975-48ea-9406-f177c1bdd532", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cbefb78-a46e-4d5c-b4f2-0d5cc8011e8c", "address": "fa:16:3e:7d:5d:cf", "network": {"id": "8f899b08-822a-4bcc-809a-de1946f3b3e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-47893288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cbefb78-a4", "ovs_interfaceid": "9cbefb78-a46e-4d5c-b4f2-0d5cc8011e8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff38dd75-d1cf-484b-9f90-d07dde95ec85", "address": "fa:16:3e:fd:b8:cd", "network": {"id": "8f899b08-822a-4bcc-809a-de1946f3b3e5", "bridge": "br-int", "label": "tempest-device-tagging-net2-47893288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bd915a019138451bb0fff462b8517c76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff38dd75-d1", "ovs_interfaceid": "ff38dd75-d1cf-484b-9f90-d07dde95ec85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-80712361-6ead-4d7f-9ee3-f97876d8493f req-00d99356-6109-49eb-b83f-3489076c1d4d service nova] Releasing lock "refresh_cache-c99f437d-1733-4308-b09f-c02245f5a092" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] <== connect_volume: return (1553ms) {'type': 'block', 'scsi_wwn': '23833396566643237', 'path': '/dev/sde'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833396566643237', 'path': '/dev/sde'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T20:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2086140812',display_name='tempest-ServerActionsTestOtherA-server-959033318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2086140812',id=15,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkT9y7rrd/Y5ebvEZ6un5mDuYkh3taeh/2CNWnRGvskqEqjhBdlrCLi3cPcBtL8QdOGFvHh7tZcM81p1N+u4M88CWgTrMXsWASi0tU/5YZzvvrfG6YTm/WptIWFFOdngQ==',key_name='tempest-keypair-24359724',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:21:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8b14efb1a4d34a3db7a51bd79234b86b',ramdisk_id='',reservation_id='r-8udz7yf5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1000495362',owner_user_name='tempest-ServerActionsTestOtherA-1000495362-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:22:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc7cfc71d0c448cbbe8d42f8b617d8b',uuid=36ec2327-b376-49e4-8592-b2a077b79043,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "address": "fa:16:3e:2c:f4:1f", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb592a6b3-33", "ovs_interfaceid": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converting VIF {"id": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "address": "fa:16:3e:2c:f4:1f", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb592a6b3-33", "ovs_interfaceid": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:f4:1f,bridge_name='br-int',has_traffic_filtering=True,id=b592a6b3-336d-4af0-ac33-8aa5f050fe9e,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb592a6b3-33') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:23:10 user nova-compute[75356]:   <uuid>36ec2327-b376-49e4-8592-b2a077b79043</uuid>
Nov 29 20:23:10 user nova-compute[75356]:   <name>instance-0000000f</name>
Nov 29 20:23:10 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:23:10 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:23:10 user nova-compute[75356]:   <metadata>
Nov 29 20:23:10 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:23:10 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:23:10 user nova-compute[75356]:       <nova:name>tempest-ServerActionsTestOtherA-server-959033318</nova:name>
Nov 29 20:23:10 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:23:09</nova:creationTime>
Nov 29 20:23:10 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:23:10 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:23:10 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:23:10 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:23:10 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:23:10 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:23:10 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:23:10 user nova-compute[75356]:       <nova:owner>
Nov 29 20:23:10 user nova-compute[75356]:         <nova:user uuid="abc7cfc71d0c448cbbe8d42f8b617d8b">tempest-ServerActionsTestOtherA-1000495362-project-member</nova:user>
Nov 29 20:23:10 user nova-compute[75356]:         <nova:project uuid="8b14efb1a4d34a3db7a51bd79234b86b">tempest-ServerActionsTestOtherA-1000495362</nova:project>
Nov 29 20:23:10 user nova-compute[75356]:       </nova:owner>
Nov 29 20:23:10 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:23:10 user nova-compute[75356]:       <nova:ports>
Nov 29 20:23:10 user nova-compute[75356]:         <nova:port uuid="b592a6b3-336d-4af0-ac33-8aa5f050fe9e">
Nov 29 20:23:10 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 20:23:10 user nova-compute[75356]:         </nova:port>
Nov 29 20:23:10 user nova-compute[75356]:       </nova:ports>
Nov 29 20:23:10 user nova-compute[75356]:     </nova:instance>
Nov 29 20:23:10 user nova-compute[75356]:   </metadata>
Nov 29 20:23:10 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:23:10 user nova-compute[75356]:     <system>
Nov 29 20:23:10 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:23:10 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:23:10 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:23:10 user nova-compute[75356]:       <entry name="serial">36ec2327-b376-49e4-8592-b2a077b79043</entry>
Nov 29 20:23:10 user nova-compute[75356]:       <entry name="uuid">36ec2327-b376-49e4-8592-b2a077b79043</entry>
Nov 29 20:23:10 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:23:10 user nova-compute[75356]:     </system>
Nov 29 20:23:10 user nova-compute[75356]:   </sysinfo>
Nov 29 20:23:10 user nova-compute[75356]:   <os>
Nov 29 20:23:10 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:23:10 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:23:10 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:23:10 user nova-compute[75356]:   </os>
Nov 29 20:23:10 user nova-compute[75356]:   <features>
Nov 29 20:23:10 user nova-compute[75356]:     <acpi/>
Nov 29 20:23:10 user nova-compute[75356]:     <apic/>
Nov 29 20:23:10 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:23:10 user nova-compute[75356]:   </features>
Nov 29 20:23:10 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:23:10 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:23:10 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:23:10 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:23:10 user nova-compute[75356]:   </clock>
Nov 29 20:23:10 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:23:10 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:23:10 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:23:10 user nova-compute[75356]:   </cpu>
Nov 29 20:23:10 user nova-compute[75356]:   <devices>
Nov 29 20:23:10 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:23:10 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:23:10 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk"/>
Nov 29 20:23:10 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:23:10 user nova-compute[75356]:     </disk>
Nov 29 20:23:10 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:23:10 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:23:10 user nova-compute[75356]:       <source dev="/dev/sde"/>
Nov 29 20:23:10 user nova-compute[75356]:       <target dev="vdb" bus="virtio"/>
Nov 29 20:23:10 user nova-compute[75356]:       <serial>c894c707-c3c7-4972-8a6d-d54fdc63f13f</serial>
Nov 29 20:23:10 user nova-compute[75356]:     </disk>
Nov 29 20:23:10 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:23:10 user nova-compute[75356]:       <mac address="fa:16:3e:2c:f4:1f"/>
Nov 29 20:23:10 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:23:10 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:23:10 user nova-compute[75356]:       <target dev="tapb592a6b3-33"/>
Nov 29 20:23:10 user nova-compute[75356]:     </interface>
Nov 29 20:23:10 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:23:10 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/console.log" append="off"/>
Nov 29 20:23:10 user nova-compute[75356]:     </serial>
Nov 29 20:23:10 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:23:10 user nova-compute[75356]:     <video>
Nov 29 20:23:10 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:23:10 user nova-compute[75356]:     </video>
Nov 29 20:23:10 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:23:10 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:23:10 user nova-compute[75356]:     </rng>
Nov 29 20:23:10 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:23:10 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:23:10 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:23:10 user nova-compute[75356]:     </memballoon>
Nov 29 20:23:10 user nova-compute[75356]:   </devices>
Nov 29 20:23:10 user nova-compute[75356]: </domain>
Nov 29 20:23:10 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T20:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2086140812',display_name='tempest-ServerActionsTestOtherA-server-959033318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2086140812',id=15,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkT9y7rrd/Y5ebvEZ6un5mDuYkh3taeh/2CNWnRGvskqEqjhBdlrCLi3cPcBtL8QdOGFvHh7tZcM81p1N+u4M88CWgTrMXsWASi0tU/5YZzvvrfG6YTm/WptIWFFOdngQ==',key_name='tempest-keypair-24359724',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:21:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8b14efb1a4d34a3db7a51bd79234b86b',ramdisk_id='',reservation_id='r-8udz7yf5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1000495362',owner_user_name='tempest-ServerActionsTestOtherA-1000495362-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:22:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc7cfc71d0c448cbbe8d42f8b617d8b',uuid=36ec2327-b376-49e4-8592-b2a077b79043,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "address": "fa:16:3e:2c:f4:1f", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb592a6b3-33", "ovs_interfaceid": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converting VIF {"id": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "address": "fa:16:3e:2c:f4:1f", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb592a6b3-33", "ovs_interfaceid": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:f4:1f,bridge_name='br-int',has_traffic_filtering=True,id=b592a6b3-336d-4af0-ac33-8aa5f050fe9e,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb592a6b3-33') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG os_vif [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:f4:1f,bridge_name='br-int',has_traffic_filtering=True,id=b592a6b3-336d-4af0-ac33-8aa5f050fe9e,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb592a6b3-33') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '93d1f6c4-fdf6-5e9f-9ede-ecb791dfa7df', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb592a6b3-33, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb592a6b3-33, col_values=(('qos', UUID('a7129f86-5da0-4e33-859f-929c0a832b9c')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb592a6b3-33, col_values=(('external_ids', {'iface-id': 'b592a6b3-336d-4af0-ac33-8aa5f050fe9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:f4:1f', 'vm-uuid': '36ec2327-b376-49e4-8592-b2a077b79043'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:10 user nova-compute[75356]: INFO os_vif [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:f4:1f,bridge_name='br-int',has_traffic_filtering=True,id=b592a6b3-336d-4af0-ac33-8aa5f050fe9e,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb592a6b3-33')
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.network.neutron [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Updating instance_info_cache with network_info: [{"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Releasing lock "refresh_cache-96cbbbdb-e1cc-49da-9a9f-5b83031b235b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG os_brick.utils [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[39326abb-45fe-4cfa-8b73-605c190b5c87]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] No VIF found with MAC fa:16:3e:2c:f4:1f, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[af670e6f-69ac-46c8-a170-5423567cef57]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b01354f-1a08-46fd-84ab-3a8ef9326b02]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cf60a7-ac5a-4538-af7b-6010aa731111]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:23:10 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:23:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebf54a9-642c-48c5-897f-2f75a3bac3f1]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:23:10 user nova-compute[75356]: DEBUG os_brick.utils [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:23:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-0701c31c-9464-49b8-9c61-410c069d3330 req-72cc3c69-0629-4e00-9eff-77b8bf2022bc service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Received event network-vif-plugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:23:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0701c31c-9464-49b8-9c61-410c069d3330 req-72cc3c69-0629-4e00-9eff-77b8bf2022bc service nova] Acquiring lock "36ec2327-b376-49e4-8592-b2a077b79043-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0701c31c-9464-49b8-9c61-410c069d3330 req-72cc3c69-0629-4e00-9eff-77b8bf2022bc service nova] Lock "36ec2327-b376-49e4-8592-b2a077b79043-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0701c31c-9464-49b8-9c61-410c069d3330 req-72cc3c69-0629-4e00-9eff-77b8bf2022bc service nova] Lock "36ec2327-b376-49e4-8592-b2a077b79043-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-0701c31c-9464-49b8-9c61-410c069d3330 req-72cc3c69-0629-4e00-9eff-77b8bf2022bc service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] No waiting events found dispatching network-vif-plugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:23:13 user nova-compute[75356]: WARNING nova.compute.manager [req-0701c31c-9464-49b8-9c61-410c069d3330 req-72cc3c69-0629-4e00-9eff-77b8bf2022bc service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Received unexpected event network-vif-plugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e for instance with vm_state active and task_state rebuild_spawning.
Nov 29 20:23:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:14 user nova-compute[75356]: DEBUG nova.network.neutron [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:23:14 user nova-compute[75356]: INFO nova.compute.manager [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Took 4.17 seconds to deallocate network for instance.
Nov 29 20:23:14 user nova-compute[75356]: DEBUG nova.compute.manager [req-b44ae05e-44a1-4fc5-837b-9c2dca851134 req-760407dc-b037-4929-a0c9-fd30aaf98179 service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Received event network-vif-plugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:23:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b44ae05e-44a1-4fc5-837b-9c2dca851134 req-760407dc-b037-4929-a0c9-fd30aaf98179 service nova] Acquiring lock "36ec2327-b376-49e4-8592-b2a077b79043-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b44ae05e-44a1-4fc5-837b-9c2dca851134 req-760407dc-b037-4929-a0c9-fd30aaf98179 service nova] Lock "36ec2327-b376-49e4-8592-b2a077b79043-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b44ae05e-44a1-4fc5-837b-9c2dca851134 req-760407dc-b037-4929-a0c9-fd30aaf98179 service nova] Lock "36ec2327-b376-49e4-8592-b2a077b79043-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:14 user nova-compute[75356]: DEBUG nova.compute.manager [req-b44ae05e-44a1-4fc5-837b-9c2dca851134 req-760407dc-b037-4929-a0c9-fd30aaf98179 service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] No waiting events found dispatching network-vif-plugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:23:14 user nova-compute[75356]: WARNING nova.compute.manager [req-b44ae05e-44a1-4fc5-837b-9c2dca851134 req-760407dc-b037-4929-a0c9-fd30aaf98179 service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Received unexpected event network-vif-plugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e for instance with vm_state active and task_state rebuild_spawning.
Nov 29 20:23:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Detaching volume: ec674ca2-2d24-41fb-a7f9-d680b501e26d {{(pid=75356) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 29 20:23:14 user nova-compute[75356]: INFO nova.compute.manager [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Detaching volume ec674ca2-2d24-41fb-a7f9-d680b501e26d
Nov 29 20:23:14 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Skipping driver_detach during remote rebuild. {{(pid=75356) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 29 20:23:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:23:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:23:15 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Instance spawned successfully.
Nov 29 20:23:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:23:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:23:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:23:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:23:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:23:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:23:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:23:16 user nova-compute[75356]: DEBUG nova.compute.manager [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:23:16 user nova-compute[75356]: WARNING nova.compute.manager [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Failed to detach volume: ec674ca2-2d24-41fb-a7f9-d680b501e26d due to 'NoneType' object has no attribute 'devices'
Nov 29 20:23:16 user nova-compute[75356]: DEBUG nova.compute.manager [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Detaching volume: 305f8a41-38c4-4f35-bd73-dd421cd1e14e {{(pid=75356) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 29 20:23:16 user nova-compute[75356]: INFO nova.compute.manager [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Detaching volume 305f8a41-38c4-4f35-bd73-dd421cd1e14e
Nov 29 20:23:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:16 user nova-compute[75356]: DEBUG nova.objects.instance [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75356) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 29 20:23:16 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Skipping driver_detach during remote rebuild. {{(pid=75356) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 29 20:23:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a4f6f2ca-eac1-4ecd-93e6-20f9628fe6ac tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.084s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:16 user nova-compute[75356]: WARNING nova.compute.manager [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Failed to detach volume: 305f8a41-38c4-4f35-bd73-dd421cd1e14e due to 'NoneType' object has no attribute 'devices'
Nov 29 20:23:16 user nova-compute[75356]: DEBUG nova.compute.manager [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Detaching volume: 6b29279c-52da-4469-8621-00bc42a1a9e4 {{(pid=75356) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 29 20:23:16 user nova-compute[75356]: INFO nova.compute.manager [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Detaching volume 6b29279c-52da-4469-8621-00bc42a1a9e4
Nov 29 20:23:16 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] [instance: c99f437d-1733-4308-b09f-c02245f5a092] Skipping driver_detach during remote rebuild. {{(pid=75356) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 29 20:23:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "972e22c1-bd85-4507-9166-ace3fce8e698" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "972e22c1-bd85-4507-9166-ace3fce8e698" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "972e22c1-bd85-4507-9166-ace3fce8e698-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "972e22c1-bd85-4507-9166-ace3fce8e698-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "972e22c1-bd85-4507-9166-ace3fce8e698-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:16 user nova-compute[75356]: INFO nova.compute.manager [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Terminating instance
Nov 29 20:23:16 user nova-compute[75356]: DEBUG nova.compute.manager [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:23:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:16 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Deleted allocations for instance c99f437d-1733-4308-b09f-c02245f5a092
Nov 29 20:23:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-869be19b-03c2-4364-afea-923ee35cd40d tempest-TaggedBootDevicesTest-1205623839 tempest-TaggedBootDevicesTest-1205623839-project-member] Lock "c99f437d-1733-4308-b09f-c02245f5a092" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.232s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:17 user nova-compute[75356]: DEBUG nova.compute.manager [req-73d08936-65c3-4005-8485-9acd6e5a2845 req-4d00c373-7f2b-4b77-aa86-06ae96b31ccc service nova] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Received event network-vif-unplugged-cfb6a771-e8ce-43da-aebb-742cb2afdbcb {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:23:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-73d08936-65c3-4005-8485-9acd6e5a2845 req-4d00c373-7f2b-4b77-aa86-06ae96b31ccc service nova] Acquiring lock "972e22c1-bd85-4507-9166-ace3fce8e698-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-73d08936-65c3-4005-8485-9acd6e5a2845 req-4d00c373-7f2b-4b77-aa86-06ae96b31ccc service nova] Lock "972e22c1-bd85-4507-9166-ace3fce8e698-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-73d08936-65c3-4005-8485-9acd6e5a2845 req-4d00c373-7f2b-4b77-aa86-06ae96b31ccc service nova] Lock "972e22c1-bd85-4507-9166-ace3fce8e698-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:17 user nova-compute[75356]: DEBUG nova.compute.manager [req-73d08936-65c3-4005-8485-9acd6e5a2845 req-4d00c373-7f2b-4b77-aa86-06ae96b31ccc service nova] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] No waiting events found dispatching network-vif-unplugged-cfb6a771-e8ce-43da-aebb-742cb2afdbcb {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:23:17 user nova-compute[75356]: DEBUG nova.compute.manager [req-73d08936-65c3-4005-8485-9acd6e5a2845 req-4d00c373-7f2b-4b77-aa86-06ae96b31ccc service nova] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Received event network-vif-unplugged-cfb6a771-e8ce-43da-aebb-742cb2afdbcb for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:23:17 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Instance destroyed successfully.
Nov 29 20:23:17 user nova-compute[75356]: DEBUG nova.objects.instance [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lazy-loading 'resources' on Instance uuid 972e22c1-bd85-4507-9166-ace3fce8e698 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:23:17 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-277366552',display_name='tempest-VolumesAdminNegativeTest-server-277366552',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-277366552',id=6,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTZq3fJeobsfPwRfLW1sVmiHO8EbDMOofCaocHP2AH8bSIXXbUYpzSh+zi76VBR1nWc6VoncPuiWCEIzq60QjrxuFW3M7+cnmK4LlVeywgzLHOALsyJDDwg8pGXba9ISw==',key_name='tempest-keypair-258596985',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:17:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2e9eb99ca1b4dddb0075e78847b980b',ramdisk_id='',reservation_id='r-jkdlbj7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1603071749',owner_user_name='tempest-VolumesAdminNegativeTest-1603071749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:17:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91cd534885224b259429518c575b82e7',uuid=972e22c1-bd85-4507-9166-ace3fce8e698,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "address": "fa:16:3e:3b:bc:00", "network": {"id": "4e1439ac-1b43-4407-997e-6ac5b6a0066f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2125172073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2e9eb99ca1b4dddb0075e78847b980b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb6a771-e8", "ovs_interfaceid": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:23:17 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Converting VIF {"id": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "address": "fa:16:3e:3b:bc:00", "network": {"id": "4e1439ac-1b43-4407-997e-6ac5b6a0066f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2125172073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2e9eb99ca1b4dddb0075e78847b980b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb6a771-e8", "ovs_interfaceid": "cfb6a771-e8ce-43da-aebb-742cb2afdbcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:23:17 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:bc:00,bridge_name='br-int',has_traffic_filtering=True,id=cfb6a771-e8ce-43da-aebb-742cb2afdbcb,network=Network(4e1439ac-1b43-4407-997e-6ac5b6a0066f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb6a771-e8') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:23:17 user nova-compute[75356]: DEBUG os_vif [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:bc:00,bridge_name='br-int',has_traffic_filtering=True,id=cfb6a771-e8ce-43da-aebb-742cb2afdbcb,network=Network(4e1439ac-1b43-4407-997e-6ac5b6a0066f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb6a771-e8') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:23:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfb6a771-e8, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:23:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=004c5aab-4438-4d4a-bfe9-f0c92e879ee6) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:23:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:17 user nova-compute[75356]: INFO os_vif [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:bc:00,bridge_name='br-int',has_traffic_filtering=True,id=cfb6a771-e8ce-43da-aebb-742cb2afdbcb,network=Network(4e1439ac-1b43-4407-997e-6ac5b6a0066f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb6a771-e8')
Nov 29 20:23:17 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Deleting instance files /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698_del
Nov 29 20:23:17 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Deletion of /opt/stack/data/nova/instances/972e22c1-bd85-4507-9166-ace3fce8e698_del complete
Nov 29 20:23:17 user nova-compute[75356]: INFO nova.compute.manager [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 29 20:23:17 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:23:17 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:23:17 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:23:18 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:23:18 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Took 0.89 seconds to deallocate network for instance.
Nov 29 20:23:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-7f9a7777-357c-4415-987c-d6d7281a38ae req-8a059682-bbf9-4edf-b56a-ba531048a571 service nova] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Received event network-vif-deleted-cfb6a771-e8ce-43da-aebb-742cb2afdbcb {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:23:19 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:23:19 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:23:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:19 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Deleted allocations for instance 972e22c1-bd85-4507-9166-ace3fce8e698
Nov 29 20:23:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-36616b9e-bcef-4a74-bf06-332ba5d3eca6 req-2deaa829-9550-45de-bf42-993559394fa9 service nova] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Received event network-vif-plugged-cfb6a771-e8ce-43da-aebb-742cb2afdbcb {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:23:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-36616b9e-bcef-4a74-bf06-332ba5d3eca6 req-2deaa829-9550-45de-bf42-993559394fa9 service nova] Acquiring lock "972e22c1-bd85-4507-9166-ace3fce8e698-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-36616b9e-bcef-4a74-bf06-332ba5d3eca6 req-2deaa829-9550-45de-bf42-993559394fa9 service nova] Lock "972e22c1-bd85-4507-9166-ace3fce8e698-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-36616b9e-bcef-4a74-bf06-332ba5d3eca6 req-2deaa829-9550-45de-bf42-993559394fa9 service nova] Lock "972e22c1-bd85-4507-9166-ace3fce8e698-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-36616b9e-bcef-4a74-bf06-332ba5d3eca6 req-2deaa829-9550-45de-bf42-993559394fa9 service nova] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] No waiting events found dispatching network-vif-plugged-cfb6a771-e8ce-43da-aebb-742cb2afdbcb {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:23:19 user nova-compute[75356]: WARNING nova.compute.manager [req-36616b9e-bcef-4a74-bf06-332ba5d3eca6 req-2deaa829-9550-45de-bf42-993559394fa9 service nova] [instance: 972e22c1-bd85-4507-9166-ace3fce8e698] Received unexpected event network-vif-plugged-cfb6a771-e8ce-43da-aebb-742cb2afdbcb for instance with vm_state deleted and task_state None.
Nov 29 20:23:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-96725202-b82a-4fde-9639-71725889edee tempest-VolumesAdminNegativeTest-1603071749 tempest-VolumesAdminNegativeTest-1603071749-project-member] Lock "972e22c1-bd85-4507-9166-ace3fce8e698" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.553s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Starting finish_revert_migration {{(pid=75356) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Start _get_guest_xml network_info=[{"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKteoRvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '96cbbbdb-e1cc-49da-9a9f-5b83031b235b', 'attached_at': '2023-11-29T20:23:20.000000', 'detached_at': '', 'volume_id': '4a07443e-a368-43b5-90b0-e96c00dc86a7', 'serial': '4a07443e-a368-43b5-90b0-e96c00dc86a7'}, 'attachment_id': '6505b8cb-bf0f-42ad-87ae-0a5b6708e955', 'volume_type': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:23:20 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:23:20 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:23:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG nova.objects.instance [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lazy-loading 'vcpu_model' on Instance uuid 96cbbbdb-e1cc-49da-9a9f-5b83031b235b {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKteoRvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:23:20 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:23:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:23:20 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:23:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:23:20 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a65dd6-abef-470b-b4b4-9ef5846267a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:23:20 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9f420e-baeb-4cb5-9197-936f9ec40bfa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7] added
Nov 29 20:23:20 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e0e1ae-f610-4e80-b50b-4dc778d39ede]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd928963-8959-4b18-88f8-812ed6c4922c]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wKteoRvT {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wKteoRvT" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5810932d-f331-4ecf-ab6e-0ab7c287d7ce]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wKteoRvT'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b690daff-8062-4567-ad0f-bd6d655c4e9f]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82ac274-7338-4f84-9151-ff00e1504cb6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:20 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:23:20 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:20 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:23:20 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:20 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:23:20 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:20 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:23:20 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffba21d7-ef05-45b6-a1a6-2f4aab7691d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260]
Nov 29 20:23:20 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260] successful.
Nov 29 20:23:20 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba575bb-95cc-4429-8dc5-1d1fd7a689bb]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaf3ea7-f188-4e9e-af12-d8f8b0a4e9a7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:20 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:23:20 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:20 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:23:20 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:23:20 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:20 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:23:20 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:20 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:23:20 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:23:20 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc32ffa-3567-45ec-a51a-6ddc95612e7e]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:23:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKteoRvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26238613931613235', 'path': '/dev/sdf'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238613931613235', 'path': '/dev/sdf'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2075887638',display_name='tempest-ServerActionsTestOtherB-server-2075887638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2075887638',id=5,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqmwjesnBZKKmMOP1nU5mLLaxgxAYrWKpY6AKu2j/L1exH/XrbvTGFuJ5hCGjIGc6yFau1HY0D/HH/XuWjDf7bDrvpfXRmVeDF3iS6kjnnvyZ4TUUiMwhiV4HxFj8NX1w==',key_name='tempest-keypair-1339068574',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:21:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='19fa4a7548454fc4a29a625b0c819c9c',ramdisk_id='',reservation_id='r-pzj88ta7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-403173210',owner_user_name='tempest-ServerActionsTestOtherB-403173210-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e5a895cde3741d0a48cb06922ad80f8',uuid=96cbbbdb-e1cc-49da-9a9f-5b83031b235b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Converting VIF {"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:e6:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf5b9476-92db-4a94-bcdd-485ba68a4d1e,network=Network(d5185e2d-1e16-408d-91cf-3c494b84cd52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5b9476-92') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:23:21 user nova-compute[75356]:   <uuid>96cbbbdb-e1cc-49da-9a9f-5b83031b235b</uuid>
Nov 29 20:23:21 user nova-compute[75356]:   <name>instance-00000005</name>
Nov 29 20:23:21 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:23:21 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:23:21 user nova-compute[75356]:   <metadata>
Nov 29 20:23:21 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:23:21 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:23:21 user nova-compute[75356]:       <nova:name>tempest-ServerActionsTestOtherB-server-2075887638</nova:name>
Nov 29 20:23:21 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:23:20</nova:creationTime>
Nov 29 20:23:21 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:23:21 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:23:21 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:23:21 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:23:21 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:23:21 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:23:21 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:23:21 user nova-compute[75356]:       <nova:owner>
Nov 29 20:23:21 user nova-compute[75356]:         <nova:user uuid="9e5a895cde3741d0a48cb06922ad80f8">tempest-ServerActionsTestOtherB-403173210-project-member</nova:user>
Nov 29 20:23:21 user nova-compute[75356]:         <nova:project uuid="19fa4a7548454fc4a29a625b0c819c9c">tempest-ServerActionsTestOtherB-403173210</nova:project>
Nov 29 20:23:21 user nova-compute[75356]:       </nova:owner>
Nov 29 20:23:21 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:23:21 user nova-compute[75356]:       <nova:ports>
Nov 29 20:23:21 user nova-compute[75356]:         <nova:port uuid="bf5b9476-92db-4a94-bcdd-485ba68a4d1e">
Nov 29 20:23:21 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 20:23:21 user nova-compute[75356]:         </nova:port>
Nov 29 20:23:21 user nova-compute[75356]:       </nova:ports>
Nov 29 20:23:21 user nova-compute[75356]:     </nova:instance>
Nov 29 20:23:21 user nova-compute[75356]:   </metadata>
Nov 29 20:23:21 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:23:21 user nova-compute[75356]:     <system>
Nov 29 20:23:21 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:23:21 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:23:21 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:23:21 user nova-compute[75356]:       <entry name="serial">96cbbbdb-e1cc-49da-9a9f-5b83031b235b</entry>
Nov 29 20:23:21 user nova-compute[75356]:       <entry name="uuid">96cbbbdb-e1cc-49da-9a9f-5b83031b235b</entry>
Nov 29 20:23:21 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:23:21 user nova-compute[75356]:     </system>
Nov 29 20:23:21 user nova-compute[75356]:   </sysinfo>
Nov 29 20:23:21 user nova-compute[75356]:   <os>
Nov 29 20:23:21 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:23:21 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:23:21 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:23:21 user nova-compute[75356]:   </os>
Nov 29 20:23:21 user nova-compute[75356]:   <features>
Nov 29 20:23:21 user nova-compute[75356]:     <acpi/>
Nov 29 20:23:21 user nova-compute[75356]:     <apic/>
Nov 29 20:23:21 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:23:21 user nova-compute[75356]:   </features>
Nov 29 20:23:21 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:23:21 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:23:21 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:23:21 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:23:21 user nova-compute[75356]:   </clock>
Nov 29 20:23:21 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:23:21 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:23:21 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:23:21 user nova-compute[75356]:   </cpu>
Nov 29 20:23:21 user nova-compute[75356]:   <devices>
Nov 29 20:23:21 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:23:21 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:23:21 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk"/>
Nov 29 20:23:21 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:23:21 user nova-compute[75356]:     </disk>
Nov 29 20:23:21 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:23:21 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:23:21 user nova-compute[75356]:       <source dev="/dev/sdf"/>
Nov 29 20:23:21 user nova-compute[75356]:       <target dev="vdb" bus="virtio"/>
Nov 29 20:23:21 user nova-compute[75356]:       <serial>4a07443e-a368-43b5-90b0-e96c00dc86a7</serial>
Nov 29 20:23:21 user nova-compute[75356]:     </disk>
Nov 29 20:23:21 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:23:21 user nova-compute[75356]:       <mac address="fa:16:3e:b0:e6:d6"/>
Nov 29 20:23:21 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:23:21 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:23:21 user nova-compute[75356]:       <target dev="tapbf5b9476-92"/>
Nov 29 20:23:21 user nova-compute[75356]:     </interface>
Nov 29 20:23:21 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:23:21 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/console.log" append="off"/>
Nov 29 20:23:21 user nova-compute[75356]:     </serial>
Nov 29 20:23:21 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:23:21 user nova-compute[75356]:     <video>
Nov 29 20:23:21 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:23:21 user nova-compute[75356]:     </video>
Nov 29 20:23:21 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:23:21 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:23:21 user nova-compute[75356]:     </rng>
Nov 29 20:23:21 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:23:21 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:23:21 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:23:21 user nova-compute[75356]:     </memballoon>
Nov 29 20:23:21 user nova-compute[75356]:   </devices>
Nov 29 20:23:21 user nova-compute[75356]: </domain>
Nov 29 20:23:21 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2075887638',display_name='tempest-ServerActionsTestOtherB-server-2075887638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2075887638',id=5,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqmwjesnBZKKmMOP1nU5mLLaxgxAYrWKpY6AKu2j/L1exH/XrbvTGFuJ5hCGjIGc6yFau1HY0D/HH/XuWjDf7bDrvpfXRmVeDF3iS6kjnnvyZ4TUUiMwhiV4HxFj8NX1w==',key_name='tempest-keypair-1339068574',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:21:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='19fa4a7548454fc4a29a625b0c819c9c',ramdisk_id='',reservation_id='r-pzj88ta7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-403173210',owner_user_name='tempest-ServerActionsTestOtherB-403173210-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e5a895cde3741d0a48cb06922ad80f8',uuid=96cbbbdb-e1cc-49da-9a9f-5b83031b235b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Converting VIF {"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:e6:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf5b9476-92db-4a94-bcdd-485ba68a4d1e,network=Network(d5185e2d-1e16-408d-91cf-3c494b84cd52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5b9476-92') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG os_vif [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:e6:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf5b9476-92db-4a94-bcdd-485ba68a4d1e,network=Network(d5185e2d-1e16-408d-91cf-3c494b84cd52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5b9476-92') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c105df8-1b1c-5775-a139-20745adc70e0', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf5b9476-92, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf5b9476-92, col_values=(('qos', UUID('2044820f-ac32-4a3e-a8a1-301070273e8b')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf5b9476-92, col_values=(('external_ids', {'iface-id': 'bf5b9476-92db-4a94-bcdd-485ba68a4d1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:e6:d6', 'vm-uuid': '96cbbbdb-e1cc-49da-9a9f-5b83031b235b'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:23:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:21 user nova-compute[75356]: INFO os_vif [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:e6:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf5b9476-92db-4a94-bcdd-485ba68a4d1e,network=Network(d5185e2d-1e16-408d-91cf-3c494b84cd52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5b9476-92')
Nov 29 20:23:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:23 user nova-compute[75356]: DEBUG nova.compute.manager [req-e140a964-e673-43ef-b58e-ab65ce738c2a req-4f33a9ec-0f68-438f-a20f-60e0a457c649 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received event network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:23:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e140a964-e673-43ef-b58e-ab65ce738c2a req-4f33a9ec-0f68-438f-a20f-60e0a457c649 service nova] Acquiring lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e140a964-e673-43ef-b58e-ab65ce738c2a req-4f33a9ec-0f68-438f-a20f-60e0a457c649 service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e140a964-e673-43ef-b58e-ab65ce738c2a req-4f33a9ec-0f68-438f-a20f-60e0a457c649 service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:23 user nova-compute[75356]: DEBUG nova.compute.manager [req-e140a964-e673-43ef-b58e-ab65ce738c2a req-4f33a9ec-0f68-438f-a20f-60e0a457c649 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] No waiting events found dispatching network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:23:23 user nova-compute[75356]: WARNING nova.compute.manager [req-e140a964-e673-43ef-b58e-ab65ce738c2a req-4f33a9ec-0f68-438f-a20f-60e0a457c649 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received unexpected event network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e for instance with vm_state resized and task_state resize_reverting.
Nov 29 20:23:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-d5c73c77-2795-45fe-9012-87649a14ec13 req-98086039-cd3f-41a7-996b-90d9fbef1dbe service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received event network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:23:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d5c73c77-2795-45fe-9012-87649a14ec13 req-98086039-cd3f-41a7-996b-90d9fbef1dbe service nova] Acquiring lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d5c73c77-2795-45fe-9012-87649a14ec13 req-98086039-cd3f-41a7-996b-90d9fbef1dbe service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d5c73c77-2795-45fe-9012-87649a14ec13 req-98086039-cd3f-41a7-996b-90d9fbef1dbe service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-d5c73c77-2795-45fe-9012-87649a14ec13 req-98086039-cd3f-41a7-996b-90d9fbef1dbe service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] No waiting events found dispatching network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:23:25 user nova-compute[75356]: WARNING nova.compute.manager [req-d5c73c77-2795-45fe-9012-87649a14ec13 req-98086039-cd3f-41a7-996b-90d9fbef1dbe service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received unexpected event network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e for instance with vm_state resized and task_state resize_reverting.
Nov 29 20:23:25 user nova-compute[75356]: DEBUG nova.compute.manager [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:23:25 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Instance running successfully.
Nov 29 20:23:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] finish_revert_migration finished successfully. {{(pid=75356) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 29 20:23:25 user nova-compute[75356]: INFO nova.compute.manager [None req-a5db5ac0-a2ee-4737-9e68-13a4de285756 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Updating instance to original state: 'active'
Nov 29 20:23:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:31 user nova-compute[75356]: DEBUG nova.compute.manager [req-a56e60ac-4bc5-4994-9638-d8ad8e2ccf53 req-949cfe68-4cbe-40d4-939f-d0de45c6e232 service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Received event network-changed-dbd23e2b-e6d6-4942-9b2f-3db29d312a85 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:23:31 user nova-compute[75356]: DEBUG nova.compute.manager [req-a56e60ac-4bc5-4994-9638-d8ad8e2ccf53 req-949cfe68-4cbe-40d4-939f-d0de45c6e232 service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Refreshing instance network info cache due to event network-changed-dbd23e2b-e6d6-4942-9b2f-3db29d312a85. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:23:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a56e60ac-4bc5-4994-9638-d8ad8e2ccf53 req-949cfe68-4cbe-40d4-939f-d0de45c6e232 service nova] Acquiring lock "refresh_cache-0f9149e4-424b-42af-bd25-19d1cc7c0635" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:23:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a56e60ac-4bc5-4994-9638-d8ad8e2ccf53 req-949cfe68-4cbe-40d4-939f-d0de45c6e232 service nova] Acquired lock "refresh_cache-0f9149e4-424b-42af-bd25-19d1cc7c0635" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:23:31 user nova-compute[75356]: DEBUG nova.network.neutron [req-a56e60ac-4bc5-4994-9638-d8ad8e2ccf53 req-949cfe68-4cbe-40d4-939f-d0de45c6e232 service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Refreshing network info cache for port dbd23e2b-e6d6-4942-9b2f-3db29d312a85 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:23:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Acquiring lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG nova.objects.instance [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lazy-loading 'flavor' on Instance uuid 0f9149e4-424b-42af-bd25-19d1cc7c0635 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG nova.network.neutron [req-a56e60ac-4bc5-4994-9638-d8ad8e2ccf53 req-949cfe68-4cbe-40d4-939f-d0de45c6e232 service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Updated VIF entry in instance network info cache for port dbd23e2b-e6d6-4942-9b2f-3db29d312a85. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG nova.network.neutron [req-a56e60ac-4bc5-4994-9638-d8ad8e2ccf53 req-949cfe68-4cbe-40d4-939f-d0de45c6e232 service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Updating instance_info_cache with network_info: [{"id": "dbd23e2b-e6d6-4942-9b2f-3db29d312a85", "address": "fa:16:3e:b4:21:8a", "network": {"id": "19745e07-fd6f-4ae7-8f23-3000120764e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1773897841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca028c7723a1409e84ee22bbb14c3bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd23e2b-e6", "ovs_interfaceid": "dbd23e2b-e6d6-4942-9b2f-3db29d312a85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a56e60ac-4bc5-4994-9638-d8ad8e2ccf53 req-949cfe68-4cbe-40d4-939f-d0de45c6e232 service nova] Releasing lock "refresh_cache-0f9149e4-424b-42af-bd25-19d1cc7c0635" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Acquiring lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:32 user nova-compute[75356]: INFO nova.compute.manager [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Attaching volume cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f to /dev/vdb
Nov 29 20:23:32 user nova-compute[75356]: DEBUG os_brick.utils [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f0037d-96c2-403e-93d4-d79da4bdc24f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb16572-a19c-461d-a6f1-1f64b7ae6b04]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7782e7-9e71-4987-9e28-5b2154fd957e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[125a5ee7-872d-4a57-85da-1435bfc5b2c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:23:32 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:23:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0c3047-dfce-430d-8f12-d19ef1e57d21]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG os_brick.utils [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:23:32 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Updating existing volume attachment record: d1c4a3ec-7b39-4e8e-8d31-d6463cd240f9 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:23:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "3584b853-567c-4dd2-ae4f-3ff074074137" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "3584b853-567c-4dd2-ae4f-3ff074074137" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:36 user nova-compute[75356]: INFO nova.compute.manager [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Detaching volume 666acfe8-575a-47c8-9d8b-160fd478283c
Nov 29 20:23:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:36 user nova-compute[75356]: INFO nova.virt.block_device [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Attempting to driver detach volume 666acfe8-575a-47c8-9d8b-160fd478283c from mountpoint /dev/vdb
Nov 29 20:23:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Attempting to detach device vdb from instance 3584b853-567c-4dd2-ae4f-3ff074074137 from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:23:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:23:36 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:23:36 user nova-compute[75356]:   <source dev="/dev/sdc"/>
Nov 29 20:23:36 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:23:36 user nova-compute[75356]:   <serial>666acfe8-575a-47c8-9d8b-160fd478283c</serial>
Nov 29 20:23:36 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:23:36 user nova-compute[75356]: </disk>
Nov 29 20:23:36 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:23:36 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Successfully detached device vdb from instance 3584b853-567c-4dd2-ae4f-3ff074074137 from the persistent domain config.
Nov 29 20:23:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3584b853-567c-4dd2-ae4f-3ff074074137 from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:23:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:23:36 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:23:36 user nova-compute[75356]:   <source dev="/dev/sdc"/>
Nov 29 20:23:36 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:23:36 user nova-compute[75356]:   <serial>666acfe8-575a-47c8-9d8b-160fd478283c</serial>
Nov 29 20:23:36 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:23:36 user nova-compute[75356]: </disk>
Nov 29 20:23:36 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:23:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "3584b853-567c-4dd2-ae4f-3ff074074137" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3584b853-567c-4dd2-ae4f-3ff074074137 {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:23:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:23:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoZtKAaF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:23:40 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:23:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:23:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:23:40 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:23:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:23:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:23:40 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:23:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[918530cc-3806-4b74-82bf-2c5977c4ac30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:23:40 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8779a663-97f0-4df4-8fc8-24f997e52e49]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f] added
Nov 29 20:23:40 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3aabc6-6db3-4132-8730-795f69340325]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[46403c2e-2259-43f4-978b-22194ab4de7d]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoZtKAaF {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoZtKAaF" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[781a31a7-6a51-4f90-9d19-38307468bdd5]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XoZtKAaF'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb594366-439c-40fe-8463-f4a940ea26f0]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d729ca24-73a9-44a4-94a2-c035a2d62545]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:41 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:23:41 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:41 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:23:41 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:23:41 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:41 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:23:41 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:41 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:23:41 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:23:41 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fe2eb1-a7d6-4551-ad6d-bc97caee9d87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f, portal: 172.16.0.220,3260]
Nov 29 20:23:41 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f, portal: 172.16.0.220,3260] successful.
Nov 29 20:23:41 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[10550d68-e24a-4b88-ba62-00ad2317b205]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1b92b7-51ce-40ad-aab4-3360f00e1dda]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:41 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:23:41 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:41 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:23:41 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:23:41 user nova-compute[75356]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)
Nov 29 20:23:41 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:41 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:23:41 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:41 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:23:41 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:23:41 user nova-compute[75356]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)
Nov 29 20:23:41 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] HCTL ('38', '-', '-', 0) found on session 21 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef590ab-6194-4c8b-a8bf-1e5a9b19a2df]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Searching for a device in session 21 and hctl ['38', '*', '*', 0] yield: None {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:23:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:42 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Searching for a device in session 21 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:23:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoZtKAaF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:23:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:23:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23564343232626562', 'path': '/dev/sdg'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:23:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564343232626562', 'path': '/dev/sdg'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:23:42 user nova-compute[75356]: DEBUG nova.objects.instance [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lazy-loading 'flavor' on Instance uuid 0f9149e4-424b-42af-bd25-19d1cc7c0635 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:23:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:23:42 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:23:42 user nova-compute[75356]:   <source dev="/dev/sdg"/>
Nov 29 20:23:42 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:23:42 user nova-compute[75356]:   <serial>cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f</serial>
Nov 29 20:23:42 user nova-compute[75356]: </disk>
Nov 29 20:23:42 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:23:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:23:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:23:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] No VIF found with MAC fa:16:3e:b4:21:8a, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:23:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-dd6a89ab-1af2-4b44-b90f-91616693db38 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.250s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Acquiring lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG nova.objects.instance [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lazy-loading 'flavor' on Instance uuid 0f9149e4-424b-42af-bd25-19d1cc7c0635 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Acquiring lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:46 user nova-compute[75356]: INFO nova.compute.manager [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Attaching volume a2e395e9-752b-4d10-96c0-4143969cebde to /dev/vdc
Nov 29 20:23:46 user nova-compute[75356]: DEBUG os_brick.utils [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf78794f-047e-469f-b236-b00e7c17eae3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2163ebae-dacb-45f4-96d4-b7f353a83912]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[124eb08f-b042-4469-9f53-df528859994e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1125a208-571c-41ca-ad16-71974e062217]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:23:46 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:23:46 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8419bb89-6bea-454c-b1c2-59436cbc03f5]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG os_brick.utils [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:23:46 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Updating existing volume attachment record: f4ac779d-7bb0-483f-8e68-bd80d596ae68 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:23:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:48 user nova-compute[75356]: DEBUG nova.compute.manager [req-a4b68f12-cab6-490b-a47d-5056367299a2 req-d8639ee3-c643-401b-a16f-c522cb939aca service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Received event network-changed-fdc58621-94e8-4c85-bafb-a51ecd40720b {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:23:48 user nova-compute[75356]: DEBUG nova.compute.manager [req-a4b68f12-cab6-490b-a47d-5056367299a2 req-d8639ee3-c643-401b-a16f-c522cb939aca service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Refreshing instance network info cache due to event network-changed-fdc58621-94e8-4c85-bafb-a51ecd40720b. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:23:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a4b68f12-cab6-490b-a47d-5056367299a2 req-d8639ee3-c643-401b-a16f-c522cb939aca service nova] Acquiring lock "refresh_cache-7d27c88e-5de8-4401-aa9d-d88643b478b9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:23:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a4b68f12-cab6-490b-a47d-5056367299a2 req-d8639ee3-c643-401b-a16f-c522cb939aca service nova] Acquired lock "refresh_cache-7d27c88e-5de8-4401-aa9d-d88643b478b9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:23:48 user nova-compute[75356]: DEBUG nova.network.neutron [req-a4b68f12-cab6-490b-a47d-5056367299a2 req-d8639ee3-c643-401b-a16f-c522cb939aca service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Refreshing network info cache for port fdc58621-94e8-4c85-bafb-a51ecd40720b {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:23:48 user nova-compute[75356]: DEBUG nova.network.neutron [req-a4b68f12-cab6-490b-a47d-5056367299a2 req-d8639ee3-c643-401b-a16f-c522cb939aca service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Updated VIF entry in instance network info cache for port fdc58621-94e8-4c85-bafb-a51ecd40720b. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:23:48 user nova-compute[75356]: DEBUG nova.network.neutron [req-a4b68f12-cab6-490b-a47d-5056367299a2 req-d8639ee3-c643-401b-a16f-c522cb939aca service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Updating instance_info_cache with network_info: [{"id": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "address": "fa:16:3e:ba:30:23", "network": {"id": "a667657a-11b6-40b9-a2e8-f50c41d49b34", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355155956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509329256df34ff9b00d01614064ff91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc58621-94", "ovs_interfaceid": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:23:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a4b68f12-cab6-490b-a47d-5056367299a2 req-d8639ee3-c643-401b-a16f-c522cb939aca service nova] Releasing lock "refresh_cache-7d27c88e-5de8-4401-aa9d-d88643b478b9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:23:49 user nova-compute[75356]: INFO nova.compute.manager [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Rebuilding instance
Nov 29 20:23:49 user nova-compute[75356]: DEBUG nova.compute.manager [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:23:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:49 user nova-compute[75356]: DEBUG nova.compute.manager [req-314f1f13-52f3-4c05-aa57-57d2002cb106 req-af8d4b41-ef44-4cac-8ece-420c4f8ac1a6 service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Received event network-vif-unplugged-fdc58621-94e8-4c85-bafb-a51ecd40720b {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:23:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-314f1f13-52f3-4c05-aa57-57d2002cb106 req-af8d4b41-ef44-4cac-8ece-420c4f8ac1a6 service nova] Acquiring lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-314f1f13-52f3-4c05-aa57-57d2002cb106 req-af8d4b41-ef44-4cac-8ece-420c4f8ac1a6 service nova] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-314f1f13-52f3-4c05-aa57-57d2002cb106 req-af8d4b41-ef44-4cac-8ece-420c4f8ac1a6 service nova] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:49 user nova-compute[75356]: DEBUG nova.compute.manager [req-314f1f13-52f3-4c05-aa57-57d2002cb106 req-af8d4b41-ef44-4cac-8ece-420c4f8ac1a6 service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] No waiting events found dispatching network-vif-unplugged-fdc58621-94e8-4c85-bafb-a51ecd40720b {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:23:49 user nova-compute[75356]: WARNING nova.compute.manager [req-314f1f13-52f3-4c05-aa57-57d2002cb106 req-af8d4b41-ef44-4cac-8ece-420c4f8ac1a6 service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Received unexpected event network-vif-unplugged-fdc58621-94e8-4c85-bafb-a51ecd40720b for instance with vm_state active and task_state rebuilding.
Nov 29 20:23:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:50 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Instance destroyed successfully.
Nov 29 20:23:50 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Instance destroyed successfully.
Nov 29 20:23:50 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:21:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-219107618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1912060011',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp9h0sV8HqQQKrm9wRP86I0faDw7r9ov+BDsQBXkVs0aZuFJR32OVgyV5IeyoX7630/1HeOKAYpIohIRYAB/skYr0un2YHRwxSgPbrAhWys2tztVnD2rtF1IOLaH5rQSg==',key_name='tempest-keypair-416274752',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:22:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='509329256df34ff9b00d01614064ff91',ramdisk_id='',reservation_id='r-vk1q32sk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-829836017',owner_user_name='tempest-ServerActionsV293TestJSON-829836017-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:23:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69e09bd9b3774a6ebe0459412b688216',uuid=7d27c88e-5de8-4401-aa9d-d88643b478b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "address": "fa:16:3e:ba:30:23", "network": {"id": "a667657a-11b6-40b9-a2e8-f50c41d49b34", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355155956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509329256df34ff9b00d01614064ff91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc58621-94", "ovs_interfaceid": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Converting VIF {"id": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "address": "fa:16:3e:ba:30:23", "network": {"id": "a667657a-11b6-40b9-a2e8-f50c41d49b34", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355155956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509329256df34ff9b00d01614064ff91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc58621-94", "ovs_interfaceid": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:30:23,bridge_name='br-int',has_traffic_filtering=True,id=fdc58621-94e8-4c85-bafb-a51ecd40720b,network=Network(a667657a-11b6-40b9-a2e8-f50c41d49b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc58621-94') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG os_vif [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:30:23,bridge_name='br-int',has_traffic_filtering=True,id=fdc58621-94e8-4c85-bafb-a51ecd40720b,network=Network(a667657a-11b6-40b9-a2e8-f50c41d49b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc58621-94') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfdc58621-94, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0ec66b1-7bdb-425b-9ee3-e63f33a61959) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:50 user nova-compute[75356]: INFO os_vif [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:30:23,bridge_name='br-int',has_traffic_filtering=True,id=fdc58621-94e8-4c85-bafb-a51ecd40720b,network=Network(a667657a-11b6-40b9-a2e8-f50c41d49b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc58621-94')
Nov 29 20:23:50 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JlIeiaCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:23:50 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 20:23:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3bba89-c40e-45b0-9fa8-8eb7563387a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:23:50 user nova-compute[75356]: No targets found.
Nov 29 20:23:50 user nova-compute[75356]: iSNS:
Nov 29 20:23:50 user nova-compute[75356]: No targets found.
Nov 29 20:23:50 user nova-compute[75356]: STATIC:
Nov 29 20:23:50 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7
Nov 29 20:23:50 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:23:50 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:23:50 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c
Nov 29 20:23:50 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:23:50 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:23:50 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061
Nov 29 20:23:50 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:23:50 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:23:50 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f
Nov 29 20:23:50 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:23:50 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:23:50 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f
Nov 29 20:23:50 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:23:50 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:23:50 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:23:50 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:23:50 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:23:50 user nova-compute[75356]: FIRMWARE:
Nov 29 20:23:50 user nova-compute[75356]: No targets found.
Nov 29 20:23:50 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:23:50 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:23:50 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[931abab1-1a7c-476c-ae41-4f514ae92833]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7824526-dfef-4f26-87cd-112d60997356]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:50 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:23:50 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:50 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:23:50 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:23:50 user nova-compute[75356]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)
Nov 29 20:23:50 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:50 user nova-compute[75356]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:23:50 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:50 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:23:50 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:23:50 user nova-compute[75356]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)
Nov 29 20:23:50 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8308239b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061'): ({'sdd'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Removing single pathed devices sdd {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG nova.compute.manager [None req-e3ef53f0-8e42-4749-b6c8-9f1eb7ed5a76 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9b5698-38ae-4eed-a1bd-d94e397b8ce6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f33f63-85f0-4510-b6cb-cbcc5bd627a2]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Flushing IO for device /dev/sdd {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35c3566-684a-45c4-a493-1eb80384bca6]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:50 user nova-compute[75356]: INFO nova.compute.manager [None req-e3ef53f0-8e42-4749-b6c8-9f1eb7ed5a76 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] instance snapshotting
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c71dd0f-0b29-43a7-a725-880a1d8848e3]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] SCSI volumes sdd have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d08d5d-e383-434c-8533-033f74e14705]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:50 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-e3ef53f0-8e42-4749-b6c8-9f1eb7ed5a76 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Beginning live snapshot process
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc8d8bb-7183-4b22-8a96-42ff248794cf]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061, portal: 172.16.0.220,3260]
Nov 29 20:23:50 user nova-compute[75356]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061, portal: 172.16.0.220,3260] successful.
Nov 29 20:23:50 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b57c9c7-fc79-4f4f-9680-08a11a375f81]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] <== disconnect_volume: return (375ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:23:50 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Deleting instance files /opt/stack/data/nova/instances/7d27c88e-5de8-4401-aa9d-d88643b478b9_del
Nov 29 20:23:50 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Deletion of /opt/stack/data/nova/instances/7d27c88e-5de8-4401-aa9d-d88643b478b9_del complete
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e3ef53f0-8e42-4749-b6c8-9f1eb7ed5a76 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json -f qcow2 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e3ef53f0-8e42-4749-b6c8-9f1eb7ed5a76 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e3ef53f0-8e42-4749-b6c8-9f1eb7ed5a76 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json -f qcow2 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:51 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 7d27c88e-5de8-4401-aa9d-d88643b478b9 could not be found.
Nov 29 20:23:51 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JlIeiaCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:23:51 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 20:23:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2357862d-66f3-4bfc-a12d-925bd2e5bc83]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:23:51 user nova-compute[75356]: No targets found.
Nov 29 20:23:51 user nova-compute[75356]: iSNS:
Nov 29 20:23:51 user nova-compute[75356]: No targets found.
Nov 29 20:23:51 user nova-compute[75356]: STATIC:
Nov 29 20:23:51 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7
Nov 29 20:23:51 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:23:51 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:23:51 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c
Nov 29 20:23:51 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:23:51 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:23:51 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f
Nov 29 20:23:51 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:23:51 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:23:51 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f
Nov 29 20:23:51 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:23:51 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:23:51 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:23:51 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:23:51 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:23:51 user nova-compute[75356]: FIRMWARE:
Nov 29 20:23:51 user nova-compute[75356]: No targets found.
Nov 29 20:23:51 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:23:51 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:23:51 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6319fcd8-8595-46e3-b059-a9e60b84c328]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7c1032-0b7e-4c84-988e-505c118c479a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:51 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:51 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:23:51 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:23:51 user nova-compute[75356]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)
Nov 29 20:23:51 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:51 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:51 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:23:51 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:23:51 user nova-compute[75356]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)
Nov 29 20:23:51 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e45489d0>, {}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Disconnecting from: [] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.090s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] <== disconnect_volume: return (93ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e3ef53f0-8e42-4749-b6c8-9f1eb7ed5a76 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json -f qcow2" returned: 0 in 0.223s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e3ef53f0-8e42-4749-b6c8-9f1eb7ed5a76 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e3ef53f0-8e42-4749-b6c8-9f1eb7ed5a76 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.223s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e3ef53f0-8e42-4749-b6c8-9f1eb7ed5a76 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2e6frs03/e02c9b8e38144c96a9b1ad49125e674a.delta 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e3ef53f0-8e42-4749-b6c8-9f1eb7ed5a76 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2e6frs03/e02c9b8e38144c96a9b1ad49125e674a.delta 1073741824" returned: 0 in 0.050s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:51 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-e3ef53f0-8e42-4749-b6c8-9f1eb7ed5a76 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 20:23:51 user nova-compute[75356]: DEBUG nova.compute.manager [req-f4cedfcf-3798-4c65-9c46-7ceadc2c1739 req-017dd427-5b59-48c5-ae16-0ee396d21f0f service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Received event network-vif-plugged-fdc58621-94e8-4c85-bafb-a51ecd40720b {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f4cedfcf-3798-4c65-9c46-7ceadc2c1739 req-017dd427-5b59-48c5-ae16-0ee396d21f0f service nova] Acquiring lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f4cedfcf-3798-4c65-9c46-7ceadc2c1739 req-017dd427-5b59-48c5-ae16-0ee396d21f0f service nova] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f4cedfcf-3798-4c65-9c46-7ceadc2c1739 req-017dd427-5b59-48c5-ae16-0ee396d21f0f service nova] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:51 user nova-compute[75356]: DEBUG nova.compute.manager [req-f4cedfcf-3798-4c65-9c46-7ceadc2c1739 req-017dd427-5b59-48c5-ae16-0ee396d21f0f service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] No waiting events found dispatching network-vif-plugged-fdc58621-94e8-4c85-bafb-a51ecd40720b {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:23:51 user nova-compute[75356]: WARNING nova.compute.manager [req-f4cedfcf-3798-4c65-9c46-7ceadc2c1739 req-017dd427-5b59-48c5-ae16-0ee396d21f0f service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Received unexpected event network-vif-plugged-fdc58621-94e8-4c85-bafb-a51ecd40720b for instance with vm_state active and task_state rebuilding.
Nov 29 20:23:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:52 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-e3ef53f0-8e42-4749-b6c8-9f1eb7ed5a76 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:23:52 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-e3ef53f0-8e42-4749-b6c8-9f1eb7ed5a76 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] COPY block job progress, current cursor: 26673152 final cursor: 75497472 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-e3ef53f0-8e42-4749-b6c8-9f1eb7ed5a76 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:23:53 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-e3ef53f0-8e42-4749-b6c8-9f1eb7ed5a76 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 20:23:53 user nova-compute[75356]: DEBUG nova.privsep.utils [None req-e3ef53f0-8e42-4749-b6c8-9f1eb7ed5a76 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75356) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e3ef53f0-8e42-4749-b6c8-9f1eb7ed5a76 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2e6frs03/e02c9b8e38144c96a9b1ad49125e674a.delta /opt/stack/data/nova/instances/snapshots/tmp2e6frs03/e02c9b8e38144c96a9b1ad49125e674a {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:23:53 user nova-compute[75356]: WARNING nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Nov 29 20:23:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid 9751c435-4d10-46dc-86e7-39d40e8209d3 {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid 0b59517a-c467-432a-a73a-d1460c1574e7 {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid 28f5dcc3-db77-4c65-87af-e300f99d2be5 {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid 96cbbbdb-e1cc-49da-9a9f-5b83031b235b {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid 3584b853-567c-4dd2-ae4f-3ff074074137 {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid 0f9149e4-424b-42af-bd25-19d1cc7c0635 {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid db0826f0-5fdc-47a8-ae36-5059844980c9 {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid 7982934b-8c0f-4403-8607-2a2679070e02 {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid 36ec2327-b376-49e4-8592-b2a077b79043 {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid 7d27c88e-5de8-4401-aa9d-d88643b478b9 {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "9751c435-4d10-46dc-86e7-39d40e8209d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "9751c435-4d10-46dc-86e7-39d40e8209d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "0b59517a-c467-432a-a73a-d1460c1574e7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "0b59517a-c467-432a-a73a-d1460c1574e7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "28f5dcc3-db77-4c65-87af-e300f99d2be5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "3584b853-567c-4dd2-ae4f-3ff074074137" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "db0826f0-5fdc-47a8-ae36-5059844980c9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "db0826f0-5fdc-47a8-ae36-5059844980c9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:53 user nova-compute[75356]: INFO nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] During sync_power_state the instance has a pending task (image_pending_upload). Skip.
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "db0826f0-5fdc-47a8-ae36-5059844980c9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "7982934b-8c0f-4403-8607-2a2679070e02" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "7982934b-8c0f-4403-8607-2a2679070e02" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "36ec2327-b376-49e4-8592-b2a077b79043" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "36ec2327-b376-49e4-8592-b2a077b79043" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "7d27c88e-5de8-4401-aa9d-d88643b478b9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:53 user nova-compute[75356]: INFO nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] During sync_power_state the instance has a pending task (rebuilding). Skip.
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "0b59517a-c467-432a-a73a-d1460c1574e7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "7982934b-8c0f-4403-8607-2a2679070e02" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "9751c435-4d10-46dc-86e7-39d40e8209d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.128s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.136s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "36ec2327-b376-49e4-8592-b2a077b79043" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.134s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e3ef53f0-8e42-4749-b6c8-9f1eb7ed5a76 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2e6frs03/e02c9b8e38144c96a9b1ad49125e674a.delta /opt/stack/data/nova/instances/snapshots/tmp2e6frs03/e02c9b8e38144c96a9b1ad49125e674a" returned: 0 in 0.686s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:54 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-e3ef53f0-8e42-4749-b6c8-9f1eb7ed5a76 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Snapshot extracted, beginning image upload
Nov 29 20:23:54 user nova-compute[75356]: DEBUG nova.compute.manager [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Preparing to wait for external event volume-reimaged-0150af0a-0981-4423-8a10-f67ac89c4061 {{(pid=75356) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 29 20:23:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Acquiring lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:54 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGKEcNge', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:23:55 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:23:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:23:55 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:23:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:23:55 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c3208d-fc1d-492b-ab14-0ac63b6e180c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:23:55 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[05abf147-c3a6-42be-b547-ec575e0ab5c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde] added
Nov 29 20:23:55 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[79867bf9-d5e8-4cc1-8b11-053c82b84e74]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[61893347-e52a-4cfb-8df1-da578dcd26f8]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TGKEcNge {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TGKEcNge" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90164ef-2b60-468c-a30c-906c7e457be9]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TGKEcNge'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d376d8bf-6224-4434-9785-7715a742e51d]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f34449-6206-4452-b986-9ad5b1f36ddc]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:55 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:55 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:23:55 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:23:55 user nova-compute[75356]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)
Nov 29 20:23:55 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:55 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:55 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:23:55 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:23:55 user nova-compute[75356]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)
Nov 29 20:23:55 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0315bb-4382-46fb-b961-444cc54b44e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde, portal: 172.16.0.220,3260]
Nov 29 20:23:55 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde, portal: 172.16.0.220,3260] successful.
Nov 29 20:23:55 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b1de74-286a-42cc-8f6f-f37cfc831f30]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[229b9e9f-3409-4501-bd41-3222341894e8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:55 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:55 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:23:55 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:23:55 user nova-compute[75356]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)
Nov 29 20:23:55 user nova-compute[75356]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde (non-flash)
Nov 29 20:23:55 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:55 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:55 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:23:55 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:23:55 user nova-compute[75356]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)
Nov 29 20:23:55 user nova-compute[75356]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde (non-flash)
Nov 29 20:23:55 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c3951f-ef60-4321-b07c-ff2ead4338f9]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:23:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGKEcNge', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:23:56 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:23:56 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:23:56 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Didn't find any instances for network info cache update. {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 20:23:56 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:23:56 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:23:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:56 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:23:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:56 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-e3ef53f0-8e42-4749-b6c8-9f1eb7ed5a76 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Snapshot image upload complete
Nov 29 20:23:56 user nova-compute[75356]: INFO nova.compute.manager [None req-e3ef53f0-8e42-4749-b6c8-9f1eb7ed5a76 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Took 6.29 seconds to snapshot the instance on the hypervisor.
Nov 29 20:23:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:23:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:23:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23730396562313461', 'path': '/dev/sdd'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:23:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730396562313461', 'path': '/dev/sdd'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:23:56 user nova-compute[75356]: DEBUG nova.objects.instance [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lazy-loading 'flavor' on Instance uuid 0f9149e4-424b-42af-bd25-19d1cc7c0635 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:23:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:23:56 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:23:56 user nova-compute[75356]:   <source dev="/dev/sdd"/>
Nov 29 20:23:56 user nova-compute[75356]:   <target dev="vdc" bus="virtio"/>
Nov 29 20:23:56 user nova-compute[75356]:   <serial>a2e395e9-752b-4d10-96c0-4143969cebde</serial>
Nov 29 20:23:56 user nova-compute[75356]: </disk>
Nov 29 20:23:56 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:57 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3584b853-567c-4dd2-ae4f-3ff074074137 is timed out.
Nov 29 20:23:57 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Successfully detached device vdb from instance 3584b853-567c-4dd2-ae4f-3ff074074137 from the live domain config.
Nov 29 20:23:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'waIcDgEV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:23:57 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:23:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[505a01b5-eb63-4e18-85b4-b9a4883bd37a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:23:57 user nova-compute[75356]: No targets found.
Nov 29 20:23:57 user nova-compute[75356]: iSNS:
Nov 29 20:23:57 user nova-compute[75356]: No targets found.
Nov 29 20:23:57 user nova-compute[75356]: STATIC:
Nov 29 20:23:57 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde
Nov 29 20:23:57 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:23:57 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:23:57 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7
Nov 29 20:23:57 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:23:57 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:23:57 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c
Nov 29 20:23:57 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:23:57 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:23:57 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f
Nov 29 20:23:57 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:23:57 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:23:57 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f
Nov 29 20:23:57 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:23:57 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:23:57 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:23:57 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:23:57 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:23:57 user nova-compute[75356]: FIRMWARE:
Nov 29 20:23:57 user nova-compute[75356]: No targets found.
Nov 29 20:23:57 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:23:57 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:23:57 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] No VIF found with MAC fa:16:3e:b4:21:8a, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7818a7c-1194-4970-bace-b550d5d982fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d2a71c-2b56-4b50-99df-8143430de858]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:57 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:57 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:23:57 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:23:57 user nova-compute[75356]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)
Nov 29 20:23:57 user nova-compute[75356]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde (non-flash)
Nov 29 20:23:57 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:23:57 user nova-compute[75356]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c (non-flash)
Nov 29 20:23:57 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:23:57 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:23:57 user nova-compute[75356]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)
Nov 29 20:23:57 user nova-compute[75356]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde (non-flash)
Nov 29 20:23:57 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830823b2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c'): ({'sdc'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Removing single pathed devices sdc {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb675a0-88bb-4706-ad04-d12edbf11765]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4aeff2-9297-4f80-9c13-0007ce1f2bb5]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Flushing IO for device /dev/sdc {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9750399-7b01-4702-9fb0-aeb11be194bb]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7597a022-5187-455a-afc8-2c3c60205fff]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1efffae6-9ee4-43a6-ae30-af0d90ccde6c tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.858s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.839s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3eb920-412b-4ab2-a884-e95b422189ca]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bef94b-a7ad-4bbc-a83b-a2795f13f7e2]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c, portal: 172.16.0.220,3260]
Nov 29 20:23:57 user nova-compute[75356]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c, portal: 172.16.0.220,3260] successful.
Nov 29 20:23:57 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2881a07-501d-4f6b-96cb-f4080e127522]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] <== disconnect_volume: return (404ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:23:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Acquiring lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:23:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:23:58 user nova-compute[75356]: INFO nova.compute.manager [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Detaching volume a2e395e9-752b-4d10-96c0-4143969cebde
Nov 29 20:23:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:59 user nova-compute[75356]: INFO nova.virt.block_device [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Attempting to driver detach volume a2e395e9-752b-4d10-96c0-4143969cebde from mountpoint /dev/vdc
Nov 29 20:23:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Attempting to detach device vdc from instance 0f9149e4-424b-42af-bd25-19d1cc7c0635 from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:23:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:23:59 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:23:59 user nova-compute[75356]:   <source dev="/dev/sdd"/>
Nov 29 20:23:59 user nova-compute[75356]:   <target dev="vdc" bus="virtio"/>
Nov 29 20:23:59 user nova-compute[75356]:   <serial>a2e395e9-752b-4d10-96c0-4143969cebde</serial>
Nov 29 20:23:59 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 20:23:59 user nova-compute[75356]: </disk>
Nov 29 20:23:59 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:23:59 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Successfully detached device vdc from instance 0f9149e4-424b-42af-bd25-19d1cc7c0635 from the persistent domain config.
Nov 29 20:23:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0f9149e4-424b-42af-bd25-19d1cc7c0635 from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:23:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:23:59 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:23:59 user nova-compute[75356]:   <source dev="/dev/sdd"/>
Nov 29 20:23:59 user nova-compute[75356]:   <target dev="vdc" bus="virtio"/>
Nov 29 20:23:59 user nova-compute[75356]:   <serial>a2e395e9-752b-4d10-96c0-4143969cebde</serial>
Nov 29 20:23:59 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 20:23:59 user nova-compute[75356]: </disk>
Nov 29 20:23:59 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:23:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:23:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:23:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0f9149e4-424b-42af-bd25-19d1cc7c0635 {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:23:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:23:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:23:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:00 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:24:00 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:24:00 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=7454MB free_disk=25.145553588867188GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:24:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:00 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 9751c435-4d10-46dc-86e7-39d40e8209d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:24:00 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0b59517a-c467-432a-a73a-d1460c1574e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:24:00 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:24:00 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 36ec2327-b376-49e4-8592-b2a077b79043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:24:00 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 3584b853-567c-4dd2-ae4f-3ff074074137 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:24:00 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 96cbbbdb-e1cc-49da-9a9f-5b83031b235b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:24:00 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0f9149e4-424b-42af-bd25-19d1cc7c0635 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:24:00 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 7d27c88e-5de8-4401-aa9d-d88643b478b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:24:00 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance db0826f0-5fdc-47a8-ae36-5059844980c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:24:00 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 7982934b-8c0f-4403-8607-2a2679070e02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:24:00 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:24:00 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:24:00 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:24:00 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:24:01 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:24:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.624s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:01 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:24:01 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:24:01 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:24:01 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:24:01 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:24:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:05 user nova-compute[75356]: DEBUG nova.compute.manager [req-30132363-ea8b-4e20-b224-0907d3eabb66 req-177ee909-63b2-44e5-aeb4-22f23f750743 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received event network-changed-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:24:05 user nova-compute[75356]: DEBUG nova.compute.manager [req-30132363-ea8b-4e20-b224-0907d3eabb66 req-177ee909-63b2-44e5-aeb4-22f23f750743 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Refreshing instance network info cache due to event network-changed-2273063c-59ad-4c22-baac-b35f81cddd68. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:24:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-30132363-ea8b-4e20-b224-0907d3eabb66 req-177ee909-63b2-44e5-aeb4-22f23f750743 service nova] Acquiring lock "refresh_cache-7982934b-8c0f-4403-8607-2a2679070e02" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:24:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-30132363-ea8b-4e20-b224-0907d3eabb66 req-177ee909-63b2-44e5-aeb4-22f23f750743 service nova] Acquired lock "refresh_cache-7982934b-8c0f-4403-8607-2a2679070e02" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:24:05 user nova-compute[75356]: DEBUG nova.network.neutron [req-30132363-ea8b-4e20-b224-0907d3eabb66 req-177ee909-63b2-44e5-aeb4-22f23f750743 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Refreshing network info cache for port 2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:24:06 user nova-compute[75356]: DEBUG nova.objects.instance [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lazy-loading 'flavor' on Instance uuid 3584b853-567c-4dd2-ae4f-3ff074074137 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:24:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-03cbed6a-4402-4f4a-93fe-952193135680 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "3584b853-567c-4dd2-ae4f-3ff074074137" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.618s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "3584b853-567c-4dd2-ae4f-3ff074074137" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 29.245s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "3584b853-567c-4dd2-ae4f-3ff074074137-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "3584b853-567c-4dd2-ae4f-3ff074074137-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "3584b853-567c-4dd2-ae4f-3ff074074137-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:06 user nova-compute[75356]: INFO nova.compute.manager [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Terminating instance
Nov 29 20:24:06 user nova-compute[75356]: DEBUG nova.compute.manager [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:24:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:06 user nova-compute[75356]: DEBUG nova.network.neutron [req-30132363-ea8b-4e20-b224-0907d3eabb66 req-177ee909-63b2-44e5-aeb4-22f23f750743 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Updated VIF entry in instance network info cache for port 2273063c-59ad-4c22-baac-b35f81cddd68. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:24:06 user nova-compute[75356]: DEBUG nova.network.neutron [req-30132363-ea8b-4e20-b224-0907d3eabb66 req-177ee909-63b2-44e5-aeb4-22f23f750743 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Updating instance_info_cache with network_info: [{"id": "2273063c-59ad-4c22-baac-b35f81cddd68", "address": "fa:16:3e:3f:8c:d9", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2273063c-59", "ovs_interfaceid": "2273063c-59ad-4c22-baac-b35f81cddd68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:24:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-30132363-ea8b-4e20-b224-0907d3eabb66 req-177ee909-63b2-44e5-aeb4-22f23f750743 service nova] Releasing lock "refresh_cache-7982934b-8c0f-4403-8607-2a2679070e02" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:24:07 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Instance destroyed successfully.
Nov 29 20:24:07 user nova-compute[75356]: DEBUG nova.objects.instance [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lazy-loading 'resources' on Instance uuid 3584b853-567c-4dd2-ae4f-3ff074074137 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:21:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1086938846',display_name='tempest-VolumesSnapshotTestJSON-instance-1086938846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1086938846',id=16,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV7S9osvaBvhuweeuKkdxH56jbjNcEBHmb6gaSr6ReHMEwa0LcCct9HZb53jwXecv/95RLtWmtafJlcPGg4YAjJR7p1zPQiTyBPWvt+xxx286V7nz+04ZF4Nk+AM/ir3w==',key_name='tempest-keypair-1838781217',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:21:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85535b509efe4dbb81c372f9031faac0',ramdisk_id='',reservation_id='r-tcg1c5m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-740377086',owner_user_name='tempest-VolumesSnapshotTestJSON-740377086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:21:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc9deaf0a28f4afaad9e42ecc448a23d',uuid=3584b853-567c-4dd2-ae4f-3ff074074137,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd24c38c-a857-4b18-9d9b-55f692288c5f", "address": "fa:16:3e:db:49:9b", "network": {"id": "c1768664-edc2-4213-80e3-64f7600eeb75", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688549704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85535b509efe4dbb81c372f9031faac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd24c38c-a8", "ovs_interfaceid": "bd24c38c-a857-4b18-9d9b-55f692288c5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Converting VIF {"id": "bd24c38c-a857-4b18-9d9b-55f692288c5f", "address": "fa:16:3e:db:49:9b", "network": {"id": "c1768664-edc2-4213-80e3-64f7600eeb75", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688549704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85535b509efe4dbb81c372f9031faac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd24c38c-a8", "ovs_interfaceid": "bd24c38c-a857-4b18-9d9b-55f692288c5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:49:9b,bridge_name='br-int',has_traffic_filtering=True,id=bd24c38c-a857-4b18-9d9b-55f692288c5f,network=Network(c1768664-edc2-4213-80e3-64f7600eeb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd24c38c-a8') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG os_vif [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:49:9b,bridge_name='br-int',has_traffic_filtering=True,id=bd24c38c-a857-4b18-9d9b-55f692288c5f,network=Network(c1768664-edc2-4213-80e3-64f7600eeb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd24c38c-a8') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd24c38c-a8, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64512a0b-1ada-435a-81e2-be9ccdc64ed2) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:24:07 user nova-compute[75356]: INFO os_vif [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:49:9b,bridge_name='br-int',has_traffic_filtering=True,id=bd24c38c-a857-4b18-9d9b-55f692288c5f,network=Network(c1768664-edc2-4213-80e3-64f7600eeb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd24c38c-a8')
Nov 29 20:24:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'waIcDgEV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:24:07 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:24:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa363a2-0882-44ce-bf53-a1b5f556e398]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:24:07 user nova-compute[75356]: No targets found.
Nov 29 20:24:07 user nova-compute[75356]: iSNS:
Nov 29 20:24:07 user nova-compute[75356]: No targets found.
Nov 29 20:24:07 user nova-compute[75356]: STATIC:
Nov 29 20:24:07 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde
Nov 29 20:24:07 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:24:07 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:24:07 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7
Nov 29 20:24:07 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:24:07 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:24:07 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f
Nov 29 20:24:07 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:24:07 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:24:07 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f
Nov 29 20:24:07 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:24:07 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:24:07 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:24:07 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:24:07 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:24:07 user nova-compute[75356]: FIRMWARE:
Nov 29 20:24:07 user nova-compute[75356]: No targets found.
Nov 29 20:24:07 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:24:07 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:24:07 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:666acfe8-575a-47c8-9d8b-160fd478283c', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e918995-3abb-4638-893d-7ae912131bc1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ceae404-b758-4e9e-95a0-d748c5e1ca06]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:24:07 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:24:07 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:24:07 user nova-compute[75356]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)
Nov 29 20:24:07 user nova-compute[75356]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde (non-flash)
Nov 29 20:24:07 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:24:07 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:24:07 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:24:07 user nova-compute[75356]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)
Nov 29 20:24:07 user nova-compute[75356]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde (non-flash)
Nov 29 20:24:07 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e44a4040>, {}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Disconnecting from: [] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] <== disconnect_volume: return (85ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:24:07 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Deleting instance files /opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137_del
Nov 29 20:24:07 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Deletion of /opt/stack/data/nova/instances/3584b853-567c-4dd2-ae4f-3ff074074137_del complete
Nov 29 20:24:07 user nova-compute[75356]: INFO nova.compute.manager [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 29 20:24:07 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-635c9d59-61b1-4890-9c80-8502db0dd2d7 req-761a3c4e-95f8-433c-9d94-21e46979317f service nova] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Received event network-vif-unplugged-bd24c38c-a857-4b18-9d9b-55f692288c5f {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-635c9d59-61b1-4890-9c80-8502db0dd2d7 req-761a3c4e-95f8-433c-9d94-21e46979317f service nova] Acquiring lock "3584b853-567c-4dd2-ae4f-3ff074074137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-635c9d59-61b1-4890-9c80-8502db0dd2d7 req-761a3c4e-95f8-433c-9d94-21e46979317f service nova] Lock "3584b853-567c-4dd2-ae4f-3ff074074137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-635c9d59-61b1-4890-9c80-8502db0dd2d7 req-761a3c4e-95f8-433c-9d94-21e46979317f service nova] Lock "3584b853-567c-4dd2-ae4f-3ff074074137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-635c9d59-61b1-4890-9c80-8502db0dd2d7 req-761a3c4e-95f8-433c-9d94-21e46979317f service nova] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] No waiting events found dispatching network-vif-unplugged-bd24c38c-a857-4b18-9d9b-55f692288c5f {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-635c9d59-61b1-4890-9c80-8502db0dd2d7 req-761a3c4e-95f8-433c-9d94-21e46979317f service nova] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Received event network-vif-unplugged-bd24c38c-a857-4b18-9d9b-55f692288c5f for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-635c9d59-61b1-4890-9c80-8502db0dd2d7 req-761a3c4e-95f8-433c-9d94-21e46979317f service nova] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Received event network-vif-plugged-bd24c38c-a857-4b18-9d9b-55f692288c5f {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-635c9d59-61b1-4890-9c80-8502db0dd2d7 req-761a3c4e-95f8-433c-9d94-21e46979317f service nova] Acquiring lock "3584b853-567c-4dd2-ae4f-3ff074074137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-635c9d59-61b1-4890-9c80-8502db0dd2d7 req-761a3c4e-95f8-433c-9d94-21e46979317f service nova] Lock "3584b853-567c-4dd2-ae4f-3ff074074137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-635c9d59-61b1-4890-9c80-8502db0dd2d7 req-761a3c4e-95f8-433c-9d94-21e46979317f service nova] Lock "3584b853-567c-4dd2-ae4f-3ff074074137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-635c9d59-61b1-4890-9c80-8502db0dd2d7 req-761a3c4e-95f8-433c-9d94-21e46979317f service nova] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] No waiting events found dispatching network-vif-plugged-bd24c38c-a857-4b18-9d9b-55f692288c5f {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:24:07 user nova-compute[75356]: WARNING nova.compute.manager [req-635c9d59-61b1-4890-9c80-8502db0dd2d7 req-761a3c4e-95f8-433c-9d94-21e46979317f service nova] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Received unexpected event network-vif-plugged-bd24c38c-a857-4b18-9d9b-55f692288c5f for instance with vm_state active and task_state deleting.
Nov 29 20:24:08 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:24:08 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Took 1.08 seconds to deallocate network for instance.
Nov 29 20:24:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-03c3db29-aa1c-4f93-840d-d7f0cc0f63d0 req-e5c6cc87-12b9-4ce1-8083-092b5bf430a2 service nova] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Received event network-vif-deleted-bd24c38c-a857-4b18-9d9b-55f692288c5f {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:24:08 user nova-compute[75356]: WARNING nova.volume.cinder [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Attachment 399a46cb-502e-4ade-9a3c-8ab2bd3fdf91 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 399a46cb-502e-4ade-9a3c-8ab2bd3fdf91. (HTTP 404) (Request-ID: req-258a0a44-1cd3-4b04-b9a4-26861f6a299f)
Nov 29 20:24:08 user nova-compute[75356]: INFO nova.compute.manager [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] Took 0.04 seconds to detach 1 volumes for instance.
Nov 29 20:24:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:08 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:24:08 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:24:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:08 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Deleted allocations for instance 3584b853-567c-4dd2-ae4f-3ff074074137
Nov 29 20:24:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-52de2139-903a-49f5-82ee-320f876d8d34 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "3584b853-567c-4dd2-ae4f-3ff074074137" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.727s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "3584b853-567c-4dd2-ae4f-3ff074074137" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 15.209s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:09 user nova-compute[75356]: INFO nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 3584b853-567c-4dd2-ae4f-3ff074074137] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 29 20:24:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "3584b853-567c-4dd2-ae4f-3ff074074137" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "7982934b-8c0f-4403-8607-2a2679070e02" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "7982934b-8c0f-4403-8607-2a2679070e02" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:09 user nova-compute[75356]: INFO nova.compute.manager [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Shelving
Nov 29 20:24:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:09 user nova-compute[75356]: DEBUG nova.compute.manager [req-d315c100-c602-4b07-b36b-53fa6508f2f7 req-ba9bcf8d-f477-4c89-bcc4-79c42270cee7 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received event network-vif-unplugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:24:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d315c100-c602-4b07-b36b-53fa6508f2f7 req-ba9bcf8d-f477-4c89-bcc4-79c42270cee7 service nova] Acquiring lock "7982934b-8c0f-4403-8607-2a2679070e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d315c100-c602-4b07-b36b-53fa6508f2f7 req-ba9bcf8d-f477-4c89-bcc4-79c42270cee7 service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d315c100-c602-4b07-b36b-53fa6508f2f7 req-ba9bcf8d-f477-4c89-bcc4-79c42270cee7 service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:09 user nova-compute[75356]: DEBUG nova.compute.manager [req-d315c100-c602-4b07-b36b-53fa6508f2f7 req-ba9bcf8d-f477-4c89-bcc4-79c42270cee7 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] No waiting events found dispatching network-vif-unplugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:24:09 user nova-compute[75356]: WARNING nova.compute.manager [req-d315c100-c602-4b07-b36b-53fa6508f2f7 req-ba9bcf8d-f477-4c89-bcc4-79c42270cee7 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received unexpected event network-vif-unplugged-2273063c-59ad-4c22-baac-b35f81cddd68 for instance with vm_state active and task_state shelving.
Nov 29 20:24:10 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Instance destroyed successfully.
Nov 29 20:24:10 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Beginning cold snapshot process
Nov 29 20:24:10 user nova-compute[75356]: DEBUG nova.privsep.utils [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75356) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 20:24:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk /opt/stack/data/nova/instances/snapshots/tmp9bwejwqs/f1921adf24be4bbfbf2be19dcbad4e75 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk /opt/stack/data/nova/instances/snapshots/tmp9bwejwqs/f1921adf24be4bbfbf2be19dcbad4e75" returned: 0 in 1.253s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:11 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Snapshot extracted, beginning image upload
Nov 29 20:24:11 user nova-compute[75356]: DEBUG nova.compute.manager [req-67c471cf-b2ee-4fc4-ab14-ca2fe7b5fa45 req-85459584-47ea-4d8d-90c2-3bcf77c38d4c service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received event network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:24:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-67c471cf-b2ee-4fc4-ab14-ca2fe7b5fa45 req-85459584-47ea-4d8d-90c2-3bcf77c38d4c service nova] Acquiring lock "7982934b-8c0f-4403-8607-2a2679070e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-67c471cf-b2ee-4fc4-ab14-ca2fe7b5fa45 req-85459584-47ea-4d8d-90c2-3bcf77c38d4c service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-67c471cf-b2ee-4fc4-ab14-ca2fe7b5fa45 req-85459584-47ea-4d8d-90c2-3bcf77c38d4c service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:11 user nova-compute[75356]: DEBUG nova.compute.manager [req-67c471cf-b2ee-4fc4-ab14-ca2fe7b5fa45 req-85459584-47ea-4d8d-90c2-3bcf77c38d4c service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] No waiting events found dispatching network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:24:11 user nova-compute[75356]: WARNING nova.compute.manager [req-67c471cf-b2ee-4fc4-ab14-ca2fe7b5fa45 req-85459584-47ea-4d8d-90c2-3bcf77c38d4c service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received unexpected event network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 20:24:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:14 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Snapshot image upload complete
Nov 29 20:24:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:24:14 user nova-compute[75356]: INFO nova.compute.manager [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Shelve offloading
Nov 29 20:24:14 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Instance destroyed successfully.
Nov 29 20:24:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:24:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "refresh_cache-7982934b-8c0f-4403-8607-2a2679070e02" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:24:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquired lock "refresh_cache-7982934b-8c0f-4403-8607-2a2679070e02" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:24:14 user nova-compute[75356]: DEBUG nova.network.neutron [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:24:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:15 user nova-compute[75356]: DEBUG nova.network.neutron [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Updating instance_info_cache with network_info: [{"id": "2273063c-59ad-4c22-baac-b35f81cddd68", "address": "fa:16:3e:3f:8c:d9", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2273063c-59", "ovs_interfaceid": "2273063c-59ad-4c22-baac-b35f81cddd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:24:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Releasing lock "refresh_cache-7982934b-8c0f-4403-8607-2a2679070e02" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:24:15 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Instance destroyed successfully.
Nov 29 20:24:15 user nova-compute[75356]: DEBUG nova.objects.instance [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lazy-loading 'resources' on Instance uuid 7982934b-8c0f-4403-8607-2a2679070e02 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:24:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-859860773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-859860773',id=20,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB61jWQLvhl105AL/kOrG2alsz/RIWF011SgEudyJwJKmlKy4g4wrMvyGGcKLeZjIEL23ogtBjthvwquYW/ZXfCmfVBm47cAiaZ3AkaXj9dYDhiFzXqQnT7zoPPd4sjddA==',key_name='tempest-keypair-1095450286',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:22:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='71e99301081a4158bc9d188e2f796350',ramdisk_id='',reservation_id='r-5mvrbzg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1538416601',owner_user_name='tempest-AttachVolumeShelveTestJSON-1538416601-project-member',shelved_at='2023-11-29T20:24:14.614669',shelved_host='user',shelved_image_id='597598e6-804f-4f4b-9b95-17f06115115b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:24:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecc96706ae3140ce8816c0e78e116d7d',uuid=7982934b-8c0f-4403-8607-2a2679070e02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "2273063c-59ad-4c22-baac-b35f81cddd68", "address": "fa:16:3e:3f:8c:d9", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2273063c-59", "ovs_interfaceid": "2273063c-59ad-4c22-baac-b35f81cddd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:24:15 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converting VIF {"id": "2273063c-59ad-4c22-baac-b35f81cddd68", "address": "fa:16:3e:3f:8c:d9", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2273063c-59", "ovs_interfaceid": "2273063c-59ad-4c22-baac-b35f81cddd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:24:15 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:8c:d9,bridge_name='br-int',has_traffic_filtering=True,id=2273063c-59ad-4c22-baac-b35f81cddd68,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2273063c-59') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:24:15 user nova-compute[75356]: DEBUG os_vif [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:8c:d9,bridge_name='br-int',has_traffic_filtering=True,id=2273063c-59ad-4c22-baac-b35f81cddd68,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2273063c-59') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:24:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2273063c-59, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:24:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60662d5e-4249-4374-ac7c-efa121d19ef6) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-cfc3317d-b35b-4131-ba7e-b11aed03a319 req-5b78c29f-bb70-42f7-b93a-03bbc3ee199c service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received event network-changed-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:24:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-cfc3317d-b35b-4131-ba7e-b11aed03a319 req-5b78c29f-bb70-42f7-b93a-03bbc3ee199c service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Refreshing instance network info cache due to event network-changed-2273063c-59ad-4c22-baac-b35f81cddd68. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:24:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cfc3317d-b35b-4131-ba7e-b11aed03a319 req-5b78c29f-bb70-42f7-b93a-03bbc3ee199c service nova] Acquiring lock "refresh_cache-7982934b-8c0f-4403-8607-2a2679070e02" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:24:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cfc3317d-b35b-4131-ba7e-b11aed03a319 req-5b78c29f-bb70-42f7-b93a-03bbc3ee199c service nova] Acquired lock "refresh_cache-7982934b-8c0f-4403-8607-2a2679070e02" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:24:15 user nova-compute[75356]: DEBUG nova.network.neutron [req-cfc3317d-b35b-4131-ba7e-b11aed03a319 req-5b78c29f-bb70-42f7-b93a-03bbc3ee199c service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Refreshing network info cache for port 2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:24:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:24:15 user nova-compute[75356]: INFO os_vif [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:8c:d9,bridge_name='br-int',has_traffic_filtering=True,id=2273063c-59ad-4c22-baac-b35f81cddd68,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2273063c-59')
Nov 29 20:24:15 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Deleting instance files /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02_del
Nov 29 20:24:15 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Deletion of /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02_del complete
Nov 29 20:24:16 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Deleted allocations for instance 7982934b-8c0f-4403-8607-2a2679070e02
Nov 29 20:24:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:16 user nova-compute[75356]: DEBUG nova.objects.instance [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lazy-loading 'numa_topology' on Instance uuid 7982934b-8c0f-4403-8607-2a2679070e02 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:24:16 user nova-compute[75356]: DEBUG nova.objects.base [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Object Instance<7982934b-8c0f-4403-8607-2a2679070e02> lazy-loaded attributes: resources,numa_topology {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:24:16 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:24:16 user nova-compute[75356]: DEBUG nova.network.neutron [req-cfc3317d-b35b-4131-ba7e-b11aed03a319 req-5b78c29f-bb70-42f7-b93a-03bbc3ee199c service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Updated VIF entry in instance network info cache for port 2273063c-59ad-4c22-baac-b35f81cddd68. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:24:16 user nova-compute[75356]: DEBUG nova.network.neutron [req-cfc3317d-b35b-4131-ba7e-b11aed03a319 req-5b78c29f-bb70-42f7-b93a-03bbc3ee199c service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Updating instance_info_cache with network_info: [{"id": "2273063c-59ad-4c22-baac-b35f81cddd68", "address": "fa:16:3e:3f:8c:d9", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2273063c-59", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:24:16 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:24:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cfc3317d-b35b-4131-ba7e-b11aed03a319 req-5b78c29f-bb70-42f7-b93a-03bbc3ee199c service nova] Releasing lock "refresh_cache-7982934b-8c0f-4403-8607-2a2679070e02" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:24:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-022879a0-1dc6-4c22-b5dd-2d932e5d7029 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "7982934b-8c0f-4403-8607-2a2679070e02" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.934s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a req-3027f9ad-71aa-4c71-b806-6ee2b217d82c service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Received event volume-reimaged-0150af0a-0981-4423-8a10-f67ac89c4061 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:24:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a req-3027f9ad-71aa-4c71-b806-6ee2b217d82c service nova] Acquiring lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a req-3027f9ad-71aa-4c71-b806-6ee2b217d82c service nova] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a req-3027f9ad-71aa-4c71-b806-6ee2b217d82c service nova] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a req-3027f9ad-71aa-4c71-b806-6ee2b217d82c service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Processing event volume-reimaged-0150af0a-0981-4423-8a10-f67ac89c4061 {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 29 20:24:18 user nova-compute[75356]: DEBUG nova.compute.manager [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Instance event wait completed in 24 seconds for volume-reimaged {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:24:19 user nova-compute[75356]: INFO nova.virt.block_device [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Booting with volume 0150af0a-0981-4423-8a10-f67ac89c4061 at /dev/vda
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.utils [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c3731c-6494-4344-a05f-ce42d2800632]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7023d4-d4cf-4ccb-9b44-6a03a51a7bb6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[466d77f7-1964-47fd-bce9-84ba0d43e8b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27fe795-ee81-4d20-be7f-060fd5f1d7ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:24:19 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9c9076-4e0d-43b3-8d4a-248571864d59]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.utils [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Updating existing volume attachment record: de26ee11-e424-4c72-b364-c40da2f5dac8 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:24:19 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 0f9149e4-424b-42af-bd25-19d1cc7c0635 is timed out.
Nov 29 20:24:19 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Successfully detached device vdc from instance 0f9149e4-424b-42af-bd25-19d1cc7c0635 from the live domain config.
Nov 29 20:24:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGKEcNge', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:24:19 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e912869-6320-47c9-b628-1d24059aaf36]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:24:19 user nova-compute[75356]: No targets found.
Nov 29 20:24:19 user nova-compute[75356]: iSNS:
Nov 29 20:24:19 user nova-compute[75356]: No targets found.
Nov 29 20:24:19 user nova-compute[75356]: STATIC:
Nov 29 20:24:19 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde
Nov 29 20:24:19 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:24:19 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:24:19 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7
Nov 29 20:24:19 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:24:19 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:24:19 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f
Nov 29 20:24:19 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:24:19 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:24:19 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f
Nov 29 20:24:19 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:24:19 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:24:19 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:24:19 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:24:19 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:24:19 user nova-compute[75356]: FIRMWARE:
Nov 29 20:24:19 user nova-compute[75356]: No targets found.
Nov 29 20:24:19 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:24:19 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:24:19 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[631e18c4-abf1-43e0-9a88-2dd53f4e48d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[576fcdfc-ba29-4931-9e9a-5e37a961dc86]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:24:19 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:24:19 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:24:19 user nova-compute[75356]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)
Nov 29 20:24:19 user nova-compute[75356]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde (non-flash)
Nov 29 20:24:19 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:24:19 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:24:19 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:24:19 user nova-compute[75356]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)
Nov 29 20:24:19 user nova-compute[75356]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde (non-flash)
Nov 29 20:24:19 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e422c700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde'): ({'sdd'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Removing single pathed devices sdd {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[de685eaf-73c0-42e9-a677-57ea357d1753]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0b023c-74c0-478f-b168-76e6684dbd20]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Flushing IO for device /dev/sdd {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1385eae-718b-42bc-8925-82ffc62405c9]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f39d9c-4ae5-4e87-aabc-585fc159770b]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] SCSI volumes sdd have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6833af2d-6543-46d8-8c1c-36f3e8438a5b]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f2d661-d86e-4c54-b6fe-261ff9507975]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde, portal: 172.16.0.220,3260]
Nov 29 20:24:19 user nova-compute[75356]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde, portal: 172.16.0.220,3260] successful.
Nov 29 20:24:19 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2e395e9-752b-4d10-96c0-4143969cebde -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e346c19-9bd8-4ee4-a113-7f2159d098fd]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] <== disconnect_volume: return (353ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:24:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:24:20 user nova-compute[75356]: DEBUG nova.objects.instance [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lazy-loading 'flavor' on Instance uuid 0f9149e4-424b-42af-bd25-19d1cc7c0635 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:24:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b962a715-b7d0-4ddd-a38b-37cc2e4ec423 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.864s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:25 user nova-compute[75356]: DEBUG nova.compute.manager [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:24:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:24:25 user nova-compute[75356]: INFO nova.compute.claims [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Claim successful on node user
Nov 29 20:24:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:25 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:24:25 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG nova.compute.manager [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG nova.compute.manager [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG nova.network.neutron [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:24:26 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:24:26 user nova-compute[75356]: DEBUG nova.compute.manager [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG nova.policy [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00cdfe6527e04f049b5e38685bc1f257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dff0986b1d47fdaf305c87e323d19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "93183110-d2e2-4da7-ab7d-73378f5e0d42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG nova.compute.manager [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG nova.compute.manager [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:24:26 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Creating image(s)
Nov 29 20:24:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "/opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "/opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:24:26 user nova-compute[75356]: INFO nova.compute.claims [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Claim successful on node user
Nov 29 20:24:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.198s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.170s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk 1073741824" returned: 0 in 0.062s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.network.neutron [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Successfully created port: 0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.219s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.765s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.compute.manager [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Cannot resize image /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Ensure instance console log exists: /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.compute.manager [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.network.neutron [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:24:27 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.compute.manager [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.compute.manager [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:24:27 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Creating image(s)
Nov 29 20:24:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "/opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "/opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "/opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.policy [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00cdfe6527e04f049b5e38685bc1f257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dff0986b1d47fdaf305c87e323d19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.203s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:24:27 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Creating image(s)
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Did not create local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Ensure instance console log exists: /opt/stack/data/nova/instances/7d27c88e-5de8-4401-aa9d-d88643b478b9/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Start _get_guest_xml network_info=[{"id": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "address": "fa:16:3e:ba:30:23", "network": {"id": "a667657a-11b6-40b9-a2e8-f50c41d49b34", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355155956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509329256df34ff9b00d01614064ff91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc58621-94", "ovs_interfaceid": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JlIeiaCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7d27c88e-5de8-4401-aa9d-d88643b478b9', 'attached_at': '', 'detached_at': '', 'volume_id': '0150af0a-0981-4423-8a10-f67ac89c4061', 'serial': '0150af0a-0981-4423-8a10-f67ac89c4061'}, 'attachment_id': 'de26ee11-e424-4c72-b364-c40da2f5dac8', 'volume_type': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:24:27 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 20:24:27 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG nova.objects.instance [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7d27c88e-5de8-4401-aa9d-d88643b478b9 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.182s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JlIeiaCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:24:28 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:24:28 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:24:28 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk 1073741824" returned: 0 in 0.088s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5211865d-76d7-490f-bb88-7a5230ba7dc1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:24:28 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7502bd-c1e8-4922-a620-e926a738da9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061] added
Nov 29 20:24:28 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.network.neutron [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Successfully updated port: 0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77ea2de-2daa-42a0-9fde-04c23c3dbf75]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "refresh_cache-4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquired lock "refresh_cache-4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.network.neutron [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[707b59f6-a863-48c8-a5c2-a1fcfe6b173b]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JlIeiaCP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.compute.manager [req-b59243c4-6c3c-41f8-af9f-7b40a0279129 req-1ff0917f-816c-4bb8-84b7-7a337eafe3d7 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received event network-changed-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.compute.manager [req-b59243c4-6c3c-41f8-af9f-7b40a0279129 req-1ff0917f-816c-4bb8-84b7-7a337eafe3d7 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Refreshing instance network info cache due to event network-changed-0a14e591-f6b5-4199-90fe-a7a40182e6c7. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b59243c4-6c3c-41f8-af9f-7b40a0279129 req-1ff0917f-816c-4bb8-84b7-7a337eafe3d7 service nova] Acquiring lock "refresh_cache-4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JlIeiaCP" returned: 0 in 0.040s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d347f9-1f68-41bb-9d19-0233b7ced119]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JlIeiaCP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.191s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[238eb1cd-b387-48d4-8d60-1b078b3dba20]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.network.neutron [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a805e69-161b-4d49-aaca-0d18f12676f0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:24:28 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:24:28 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:24:28 user nova-compute[75356]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)
Nov 29 20:24:28 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:24:28 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:24:28 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:24:28 user nova-compute[75356]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)
Nov 29 20:24:28 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dac2d7-12d8-490d-876f-65d8920ca6cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061, portal: 172.16.0.220,3260]
Nov 29 20:24:28 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061, portal: 172.16.0.220,3260] successful.
Nov 29 20:24:28 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[361cddd5-31fc-4884-8e62-11c615d2facd]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Cannot resize image /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Ensure instance console log exists: /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96eb37a-0905-415b-9e6b-ebb9d5c1c6ce]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:24:28 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:24:28 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:24:28 user nova-compute[75356]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)
Nov 29 20:24:28 user nova-compute[75356]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:24:28 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:24:28 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:24:28 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:24:28 user nova-compute[75356]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)
Nov 29 20:24:28 user nova-compute[75356]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:24:28 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.418s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[edce8cff-ef3d-4f73-9727-2459f942f220]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JlIeiaCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.network.neutron [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Successfully created port: a9883307-4927-4472-932e-b7a9354d5fe8 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.network.neutron [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Updating instance_info_cache with network_info: [{"id": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "address": "fa:16:3e:91:30:da", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a14e591-f6", "ovs_interfaceid": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Releasing lock "refresh_cache-4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.compute.manager [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Instance network_info: |[{"id": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "address": "fa:16:3e:91:30:da", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a14e591-f6", "ovs_interfaceid": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b59243c4-6c3c-41f8-af9f-7b40a0279129 req-1ff0917f-816c-4bb8-84b7-7a337eafe3d7 service nova] Acquired lock "refresh_cache-4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.network.neutron [req-b59243c4-6c3c-41f8-af9f-7b40a0279129 req-1ff0917f-816c-4bb8-84b7-7a337eafe3d7 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Refreshing network info cache for port 0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Start _get_guest_xml network_info=[{"id": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "address": "fa:16:3e:91:30:da", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a14e591-f6", "ovs_interfaceid": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:24:28 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:24:28 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:24:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-524234962',display_name='tempest-ServerRescueNegativeTestJSON-server-524234962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-524234962',id=22,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34dff0986b1d47fdaf305c87e323d19e',ramdisk_id='',reservation_id='r-fdzu3fqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1204717931',owner_user_name='tempest-ServerRescueNegativeTestJSON-1204717931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:24:26Z,user_data=None,user_id='00cdfe6527e04f049b5e38685bc1f257',uuid=4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "address": "fa:16:3e:91:30:da", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a14e591-f6", "ovs_interfaceid": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converting VIF {"id": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "address": "fa:16:3e:91:30:da", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a14e591-f6", "ovs_interfaceid": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:30:da,bridge_name='br-int',has_traffic_filtering=True,id=0a14e591-f6b5-4199-90fe-a7a40182e6c7,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a14e591-f6') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.objects.instance [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:24:28 user nova-compute[75356]:   <uuid>4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1</uuid>
Nov 29 20:24:28 user nova-compute[75356]:   <name>instance-00000016</name>
Nov 29 20:24:28 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:24:28 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:24:28 user nova-compute[75356]:   <metadata>
Nov 29 20:24:28 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:24:28 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:24:28 user nova-compute[75356]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-524234962</nova:name>
Nov 29 20:24:28 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:24:28</nova:creationTime>
Nov 29 20:24:28 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:24:28 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:24:28 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:24:28 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:24:28 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:24:28 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:24:28 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:24:28 user nova-compute[75356]:       <nova:owner>
Nov 29 20:24:28 user nova-compute[75356]:         <nova:user uuid="00cdfe6527e04f049b5e38685bc1f257">tempest-ServerRescueNegativeTestJSON-1204717931-project-member</nova:user>
Nov 29 20:24:28 user nova-compute[75356]:         <nova:project uuid="34dff0986b1d47fdaf305c87e323d19e">tempest-ServerRescueNegativeTestJSON-1204717931</nova:project>
Nov 29 20:24:28 user nova-compute[75356]:       </nova:owner>
Nov 29 20:24:28 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:24:28 user nova-compute[75356]:       <nova:ports>
Nov 29 20:24:28 user nova-compute[75356]:         <nova:port uuid="0a14e591-f6b5-4199-90fe-a7a40182e6c7">
Nov 29 20:24:28 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 20:24:28 user nova-compute[75356]:         </nova:port>
Nov 29 20:24:28 user nova-compute[75356]:       </nova:ports>
Nov 29 20:24:28 user nova-compute[75356]:     </nova:instance>
Nov 29 20:24:28 user nova-compute[75356]:   </metadata>
Nov 29 20:24:28 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:24:28 user nova-compute[75356]:     <system>
Nov 29 20:24:28 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:24:28 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:24:28 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:24:28 user nova-compute[75356]:       <entry name="serial">4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1</entry>
Nov 29 20:24:28 user nova-compute[75356]:       <entry name="uuid">4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1</entry>
Nov 29 20:24:28 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:24:28 user nova-compute[75356]:     </system>
Nov 29 20:24:28 user nova-compute[75356]:   </sysinfo>
Nov 29 20:24:28 user nova-compute[75356]:   <os>
Nov 29 20:24:28 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:24:28 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:24:28 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:24:28 user nova-compute[75356]:   </os>
Nov 29 20:24:28 user nova-compute[75356]:   <features>
Nov 29 20:24:28 user nova-compute[75356]:     <acpi/>
Nov 29 20:24:28 user nova-compute[75356]:     <apic/>
Nov 29 20:24:28 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:24:28 user nova-compute[75356]:   </features>
Nov 29 20:24:28 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:24:28 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:24:28 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:24:28 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:24:28 user nova-compute[75356]:   </clock>
Nov 29 20:24:28 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:24:28 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:24:28 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:24:28 user nova-compute[75356]:   </cpu>
Nov 29 20:24:28 user nova-compute[75356]:   <devices>
Nov 29 20:24:28 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:24:28 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:24:28 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk"/>
Nov 29 20:24:28 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:24:28 user nova-compute[75356]:     </disk>
Nov 29 20:24:28 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:24:28 user nova-compute[75356]:       <mac address="fa:16:3e:91:30:da"/>
Nov 29 20:24:28 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:24:28 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:24:28 user nova-compute[75356]:       <target dev="tap0a14e591-f6"/>
Nov 29 20:24:28 user nova-compute[75356]:     </interface>
Nov 29 20:24:28 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:24:28 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/console.log" append="off"/>
Nov 29 20:24:28 user nova-compute[75356]:     </serial>
Nov 29 20:24:28 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:24:28 user nova-compute[75356]:     <video>
Nov 29 20:24:28 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:24:28 user nova-compute[75356]:     </video>
Nov 29 20:24:28 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:24:28 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:24:28 user nova-compute[75356]:     </rng>
Nov 29 20:24:28 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:24:28 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:24:28 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:24:28 user nova-compute[75356]:     </memballoon>
Nov 29 20:24:28 user nova-compute[75356]:   </devices>
Nov 29 20:24:28 user nova-compute[75356]: </domain>
Nov 29 20:24:28 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:24:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-524234962',display_name='tempest-ServerRescueNegativeTestJSON-server-524234962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-524234962',id=22,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34dff0986b1d47fdaf305c87e323d19e',ramdisk_id='',reservation_id='r-fdzu3fqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1204717931',owner_user_name='tempest-ServerRescueNegativeTestJSON-1204717931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:24:26Z,user_data=None,user_id='00cdfe6527e04f049b5e38685bc1f257',uuid=4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "address": "fa:16:3e:91:30:da", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a14e591-f6", "ovs_interfaceid": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converting VIF {"id": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "address": "fa:16:3e:91:30:da", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a14e591-f6", "ovs_interfaceid": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:30:da,bridge_name='br-int',has_traffic_filtering=True,id=0a14e591-f6b5-4199-90fe-a7a40182e6c7,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a14e591-f6') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG os_vif [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:30:da,bridge_name='br-int',has_traffic_filtering=True,id=0a14e591-f6b5-4199-90fe-a7a40182e6c7,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a14e591-f6') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1fccffde-ce6e-57a8-8f97-6adb6271b040', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a14e591-f6, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a14e591-f6, col_values=(('qos', UUID('95adc919-e67c-406f-92f1-ff35f32efb16')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a14e591-f6, col_values=(('external_ids', {'iface-id': '0a14e591-f6b5-4199-90fe-a7a40182e6c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:30:da', 'vm-uuid': '4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:24:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:29 user nova-compute[75356]: INFO os_vif [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:30:da,bridge_name='br-int',has_traffic_filtering=True,id=0a14e591-f6b5-4199-90fe-a7a40182e6c7,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a14e591-f6')
Nov 29 20:24:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] No VIF found with MAC fa:16:3e:91:30:da, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.458s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] <== connect_volume: return (1461ms) {'type': 'block', 'scsi_wwn': '23538643362316236', 'path': '/dev/sdc'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538643362316236', 'path': '/dev/sdc'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T20:21:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-219107618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1912060011',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp9h0sV8HqQQKrm9wRP86I0faDw7r9ov+BDsQBXkVs0aZuFJR32OVgyV5IeyoX7630/1HeOKAYpIohIRYAB/skYr0un2YHRwxSgPbrAhWys2tztVnD2rtF1IOLaH5rQSg==',key_name='tempest-keypair-416274752',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:22:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='509329256df34ff9b00d01614064ff91',ramdisk_id='',reservation_id='r-vk1q32sk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-829836017',owner_user_name='tempest-ServerActionsV293TestJSON-829836017-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:24:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69e09bd9b3774a6ebe0459412b688216',uuid=7d27c88e-5de8-4401-aa9d-d88643b478b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "address": "fa:16:3e:ba:30:23", "network": {"id": "a667657a-11b6-40b9-a2e8-f50c41d49b34", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355155956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509329256df34ff9b00d01614064ff91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc58621-94", "ovs_interfaceid": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Converting VIF {"id": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "address": "fa:16:3e:ba:30:23", "network": {"id": "a667657a-11b6-40b9-a2e8-f50c41d49b34", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355155956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509329256df34ff9b00d01614064ff91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc58621-94", "ovs_interfaceid": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:30:23,bridge_name='br-int',has_traffic_filtering=True,id=fdc58621-94e8-4c85-bafb-a51ecd40720b,network=Network(a667657a-11b6-40b9-a2e8-f50c41d49b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc58621-94') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:24:29 user nova-compute[75356]:   <uuid>7d27c88e-5de8-4401-aa9d-d88643b478b9</uuid>
Nov 29 20:24:29 user nova-compute[75356]:   <name>instance-00000012</name>
Nov 29 20:24:29 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:24:29 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:24:29 user nova-compute[75356]:   <metadata>
Nov 29 20:24:29 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:24:29 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:24:29 user nova-compute[75356]:       <nova:name>tempest-ServerActionsV293TestJSON-server-219107618</nova:name>
Nov 29 20:24:29 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:24:27</nova:creationTime>
Nov 29 20:24:29 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:24:29 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:24:29 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:24:29 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:24:29 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:24:29 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:24:29 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:24:29 user nova-compute[75356]:       <nova:owner>
Nov 29 20:24:29 user nova-compute[75356]:         <nova:user uuid="69e09bd9b3774a6ebe0459412b688216">tempest-ServerActionsV293TestJSON-829836017-project-member</nova:user>
Nov 29 20:24:29 user nova-compute[75356]:         <nova:project uuid="509329256df34ff9b00d01614064ff91">tempest-ServerActionsV293TestJSON-829836017</nova:project>
Nov 29 20:24:29 user nova-compute[75356]:       </nova:owner>
Nov 29 20:24:29 user nova-compute[75356]:       <nova:ports>
Nov 29 20:24:29 user nova-compute[75356]:         <nova:port uuid="fdc58621-94e8-4c85-bafb-a51ecd40720b">
Nov 29 20:24:29 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 20:24:29 user nova-compute[75356]:         </nova:port>
Nov 29 20:24:29 user nova-compute[75356]:       </nova:ports>
Nov 29 20:24:29 user nova-compute[75356]:     </nova:instance>
Nov 29 20:24:29 user nova-compute[75356]:   </metadata>
Nov 29 20:24:29 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:24:29 user nova-compute[75356]:     <system>
Nov 29 20:24:29 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:24:29 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:24:29 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:24:29 user nova-compute[75356]:       <entry name="serial">7d27c88e-5de8-4401-aa9d-d88643b478b9</entry>
Nov 29 20:24:29 user nova-compute[75356]:       <entry name="uuid">7d27c88e-5de8-4401-aa9d-d88643b478b9</entry>
Nov 29 20:24:29 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:24:29 user nova-compute[75356]:     </system>
Nov 29 20:24:29 user nova-compute[75356]:   </sysinfo>
Nov 29 20:24:29 user nova-compute[75356]:   <os>
Nov 29 20:24:29 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:24:29 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:24:29 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:24:29 user nova-compute[75356]:   </os>
Nov 29 20:24:29 user nova-compute[75356]:   <features>
Nov 29 20:24:29 user nova-compute[75356]:     <acpi/>
Nov 29 20:24:29 user nova-compute[75356]:     <apic/>
Nov 29 20:24:29 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:24:29 user nova-compute[75356]:   </features>
Nov 29 20:24:29 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:24:29 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:24:29 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:24:29 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:24:29 user nova-compute[75356]:   </clock>
Nov 29 20:24:29 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:24:29 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:24:29 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:24:29 user nova-compute[75356]:   </cpu>
Nov 29 20:24:29 user nova-compute[75356]:   <devices>
Nov 29 20:24:29 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:24:29 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:24:29 user nova-compute[75356]:       <source dev="/dev/sdc"/>
Nov 29 20:24:29 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:24:29 user nova-compute[75356]:       <serial>0150af0a-0981-4423-8a10-f67ac89c4061</serial>
Nov 29 20:24:29 user nova-compute[75356]:     </disk>
Nov 29 20:24:29 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:24:29 user nova-compute[75356]:       <mac address="fa:16:3e:ba:30:23"/>
Nov 29 20:24:29 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:24:29 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:24:29 user nova-compute[75356]:       <target dev="tapfdc58621-94"/>
Nov 29 20:24:29 user nova-compute[75356]:     </interface>
Nov 29 20:24:29 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:24:29 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/7d27c88e-5de8-4401-aa9d-d88643b478b9/console.log" append="off"/>
Nov 29 20:24:29 user nova-compute[75356]:     </serial>
Nov 29 20:24:29 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:24:29 user nova-compute[75356]:     <video>
Nov 29 20:24:29 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:24:29 user nova-compute[75356]:     </video>
Nov 29 20:24:29 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:24:29 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:24:29 user nova-compute[75356]:     </rng>
Nov 29 20:24:29 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:24:29 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:24:29 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:24:29 user nova-compute[75356]:     </memballoon>
Nov 29 20:24:29 user nova-compute[75356]:   </devices>
Nov 29 20:24:29 user nova-compute[75356]: </domain>
Nov 29 20:24:29 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T20:21:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-219107618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1912060011',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp9h0sV8HqQQKrm9wRP86I0faDw7r9ov+BDsQBXkVs0aZuFJR32OVgyV5IeyoX7630/1HeOKAYpIohIRYAB/skYr0un2YHRwxSgPbrAhWys2tztVnD2rtF1IOLaH5rQSg==',key_name='tempest-keypair-416274752',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:22:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='509329256df34ff9b00d01614064ff91',ramdisk_id='',reservation_id='r-vk1q32sk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-829836017',owner_user_name='tempest-ServerActionsV293TestJSON-829836017-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:24:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69e09bd9b3774a6ebe0459412b688216',uuid=7d27c88e-5de8-4401-aa9d-d88643b478b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "address": "fa:16:3e:ba:30:23", "network": {"id": "a667657a-11b6-40b9-a2e8-f50c41d49b34", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355155956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509329256df34ff9b00d01614064ff91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc58621-94", "ovs_interfaceid": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Converting VIF {"id": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "address": "fa:16:3e:ba:30:23", "network": {"id": "a667657a-11b6-40b9-a2e8-f50c41d49b34", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355155956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509329256df34ff9b00d01614064ff91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc58621-94", "ovs_interfaceid": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:30:23,bridge_name='br-int',has_traffic_filtering=True,id=fdc58621-94e8-4c85-bafb-a51ecd40720b,network=Network(a667657a-11b6-40b9-a2e8-f50c41d49b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc58621-94') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG os_vif [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:30:23,bridge_name='br-int',has_traffic_filtering=True,id=fdc58621-94e8-4c85-bafb-a51ecd40720b,network=Network(a667657a-11b6-40b9-a2e8-f50c41d49b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc58621-94') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb8f721b-c8a9-5306-85f0-195d04afa395', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG nova.network.neutron [req-b59243c4-6c3c-41f8-af9f-7b40a0279129 req-1ff0917f-816c-4bb8-84b7-7a337eafe3d7 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Updated VIF entry in instance network info cache for port 0a14e591-f6b5-4199-90fe-a7a40182e6c7. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG nova.network.neutron [req-b59243c4-6c3c-41f8-af9f-7b40a0279129 req-1ff0917f-816c-4bb8-84b7-7a337eafe3d7 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Updating instance_info_cache with network_info: [{"id": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "address": "fa:16:3e:91:30:da", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a14e591-f6", "ovs_interfaceid": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b59243c4-6c3c-41f8-af9f-7b40a0279129 req-1ff0917f-816c-4bb8-84b7-7a337eafe3d7 service nova] Releasing lock "refresh_cache-4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfdc58621-94, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfdc58621-94, col_values=(('qos', UUID('b1c4978b-050c-45ba-91ce-b2a383d5c2b7')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfdc58621-94, col_values=(('external_ids', {'iface-id': 'fdc58621-94e8-4c85-bafb-a51ecd40720b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:30:23', 'vm-uuid': '7d27c88e-5de8-4401-aa9d-d88643b478b9'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:29 user nova-compute[75356]: INFO os_vif [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:30:23,bridge_name='br-int',has_traffic_filtering=True,id=fdc58621-94e8-4c85-bafb-a51ecd40720b,network=Network(a667657a-11b6-40b9-a2e8-f50c41d49b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc58621-94')
Nov 29 20:24:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] No VIF found with MAC fa:16:3e:ba:30:23, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG nova.network.neutron [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Successfully updated port: a9883307-4927-4472-932e-b7a9354d5fe8 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "refresh_cache-93183110-d2e2-4da7-ab7d-73378f5e0d42" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquired lock "refresh_cache-93183110-d2e2-4da7-ab7d-73378f5e0d42" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG nova.network.neutron [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:24:29 user nova-compute[75356]: DEBUG nova.network.neutron [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.network.neutron [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Updating instance_info_cache with network_info: [{"id": "a9883307-4927-4472-932e-b7a9354d5fe8", "address": "fa:16:3e:80:43:0b", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9883307-49", "ovs_interfaceid": "a9883307-4927-4472-932e-b7a9354d5fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Releasing lock "refresh_cache-93183110-d2e2-4da7-ab7d-73378f5e0d42" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.compute.manager [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Instance network_info: |[{"id": "a9883307-4927-4472-932e-b7a9354d5fe8", "address": "fa:16:3e:80:43:0b", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9883307-49", "ovs_interfaceid": "a9883307-4927-4472-932e-b7a9354d5fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Start _get_guest_xml network_info=[{"id": "a9883307-4927-4472-932e-b7a9354d5fe8", "address": "fa:16:3e:80:43:0b", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9883307-49", "ovs_interfaceid": "a9883307-4927-4472-932e-b7a9354d5fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:24:30 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:24:30 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:24:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-674467598',display_name='tempest-ServerRescueNegativeTestJSON-server-674467598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-674467598',id=23,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34dff0986b1d47fdaf305c87e323d19e',ramdisk_id='',reservation_id='r-ri9bq1p5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1204717931',owner_user_name='tempest-ServerRescueNegativeTestJSON-1204717931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:24:27Z,user_data=None,user_id='00cdfe6527e04f049b5e38685bc1f257',uuid=93183110-d2e2-4da7-ab7d-73378f5e0d42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9883307-4927-4472-932e-b7a9354d5fe8", "address": "fa:16:3e:80:43:0b", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9883307-49", "ovs_interfaceid": "a9883307-4927-4472-932e-b7a9354d5fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converting VIF {"id": "a9883307-4927-4472-932e-b7a9354d5fe8", "address": "fa:16:3e:80:43:0b", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9883307-49", "ovs_interfaceid": "a9883307-4927-4472-932e-b7a9354d5fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:43:0b,bridge_name='br-int',has_traffic_filtering=True,id=a9883307-4927-4472-932e-b7a9354d5fe8,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9883307-49') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.objects.instance [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'pci_devices' on Instance uuid 93183110-d2e2-4da7-ab7d-73378f5e0d42 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:24:30 user nova-compute[75356]:   <uuid>93183110-d2e2-4da7-ab7d-73378f5e0d42</uuid>
Nov 29 20:24:30 user nova-compute[75356]:   <name>instance-00000017</name>
Nov 29 20:24:30 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:24:30 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:24:30 user nova-compute[75356]:   <metadata>
Nov 29 20:24:30 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:24:30 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:24:30 user nova-compute[75356]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-674467598</nova:name>
Nov 29 20:24:30 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:24:30</nova:creationTime>
Nov 29 20:24:30 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:24:30 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:24:30 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:24:30 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:24:30 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:24:30 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:24:30 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:24:30 user nova-compute[75356]:       <nova:owner>
Nov 29 20:24:30 user nova-compute[75356]:         <nova:user uuid="00cdfe6527e04f049b5e38685bc1f257">tempest-ServerRescueNegativeTestJSON-1204717931-project-member</nova:user>
Nov 29 20:24:30 user nova-compute[75356]:         <nova:project uuid="34dff0986b1d47fdaf305c87e323d19e">tempest-ServerRescueNegativeTestJSON-1204717931</nova:project>
Nov 29 20:24:30 user nova-compute[75356]:       </nova:owner>
Nov 29 20:24:30 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:24:30 user nova-compute[75356]:       <nova:ports>
Nov 29 20:24:30 user nova-compute[75356]:         <nova:port uuid="a9883307-4927-4472-932e-b7a9354d5fe8">
Nov 29 20:24:30 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 20:24:30 user nova-compute[75356]:         </nova:port>
Nov 29 20:24:30 user nova-compute[75356]:       </nova:ports>
Nov 29 20:24:30 user nova-compute[75356]:     </nova:instance>
Nov 29 20:24:30 user nova-compute[75356]:   </metadata>
Nov 29 20:24:30 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:24:30 user nova-compute[75356]:     <system>
Nov 29 20:24:30 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:24:30 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:24:30 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:24:30 user nova-compute[75356]:       <entry name="serial">93183110-d2e2-4da7-ab7d-73378f5e0d42</entry>
Nov 29 20:24:30 user nova-compute[75356]:       <entry name="uuid">93183110-d2e2-4da7-ab7d-73378f5e0d42</entry>
Nov 29 20:24:30 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:24:30 user nova-compute[75356]:     </system>
Nov 29 20:24:30 user nova-compute[75356]:   </sysinfo>
Nov 29 20:24:30 user nova-compute[75356]:   <os>
Nov 29 20:24:30 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:24:30 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:24:30 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:24:30 user nova-compute[75356]:   </os>
Nov 29 20:24:30 user nova-compute[75356]:   <features>
Nov 29 20:24:30 user nova-compute[75356]:     <acpi/>
Nov 29 20:24:30 user nova-compute[75356]:     <apic/>
Nov 29 20:24:30 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:24:30 user nova-compute[75356]:   </features>
Nov 29 20:24:30 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:24:30 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:24:30 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:24:30 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:24:30 user nova-compute[75356]:   </clock>
Nov 29 20:24:30 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:24:30 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:24:30 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:24:30 user nova-compute[75356]:   </cpu>
Nov 29 20:24:30 user nova-compute[75356]:   <devices>
Nov 29 20:24:30 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:24:30 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:24:30 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk"/>
Nov 29 20:24:30 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:24:30 user nova-compute[75356]:     </disk>
Nov 29 20:24:30 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:24:30 user nova-compute[75356]:       <mac address="fa:16:3e:80:43:0b"/>
Nov 29 20:24:30 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:24:30 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:24:30 user nova-compute[75356]:       <target dev="tapa9883307-49"/>
Nov 29 20:24:30 user nova-compute[75356]:     </interface>
Nov 29 20:24:30 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:24:30 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/console.log" append="off"/>
Nov 29 20:24:30 user nova-compute[75356]:     </serial>
Nov 29 20:24:30 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:24:30 user nova-compute[75356]:     <video>
Nov 29 20:24:30 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:24:30 user nova-compute[75356]:     </video>
Nov 29 20:24:30 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:24:30 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:24:30 user nova-compute[75356]:     </rng>
Nov 29 20:24:30 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:24:30 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:24:30 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:24:30 user nova-compute[75356]:     </memballoon>
Nov 29 20:24:30 user nova-compute[75356]:   </devices>
Nov 29 20:24:30 user nova-compute[75356]: </domain>
Nov 29 20:24:30 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:24:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-674467598',display_name='tempest-ServerRescueNegativeTestJSON-server-674467598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-674467598',id=23,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34dff0986b1d47fdaf305c87e323d19e',ramdisk_id='',reservation_id='r-ri9bq1p5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1204717931',owner_user_name='tempest-ServerRescueNegativeTestJSON-1204717931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:24:27Z,user_data=None,user_id='00cdfe6527e04f049b5e38685bc1f257',uuid=93183110-d2e2-4da7-ab7d-73378f5e0d42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9883307-4927-4472-932e-b7a9354d5fe8", "address": "fa:16:3e:80:43:0b", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9883307-49", "ovs_interfaceid": "a9883307-4927-4472-932e-b7a9354d5fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converting VIF {"id": "a9883307-4927-4472-932e-b7a9354d5fe8", "address": "fa:16:3e:80:43:0b", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9883307-49", "ovs_interfaceid": "a9883307-4927-4472-932e-b7a9354d5fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:43:0b,bridge_name='br-int',has_traffic_filtering=True,id=a9883307-4927-4472-932e-b7a9354d5fe8,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9883307-49') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG os_vif [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:43:0b,bridge_name='br-int',has_traffic_filtering=True,id=a9883307-4927-4472-932e-b7a9354d5fe8,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9883307-49') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f58d06d4-fc18-5db6-ac4a-e91c4156413f', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9883307-49, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa9883307-49, col_values=(('qos', UUID('b14c541b-316a-4490-8fdf-b96947cad906')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa9883307-49, col_values=(('external_ids', {'iface-id': 'a9883307-4927-4472-932e-b7a9354d5fe8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:43:0b', 'vm-uuid': '93183110-d2e2-4da7-ab7d-73378f5e0d42'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.compute.manager [req-3afe6e89-e0b3-4a48-a8fa-0f06d0f7c7c1 req-2aa58c48-d05e-4e21-9ce3-ea900cec1213 service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Received event network-changed-a9883307-4927-4472-932e-b7a9354d5fe8 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.compute.manager [req-3afe6e89-e0b3-4a48-a8fa-0f06d0f7c7c1 req-2aa58c48-d05e-4e21-9ce3-ea900cec1213 service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Refreshing instance network info cache due to event network-changed-a9883307-4927-4472-932e-b7a9354d5fe8. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3afe6e89-e0b3-4a48-a8fa-0f06d0f7c7c1 req-2aa58c48-d05e-4e21-9ce3-ea900cec1213 service nova] Acquiring lock "refresh_cache-93183110-d2e2-4da7-ab7d-73378f5e0d42" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3afe6e89-e0b3-4a48-a8fa-0f06d0f7c7c1 req-2aa58c48-d05e-4e21-9ce3-ea900cec1213 service nova] Acquired lock "refresh_cache-93183110-d2e2-4da7-ab7d-73378f5e0d42" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.network.neutron [req-3afe6e89-e0b3-4a48-a8fa-0f06d0f7c7c1 req-2aa58c48-d05e-4e21-9ce3-ea900cec1213 service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Refreshing network info cache for port a9883307-4927-4472-932e-b7a9354d5fe8 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:30 user nova-compute[75356]: INFO os_vif [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:43:0b,bridge_name='br-int',has_traffic_filtering=True,id=a9883307-4927-4472-932e-b7a9354d5fe8,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9883307-49')
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] No VIF found with MAC fa:16:3e:80:43:0b, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.network.neutron [req-3afe6e89-e0b3-4a48-a8fa-0f06d0f7c7c1 req-2aa58c48-d05e-4e21-9ce3-ea900cec1213 service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Updated VIF entry in instance network info cache for port a9883307-4927-4472-932e-b7a9354d5fe8. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG nova.network.neutron [req-3afe6e89-e0b3-4a48-a8fa-0f06d0f7c7c1 req-2aa58c48-d05e-4e21-9ce3-ea900cec1213 service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Updating instance_info_cache with network_info: [{"id": "a9883307-4927-4472-932e-b7a9354d5fe8", "address": "fa:16:3e:80:43:0b", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9883307-49", "ovs_interfaceid": "a9883307-4927-4472-932e-b7a9354d5fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:24:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3afe6e89-e0b3-4a48-a8fa-0f06d0f7c7c1 req-2aa58c48-d05e-4e21-9ce3-ea900cec1213 service nova] Releasing lock "refresh_cache-93183110-d2e2-4da7-ab7d-73378f5e0d42" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:24:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:32 user nova-compute[75356]: DEBUG nova.compute.manager [req-8fa18225-e05a-4dcc-9fa5-a57228d29a8c req-e741ef77-a7ed-4520-a05f-b9d00cbf8ffc service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received event network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:24:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-8fa18225-e05a-4dcc-9fa5-a57228d29a8c req-e741ef77-a7ed-4520-a05f-b9d00cbf8ffc service nova] Acquiring lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-8fa18225-e05a-4dcc-9fa5-a57228d29a8c req-e741ef77-a7ed-4520-a05f-b9d00cbf8ffc service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-8fa18225-e05a-4dcc-9fa5-a57228d29a8c req-e741ef77-a7ed-4520-a05f-b9d00cbf8ffc service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:32 user nova-compute[75356]: DEBUG nova.compute.manager [req-8fa18225-e05a-4dcc-9fa5-a57228d29a8c req-e741ef77-a7ed-4520-a05f-b9d00cbf8ffc service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] No waiting events found dispatching network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:24:32 user nova-compute[75356]: WARNING nova.compute.manager [req-8fa18225-e05a-4dcc-9fa5-a57228d29a8c req-e741ef77-a7ed-4520-a05f-b9d00cbf8ffc service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received unexpected event network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 for instance with vm_state building and task_state spawning.
Nov 29 20:24:32 user nova-compute[75356]: DEBUG nova.compute.manager [req-ba4ab673-3b62-4fbe-8a84-c4c222583a43 req-ef9b9ce5-51e2-41f7-a21a-b39a003b38ed service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Received event network-vif-plugged-a9883307-4927-4472-932e-b7a9354d5fe8 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:24:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ba4ab673-3b62-4fbe-8a84-c4c222583a43 req-ef9b9ce5-51e2-41f7-a21a-b39a003b38ed service nova] Acquiring lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ba4ab673-3b62-4fbe-8a84-c4c222583a43 req-ef9b9ce5-51e2-41f7-a21a-b39a003b38ed service nova] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ba4ab673-3b62-4fbe-8a84-c4c222583a43 req-ef9b9ce5-51e2-41f7-a21a-b39a003b38ed service nova] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:32 user nova-compute[75356]: DEBUG nova.compute.manager [req-ba4ab673-3b62-4fbe-8a84-c4c222583a43 req-ef9b9ce5-51e2-41f7-a21a-b39a003b38ed service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] No waiting events found dispatching network-vif-plugged-a9883307-4927-4472-932e-b7a9354d5fe8 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:24:32 user nova-compute[75356]: WARNING nova.compute.manager [req-ba4ab673-3b62-4fbe-8a84-c4c222583a43 req-ef9b9ce5-51e2-41f7-a21a-b39a003b38ed service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Received unexpected event network-vif-plugged-a9883307-4927-4472-932e-b7a9354d5fe8 for instance with vm_state building and task_state spawning.
Nov 29 20:24:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:34 user nova-compute[75356]: DEBUG nova.compute.manager [req-b82e339c-b1ba-4118-82e2-b6595f9d324b req-f9d0c26d-cdc4-40c1-9d0c-ab94ec4f43e4 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received event network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:24:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b82e339c-b1ba-4118-82e2-b6595f9d324b req-f9d0c26d-cdc4-40c1-9d0c-ab94ec4f43e4 service nova] Acquiring lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b82e339c-b1ba-4118-82e2-b6595f9d324b req-f9d0c26d-cdc4-40c1-9d0c-ab94ec4f43e4 service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b82e339c-b1ba-4118-82e2-b6595f9d324b req-f9d0c26d-cdc4-40c1-9d0c-ab94ec4f43e4 service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:34 user nova-compute[75356]: DEBUG nova.compute.manager [req-b82e339c-b1ba-4118-82e2-b6595f9d324b req-f9d0c26d-cdc4-40c1-9d0c-ab94ec4f43e4 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] No waiting events found dispatching network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:24:34 user nova-compute[75356]: WARNING nova.compute.manager [req-b82e339c-b1ba-4118-82e2-b6595f9d324b req-f9d0c26d-cdc4-40c1-9d0c-ab94ec4f43e4 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received unexpected event network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 for instance with vm_state building and task_state spawning.
Nov 29 20:24:34 user nova-compute[75356]: DEBUG nova.compute.manager [req-c153727e-3c6f-4b83-90c5-25b36957de2e req-5bf40275-6d4d-469c-8ce2-ed6dd562a51c service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Received event network-vif-plugged-a9883307-4927-4472-932e-b7a9354d5fe8 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:24:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c153727e-3c6f-4b83-90c5-25b36957de2e req-5bf40275-6d4d-469c-8ce2-ed6dd562a51c service nova] Acquiring lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c153727e-3c6f-4b83-90c5-25b36957de2e req-5bf40275-6d4d-469c-8ce2-ed6dd562a51c service nova] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c153727e-3c6f-4b83-90c5-25b36957de2e req-5bf40275-6d4d-469c-8ce2-ed6dd562a51c service nova] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:34 user nova-compute[75356]: DEBUG nova.compute.manager [req-c153727e-3c6f-4b83-90c5-25b36957de2e req-5bf40275-6d4d-469c-8ce2-ed6dd562a51c service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] No waiting events found dispatching network-vif-plugged-a9883307-4927-4472-932e-b7a9354d5fe8 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:24:34 user nova-compute[75356]: WARNING nova.compute.manager [req-c153727e-3c6f-4b83-90c5-25b36957de2e req-5bf40275-6d4d-469c-8ce2-ed6dd562a51c service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Received unexpected event network-vif-plugged-a9883307-4927-4472-932e-b7a9354d5fe8 for instance with vm_state building and task_state spawning.
Nov 29 20:24:34 user nova-compute[75356]: DEBUG nova.compute.manager [req-c153727e-3c6f-4b83-90c5-25b36957de2e req-5bf40275-6d4d-469c-8ce2-ed6dd562a51c service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Received event network-vif-plugged-fdc58621-94e8-4c85-bafb-a51ecd40720b {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:24:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c153727e-3c6f-4b83-90c5-25b36957de2e req-5bf40275-6d4d-469c-8ce2-ed6dd562a51c service nova] Acquiring lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c153727e-3c6f-4b83-90c5-25b36957de2e req-5bf40275-6d4d-469c-8ce2-ed6dd562a51c service nova] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c153727e-3c6f-4b83-90c5-25b36957de2e req-5bf40275-6d4d-469c-8ce2-ed6dd562a51c service nova] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:34 user nova-compute[75356]: DEBUG nova.compute.manager [req-c153727e-3c6f-4b83-90c5-25b36957de2e req-5bf40275-6d4d-469c-8ce2-ed6dd562a51c service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] No waiting events found dispatching network-vif-plugged-fdc58621-94e8-4c85-bafb-a51ecd40720b {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:24:34 user nova-compute[75356]: WARNING nova.compute.manager [req-c153727e-3c6f-4b83-90c5-25b36957de2e req-5bf40275-6d4d-469c-8ce2-ed6dd562a51c service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Received unexpected event network-vif-plugged-fdc58621-94e8-4c85-bafb-a51ecd40720b for instance with vm_state active and task_state rebuild_spawning.
Nov 29 20:24:34 user nova-compute[75356]: DEBUG nova.compute.manager [req-c153727e-3c6f-4b83-90c5-25b36957de2e req-5bf40275-6d4d-469c-8ce2-ed6dd562a51c service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Received event network-vif-plugged-fdc58621-94e8-4c85-bafb-a51ecd40720b {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:24:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c153727e-3c6f-4b83-90c5-25b36957de2e req-5bf40275-6d4d-469c-8ce2-ed6dd562a51c service nova] Acquiring lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c153727e-3c6f-4b83-90c5-25b36957de2e req-5bf40275-6d4d-469c-8ce2-ed6dd562a51c service nova] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c153727e-3c6f-4b83-90c5-25b36957de2e req-5bf40275-6d4d-469c-8ce2-ed6dd562a51c service nova] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:34 user nova-compute[75356]: DEBUG nova.compute.manager [req-c153727e-3c6f-4b83-90c5-25b36957de2e req-5bf40275-6d4d-469c-8ce2-ed6dd562a51c service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] No waiting events found dispatching network-vif-plugged-fdc58621-94e8-4c85-bafb-a51ecd40720b {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:24:34 user nova-compute[75356]: WARNING nova.compute.manager [req-c153727e-3c6f-4b83-90c5-25b36957de2e req-5bf40275-6d4d-469c-8ce2-ed6dd562a51c service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Received unexpected event network-vif-plugged-fdc58621-94e8-4c85-bafb-a51ecd40720b for instance with vm_state active and task_state rebuild_spawning.
Nov 29 20:24:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.compute.manager [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.compute.manager [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.compute.manager [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:24:35 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Instance spawned successfully.
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:24:35 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Instance spawned successfully.
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:24:35 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Instance spawned successfully.
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:35 user nova-compute[75356]: INFO nova.compute.manager [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Took 8.45 seconds to spawn the instance on the hypervisor.
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.compute.manager [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:24:35 user nova-compute[75356]: INFO nova.compute.manager [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Took 9.59 seconds to spawn the instance on the hypervisor.
Nov 29 20:24:35 user nova-compute[75356]: DEBUG nova.compute.manager [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:24:36 user nova-compute[75356]: DEBUG nova.compute.manager [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:24:36 user nova-compute[75356]: INFO nova.compute.manager [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Took 9.59 seconds to build instance.
Nov 29 20:24:36 user nova-compute[75356]: INFO nova.compute.manager [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Took 10.66 seconds to build instance.
Nov 29 20:24:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-91eb0f15-fc26-4705-8751-bec915ae42ee tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.771s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84399c10-d5a6-49f6-aab6-417bd8c3695d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.818s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:36 user nova-compute[75356]: DEBUG nova.objects.instance [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75356) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 29 20:24:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-14ce7319-ced7-4011-a74e-9d9b8a50ff2a tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.112s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Acquiring lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:49 user nova-compute[75356]: INFO nova.compute.manager [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Detaching volume cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f
Nov 29 20:24:49 user nova-compute[75356]: INFO nova.virt.block_device [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Attempting to driver detach volume cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f from mountpoint /dev/vdb
Nov 29 20:24:49 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Attempting to detach device vdb from instance 0f9149e4-424b-42af-bd25-19d1cc7c0635 from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:24:49 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:24:49 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:24:49 user nova-compute[75356]:   <source dev="/dev/sdg"/>
Nov 29 20:24:49 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:24:49 user nova-compute[75356]:   <serial>cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f</serial>
Nov 29 20:24:49 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:24:49 user nova-compute[75356]: </disk>
Nov 29 20:24:49 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:24:49 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Successfully detached device vdb from instance 0f9149e4-424b-42af-bd25-19d1cc7c0635 from the persistent domain config.
Nov 29 20:24:49 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0f9149e4-424b-42af-bd25-19d1cc7c0635 from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:24:49 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:24:49 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:24:49 user nova-compute[75356]:   <source dev="/dev/sdg"/>
Nov 29 20:24:49 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:24:49 user nova-compute[75356]:   <serial>cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f</serial>
Nov 29 20:24:49 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:24:49 user nova-compute[75356]: </disk>
Nov 29 20:24:49 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:24:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:50 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0f9149e4-424b-42af-bd25-19d1cc7c0635 {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:24:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:51 user nova-compute[75356]: DEBUG nova.compute.manager [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:24:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:52 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:24:52 user nova-compute[75356]: INFO nova.compute.claims [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Claim successful on node user
Nov 29 20:24:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:52 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:24:52 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:24:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:24:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:24:52 user nova-compute[75356]: DEBUG nova.network.neutron [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:24:52 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:24:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:24:52 user nova-compute[75356]: DEBUG nova.policy [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc9deaf0a28f4afaad9e42ecc448a23d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85535b509efe4dbb81c372f9031faac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:24:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:24:52 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:24:52 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Creating image(s)
Nov 29 20:24:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "/opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "/opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.177s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:53 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:24:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.187s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/disk 1073741824" returned: 0 in 0.053s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:53 user nova-compute[75356]: DEBUG nova.network.neutron [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Successfully created port: cca86ef6-13ce-4177-b51b-266014d38e93 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:24:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.181s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:53 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:24:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:53 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Cannot resize image /opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:24:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:24:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Ensure instance console log exists: /opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:24:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.network.neutron [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Successfully updated port: cca86ef6-13ce-4177-b51b-266014d38e93 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "refresh_cache-6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquired lock "refresh_cache-6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.network.neutron [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.compute.manager [req-15751a9f-d376-4bba-a8c5-4655c199420b req-425f293f-2ba1-4910-a7cc-78e3587dbe06 service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Received event network-changed-cca86ef6-13ce-4177-b51b-266014d38e93 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.compute.manager [req-15751a9f-d376-4bba-a8c5-4655c199420b req-425f293f-2ba1-4910-a7cc-78e3587dbe06 service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Refreshing instance network info cache due to event network-changed-cca86ef6-13ce-4177-b51b-266014d38e93. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-15751a9f-d376-4bba-a8c5-4655c199420b req-425f293f-2ba1-4910-a7cc-78e3587dbe06 service nova] Acquiring lock "refresh_cache-6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.network.neutron [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.network.neutron [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Updating instance_info_cache with network_info: [{"id": "cca86ef6-13ce-4177-b51b-266014d38e93", "address": "fa:16:3e:f9:6e:16", "network": {"id": "c1768664-edc2-4213-80e3-64f7600eeb75", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688549704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85535b509efe4dbb81c372f9031faac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca86ef6-13", "ovs_interfaceid": "cca86ef6-13ce-4177-b51b-266014d38e93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Releasing lock "refresh_cache-6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.compute.manager [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Instance network_info: |[{"id": "cca86ef6-13ce-4177-b51b-266014d38e93", "address": "fa:16:3e:f9:6e:16", "network": {"id": "c1768664-edc2-4213-80e3-64f7600eeb75", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688549704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85535b509efe4dbb81c372f9031faac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca86ef6-13", "ovs_interfaceid": "cca86ef6-13ce-4177-b51b-266014d38e93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-15751a9f-d376-4bba-a8c5-4655c199420b req-425f293f-2ba1-4910-a7cc-78e3587dbe06 service nova] Acquired lock "refresh_cache-6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.network.neutron [req-15751a9f-d376-4bba-a8c5-4655c199420b req-425f293f-2ba1-4910-a7cc-78e3587dbe06 service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Refreshing network info cache for port cca86ef6-13ce-4177-b51b-266014d38e93 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Start _get_guest_xml network_info=[{"id": "cca86ef6-13ce-4177-b51b-266014d38e93", "address": "fa:16:3e:f9:6e:16", "network": {"id": "c1768664-edc2-4213-80e3-64f7600eeb75", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688549704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85535b509efe4dbb81c372f9031faac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca86ef6-13", "ovs_interfaceid": "cca86ef6-13ce-4177-b51b-266014d38e93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:24:54 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:24:54 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:24:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-12870285',display_name='tempest-VolumesSnapshotTestJSON-instance-12870285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-12870285',id=24,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZQFzECYEirqcd8FJq7wBIC0Dpxn5/CZPMCjhovGV3vMRFVOSYpG88QIuVhtcxpdTAOA2MpwkWZIFLAYlykHEASRLhU/OBOiZyhbHXnmrUFx33RzOBHgkJdMc7YICn7xA==',key_name='tempest-keypair-127993307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85535b509efe4dbb81c372f9031faac0',ramdisk_id='',reservation_id='r-xuwi9wn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-740377086',owner_user_name='tempest-VolumesSnapshotTestJSON-740377086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:24:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc9deaf0a28f4afaad9e42ecc448a23d',uuid=6ece3dd0-deb1-43b3-aaa8-bcccc61e712f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cca86ef6-13ce-4177-b51b-266014d38e93", "address": "fa:16:3e:f9:6e:16", "network": {"id": "c1768664-edc2-4213-80e3-64f7600eeb75", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688549704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85535b509efe4dbb81c372f9031faac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca86ef6-13", "ovs_interfaceid": "cca86ef6-13ce-4177-b51b-266014d38e93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Converting VIF {"id": "cca86ef6-13ce-4177-b51b-266014d38e93", "address": "fa:16:3e:f9:6e:16", "network": {"id": "c1768664-edc2-4213-80e3-64f7600eeb75", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688549704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85535b509efe4dbb81c372f9031faac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca86ef6-13", "ovs_interfaceid": "cca86ef6-13ce-4177-b51b-266014d38e93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:6e:16,bridge_name='br-int',has_traffic_filtering=True,id=cca86ef6-13ce-4177-b51b-266014d38e93,network=Network(c1768664-edc2-4213-80e3-64f7600eeb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcca86ef6-13') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.objects.instance [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:24:54 user nova-compute[75356]:   <uuid>6ece3dd0-deb1-43b3-aaa8-bcccc61e712f</uuid>
Nov 29 20:24:54 user nova-compute[75356]:   <name>instance-00000018</name>
Nov 29 20:24:54 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:24:54 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:24:54 user nova-compute[75356]:   <metadata>
Nov 29 20:24:54 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:24:54 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:24:54 user nova-compute[75356]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-12870285</nova:name>
Nov 29 20:24:54 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:24:54</nova:creationTime>
Nov 29 20:24:54 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:24:54 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:24:54 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:24:54 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:24:54 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:24:54 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:24:54 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:24:54 user nova-compute[75356]:       <nova:owner>
Nov 29 20:24:54 user nova-compute[75356]:         <nova:user uuid="dc9deaf0a28f4afaad9e42ecc448a23d">tempest-VolumesSnapshotTestJSON-740377086-project-member</nova:user>
Nov 29 20:24:54 user nova-compute[75356]:         <nova:project uuid="85535b509efe4dbb81c372f9031faac0">tempest-VolumesSnapshotTestJSON-740377086</nova:project>
Nov 29 20:24:54 user nova-compute[75356]:       </nova:owner>
Nov 29 20:24:54 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:24:54 user nova-compute[75356]:       <nova:ports>
Nov 29 20:24:54 user nova-compute[75356]:         <nova:port uuid="cca86ef6-13ce-4177-b51b-266014d38e93">
Nov 29 20:24:54 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 20:24:54 user nova-compute[75356]:         </nova:port>
Nov 29 20:24:54 user nova-compute[75356]:       </nova:ports>
Nov 29 20:24:54 user nova-compute[75356]:     </nova:instance>
Nov 29 20:24:54 user nova-compute[75356]:   </metadata>
Nov 29 20:24:54 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:24:54 user nova-compute[75356]:     <system>
Nov 29 20:24:54 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:24:54 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:24:54 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:24:54 user nova-compute[75356]:       <entry name="serial">6ece3dd0-deb1-43b3-aaa8-bcccc61e712f</entry>
Nov 29 20:24:54 user nova-compute[75356]:       <entry name="uuid">6ece3dd0-deb1-43b3-aaa8-bcccc61e712f</entry>
Nov 29 20:24:54 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:24:54 user nova-compute[75356]:     </system>
Nov 29 20:24:54 user nova-compute[75356]:   </sysinfo>
Nov 29 20:24:54 user nova-compute[75356]:   <os>
Nov 29 20:24:54 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:24:54 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:24:54 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:24:54 user nova-compute[75356]:   </os>
Nov 29 20:24:54 user nova-compute[75356]:   <features>
Nov 29 20:24:54 user nova-compute[75356]:     <acpi/>
Nov 29 20:24:54 user nova-compute[75356]:     <apic/>
Nov 29 20:24:54 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:24:54 user nova-compute[75356]:   </features>
Nov 29 20:24:54 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:24:54 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:24:54 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:24:54 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:24:54 user nova-compute[75356]:   </clock>
Nov 29 20:24:54 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:24:54 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:24:54 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:24:54 user nova-compute[75356]:   </cpu>
Nov 29 20:24:54 user nova-compute[75356]:   <devices>
Nov 29 20:24:54 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:24:54 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:24:54 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/disk"/>
Nov 29 20:24:54 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:24:54 user nova-compute[75356]:     </disk>
Nov 29 20:24:54 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:24:54 user nova-compute[75356]:       <mac address="fa:16:3e:f9:6e:16"/>
Nov 29 20:24:54 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:24:54 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:24:54 user nova-compute[75356]:       <target dev="tapcca86ef6-13"/>
Nov 29 20:24:54 user nova-compute[75356]:     </interface>
Nov 29 20:24:54 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:24:54 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/console.log" append="off"/>
Nov 29 20:24:54 user nova-compute[75356]:     </serial>
Nov 29 20:24:54 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:24:54 user nova-compute[75356]:     <video>
Nov 29 20:24:54 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:24:54 user nova-compute[75356]:     </video>
Nov 29 20:24:54 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:24:54 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:24:54 user nova-compute[75356]:     </rng>
Nov 29 20:24:54 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:24:54 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:24:54 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:24:54 user nova-compute[75356]:     </memballoon>
Nov 29 20:24:54 user nova-compute[75356]:   </devices>
Nov 29 20:24:54 user nova-compute[75356]: </domain>
Nov 29 20:24:54 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:24:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-12870285',display_name='tempest-VolumesSnapshotTestJSON-instance-12870285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-12870285',id=24,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZQFzECYEirqcd8FJq7wBIC0Dpxn5/CZPMCjhovGV3vMRFVOSYpG88QIuVhtcxpdTAOA2MpwkWZIFLAYlykHEASRLhU/OBOiZyhbHXnmrUFx33RzOBHgkJdMc7YICn7xA==',key_name='tempest-keypair-127993307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85535b509efe4dbb81c372f9031faac0',ramdisk_id='',reservation_id='r-xuwi9wn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-740377086',owner_user_name='tempest-VolumesSnapshotTestJSON-740377086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:24:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc9deaf0a28f4afaad9e42ecc448a23d',uuid=6ece3dd0-deb1-43b3-aaa8-bcccc61e712f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cca86ef6-13ce-4177-b51b-266014d38e93", "address": "fa:16:3e:f9:6e:16", "network": {"id": "c1768664-edc2-4213-80e3-64f7600eeb75", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688549704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85535b509efe4dbb81c372f9031faac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca86ef6-13", "ovs_interfaceid": "cca86ef6-13ce-4177-b51b-266014d38e93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Converting VIF {"id": "cca86ef6-13ce-4177-b51b-266014d38e93", "address": "fa:16:3e:f9:6e:16", "network": {"id": "c1768664-edc2-4213-80e3-64f7600eeb75", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688549704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85535b509efe4dbb81c372f9031faac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca86ef6-13", "ovs_interfaceid": "cca86ef6-13ce-4177-b51b-266014d38e93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:6e:16,bridge_name='br-int',has_traffic_filtering=True,id=cca86ef6-13ce-4177-b51b-266014d38e93,network=Network(c1768664-edc2-4213-80e3-64f7600eeb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcca86ef6-13') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG os_vif [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:6e:16,bridge_name='br-int',has_traffic_filtering=True,id=cca86ef6-13ce-4177-b51b-266014d38e93,network=Network(c1768664-edc2-4213-80e3-64f7600eeb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcca86ef6-13') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a2d4a5f7-ad24-539b-994c-7e3102d7b5fb', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcca86ef6-13, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcca86ef6-13, col_values=(('qos', UUID('958f4167-10d3-4583-a031-65f57636b178')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcca86ef6-13, col_values=(('external_ids', {'iface-id': 'cca86ef6-13ce-4177-b51b-266014d38e93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:6e:16', 'vm-uuid': '6ece3dd0-deb1-43b3-aaa8-bcccc61e712f'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:54 user nova-compute[75356]: INFO os_vif [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:6e:16,bridge_name='br-int',has_traffic_filtering=True,id=cca86ef6-13ce-4177-b51b-266014d38e93,network=Network(c1768664-edc2-4213-80e3-64f7600eeb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcca86ef6-13')
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] No VIF found with MAC fa:16:3e:f9:6e:16, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.network.neutron [req-15751a9f-d376-4bba-a8c5-4655c199420b req-425f293f-2ba1-4910-a7cc-78e3587dbe06 service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Updated VIF entry in instance network info cache for port cca86ef6-13ce-4177-b51b-266014d38e93. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG nova.network.neutron [req-15751a9f-d376-4bba-a8c5-4655c199420b req-425f293f-2ba1-4910-a7cc-78e3587dbe06 service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Updating instance_info_cache with network_info: [{"id": "cca86ef6-13ce-4177-b51b-266014d38e93", "address": "fa:16:3e:f9:6e:16", "network": {"id": "c1768664-edc2-4213-80e3-64f7600eeb75", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688549704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85535b509efe4dbb81c372f9031faac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca86ef6-13", "ovs_interfaceid": "cca86ef6-13ce-4177-b51b-266014d38e93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:24:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-15751a9f-d376-4bba-a8c5-4655c199420b req-425f293f-2ba1-4910-a7cc-78e3587dbe06 service nova] Releasing lock "refresh_cache-6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:24:55 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Skipping network cache update for instance because it is Building. {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-9751c435-4d10-46dc-86e7-39d40e8209d3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-9751c435-4d10-46dc-86e7-39d40e8209d3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG nova.objects.instance [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lazy-loading 'info_cache' on Instance uuid 9751c435-4d10-46dc-86e7-39d40e8209d3 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG nova.compute.manager [req-0de96177-e563-4644-9133-62051d965d08 req-63e13b04-18f4-489a-9e07-4786a819b4c8 service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Received event network-vif-plugged-cca86ef6-13ce-4177-b51b-266014d38e93 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0de96177-e563-4644-9133-62051d965d08 req-63e13b04-18f4-489a-9e07-4786a819b4c8 service nova] Acquiring lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0de96177-e563-4644-9133-62051d965d08 req-63e13b04-18f4-489a-9e07-4786a819b4c8 service nova] Lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0de96177-e563-4644-9133-62051d965d08 req-63e13b04-18f4-489a-9e07-4786a819b4c8 service nova] Lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG nova.compute.manager [req-0de96177-e563-4644-9133-62051d965d08 req-63e13b04-18f4-489a-9e07-4786a819b4c8 service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] No waiting events found dispatching network-vif-plugged-cca86ef6-13ce-4177-b51b-266014d38e93 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:24:56 user nova-compute[75356]: WARNING nova.compute.manager [req-0de96177-e563-4644-9133-62051d965d08 req-63e13b04-18f4-489a-9e07-4786a819b4c8 service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Received unexpected event network-vif-plugged-cca86ef6-13ce-4177-b51b-266014d38e93 for instance with vm_state building and task_state spawning.
Nov 29 20:24:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Updating instance_info_cache with network_info: [{"id": "21221e61-952e-4f3b-a212-dbb9cafe061d", "address": "fa:16:3e:c1:72:a4", "network": {"id": "ee89a769-4a94-475b-b835-e49cabad1f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407371162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f191c68eb9041d289e04d64dc71ddb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21221e61-95", "ovs_interfaceid": "21221e61-952e-4f3b-a212-dbb9cafe061d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-9751c435-4d10-46dc-86e7-39d40e8209d3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:56 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:24:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:58 user nova-compute[75356]: DEBUG nova.compute.manager [req-e12b6609-2c6c-4a60-9daf-724b13a45527 req-d3c3e46c-525d-4ce9-9c54-f8ce666d5400 service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Received event network-vif-plugged-cca86ef6-13ce-4177-b51b-266014d38e93 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:24:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e12b6609-2c6c-4a60-9daf-724b13a45527 req-d3c3e46c-525d-4ce9-9c54-f8ce666d5400 service nova] Acquiring lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e12b6609-2c6c-4a60-9daf-724b13a45527 req-d3c3e46c-525d-4ce9-9c54-f8ce666d5400 service nova] Lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e12b6609-2c6c-4a60-9daf-724b13a45527 req-d3c3e46c-525d-4ce9-9c54-f8ce666d5400 service nova] Lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:58 user nova-compute[75356]: DEBUG nova.compute.manager [req-e12b6609-2c6c-4a60-9daf-724b13a45527 req-d3c3e46c-525d-4ce9-9c54-f8ce666d5400 service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] No waiting events found dispatching network-vif-plugged-cca86ef6-13ce-4177-b51b-266014d38e93 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:24:58 user nova-compute[75356]: WARNING nova.compute.manager [req-e12b6609-2c6c-4a60-9daf-724b13a45527 req-d3c3e46c-525d-4ce9-9c54-f8ce666d5400 service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Received unexpected event network-vif-plugged-cca86ef6-13ce-4177-b51b-266014d38e93 for instance with vm_state building and task_state spawning.
Nov 29 20:24:58 user nova-compute[75356]: DEBUG nova.compute.manager [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:24:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:24:58 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Instance spawned successfully.
Nov 29 20:24:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:24:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:24:58 user nova-compute[75356]: INFO nova.compute.manager [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Took 5.58 seconds to spawn the instance on the hypervisor.
Nov 29 20:24:58 user nova-compute[75356]: DEBUG nova.compute.manager [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:24:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:58 user nova-compute[75356]: INFO nova.compute.manager [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Took 6.73 seconds to build instance.
Nov 29 20:24:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-eba55f8b-7760-4ad4-bdab-e8a4d6f12d92 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.184s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:24:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:24:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "cd109bc9-5080-4d0e-ab01-df9072335b55" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "cd109bc9-5080-4d0e-ab01-df9072335b55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:59 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:24:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:24:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:24:59 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:24:59 user nova-compute[75356]: INFO nova.compute.claims [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Claim successful on node user
Nov 29 20:24:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:24:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:24:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:24:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:24:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:24:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:00 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:25:00 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:25:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.712s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:25:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:25:00 user nova-compute[75356]: DEBUG nova.network.neutron [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:25:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:00 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:25:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:25:00 user nova-compute[75356]: DEBUG nova.policy [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e395b4248b794d65915edf2d23bbbeaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed33acdfd5f48b9967d1dd68c261d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:25:00 user nova-compute[75356]: INFO nova.virt.block_device [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Booting with blank volume at /dev/vda
Nov 29 20:25:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:25:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:01 user nova-compute[75356]: DEBUG nova.network.neutron [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Successfully created port: 93c5ab8f-7281-4fb0-94f5-966f42507c4e {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:25:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:02 user nova-compute[75356]: DEBUG nova.network.neutron [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Successfully updated port: 93c5ab8f-7281-4fb0-94f5-966f42507c4e {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:25:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "refresh_cache-cd109bc9-5080-4d0e-ab01-df9072335b55" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:25:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquired lock "refresh_cache-cd109bc9-5080-4d0e-ab01-df9072335b55" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:25:02 user nova-compute[75356]: DEBUG nova.network.neutron [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:25:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-a77073b2-fd67-44b7-90fd-ff72b51836d8 req-16f85db6-db2a-440d-b5b5-2679c2edc75d service nova] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Received event network-changed-93c5ab8f-7281-4fb0-94f5-966f42507c4e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:25:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-a77073b2-fd67-44b7-90fd-ff72b51836d8 req-16f85db6-db2a-440d-b5b5-2679c2edc75d service nova] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Refreshing instance network info cache due to event network-changed-93c5ab8f-7281-4fb0-94f5-966f42507c4e. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:25:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a77073b2-fd67-44b7-90fd-ff72b51836d8 req-16f85db6-db2a-440d-b5b5-2679c2edc75d service nova] Acquiring lock "refresh_cache-cd109bc9-5080-4d0e-ab01-df9072335b55" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:25:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:02 user nova-compute[75356]: DEBUG nova.network.neutron [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:25:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG nova.network.neutron [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Updating instance_info_cache with network_info: [{"id": "93c5ab8f-7281-4fb0-94f5-966f42507c4e", "address": "fa:16:3e:87:ce:05", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c5ab8f-72", "ovs_interfaceid": "93c5ab8f-7281-4fb0-94f5-966f42507c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Releasing lock "refresh_cache-cd109bc9-5080-4d0e-ab01-df9072335b55" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Instance network_info: |[{"id": "93c5ab8f-7281-4fb0-94f5-966f42507c4e", "address": "fa:16:3e:87:ce:05", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c5ab8f-72", "ovs_interfaceid": "93c5ab8f-7281-4fb0-94f5-966f42507c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a77073b2-fd67-44b7-90fd-ff72b51836d8 req-16f85db6-db2a-440d-b5b5-2679c2edc75d service nova] Acquired lock "refresh_cache-cd109bc9-5080-4d0e-ab01-df9072335b55" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG nova.network.neutron [req-a77073b2-fd67-44b7-90fd-ff72b51836d8 req-16f85db6-db2a-440d-b5b5-2679c2edc75d service nova] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Refreshing network info cache for port 93c5ab8f-7281-4fb0-94f5-966f42507c4e {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:03 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:25:03 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:25:03 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=7273MB free_disk=25.12103271484375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 9751c435-4d10-46dc-86e7-39d40e8209d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0b59517a-c467-432a-a73a-d1460c1574e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 36ec2327-b376-49e4-8592-b2a077b79043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 96cbbbdb-e1cc-49da-9a9f-5b83031b235b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0f9149e4-424b-42af-bd25-19d1cc7c0635 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 7d27c88e-5de8-4401-aa9d-d88643b478b9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance db0826f0-5fdc-47a8-ae36-5059844980c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 93183110-d2e2-4da7-ab7d-73378f5e0d42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance cd109bc9-5080-4d0e-ab01-df9072335b55 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG nova.network.neutron [req-a77073b2-fd67-44b7-90fd-ff72b51836d8 req-16f85db6-db2a-440d-b5b5-2679c2edc75d service nova] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Updated VIF entry in instance network info cache for port 93c5ab8f-7281-4fb0-94f5-966f42507c4e. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG nova.network.neutron [req-a77073b2-fd67-44b7-90fd-ff72b51836d8 req-16f85db6-db2a-440d-b5b5-2679c2edc75d service nova] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Updating instance_info_cache with network_info: [{"id": "93c5ab8f-7281-4fb0-94f5-966f42507c4e", "address": "fa:16:3e:87:ce:05", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c5ab8f-72", "ovs_interfaceid": "93c5ab8f-7281-4fb0-94f5-966f42507c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:25:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a77073b2-fd67-44b7-90fd-ff72b51836d8 req-16f85db6-db2a-440d-b5b5-2679c2edc75d service nova] Releasing lock "refresh_cache-cd109bc9-5080-4d0e-ab01-df9072335b55" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:25:04 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:25:04 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:25:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:25:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:05 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:25:05 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:25:05 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:25:05 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:25:05 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:25:06 user nova-compute[75356]: DEBUG os_brick.utils [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:25:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:06 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd43eb75-0d5b-4d36-ba5e-4c8e5e4185d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:06 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f71e18b-62e1-4cfb-b607-b7ad01f8d723]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:06 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5fad57-e5e6-4acd-8d3d-d2503734c37d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:06 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7065fee-ec1d-40dc-8357-0c04103ee923]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:25:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:25:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:25:06 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:25:06 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaa15e9-bea0-40c3-aae7-89bf80f1dd14]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:25:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:25:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:25:06 user nova-compute[75356]: DEBUG os_brick.utils [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:25:06 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Updating existing volume attachment record: a850ac81-f8c3-4dfd-9f31-a80fdcc1b0f0 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:25:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:10 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0f9149e4-424b-42af-bd25-19d1cc7c0635 is timed out.
Nov 29 20:25:10 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Successfully detached device vdb from instance 0f9149e4-424b-42af-bd25-19d1cc7c0635 from the live domain config.
Nov 29 20:25:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoZtKAaF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:25:10 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:25:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71769e7-5921-4c79-9dda-0328430add50]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:25:10 user nova-compute[75356]: No targets found.
Nov 29 20:25:10 user nova-compute[75356]: iSNS:
Nov 29 20:25:10 user nova-compute[75356]: No targets found.
Nov 29 20:25:10 user nova-compute[75356]: STATIC:
Nov 29 20:25:10 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7
Nov 29 20:25:10 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:25:10 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:25:10 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061
Nov 29 20:25:10 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:25:10 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:25:10 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f
Nov 29 20:25:10 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:25:10 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:25:10 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f
Nov 29 20:25:10 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:25:10 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:25:10 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:25:10 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:25:10 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:25:10 user nova-compute[75356]: FIRMWARE:
Nov 29 20:25:10 user nova-compute[75356]: No targets found.
Nov 29 20:25:10 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:25:10 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:25:10 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d34a2f-aba1-4155-b9e9-5c74ff21d73f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f110ea4-6318-41bf-b162-2c599a6c7ebe]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:25:10 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:25:10 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:25:10 user nova-compute[75356]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)
Nov 29 20:25:10 user nova-compute[75356]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:25:10 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:25:10 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:25:10 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:25:10 user nova-compute[75356]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f (non-flash)
Nov 29 20:25:10 user nova-compute[75356]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:25:10 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e454ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f'): ({'sdg'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Removing single pathed devices sdg {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03ac045-9518-4f3e-9032-01abad1a81e4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ff9878-8fff-4914-99e8-61db0d37ad71]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Flushing IO for device /dev/sdg {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e3f6b3-2a54-4fe7-8ed0-c76ca94b74e9]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.059s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d4d57c-c4ed-4b7a-a95f-288615b45d52]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] SCSI volumes sdg have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[710e7886-e2cd-439e-aee7-83492e8c7461]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f89e33-56b8-48c5-ac49-ce283492496f]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f, portal: 172.16.0.220,3260]
Nov 29 20:25:10 user nova-compute[75356]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f, portal: 172.16.0.220,3260] successful.
Nov 29 20:25:10 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf85d05-cb32-4da4-bdb0-3fb38bb1d08f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afc30d7-deae-4570-8db6-0ff02e68584e]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] <== disconnect_volume: return (339ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:25:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:25:11 user nova-compute[75356]: DEBUG nova.objects.instance [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lazy-loading 'flavor' on Instance uuid 0f9149e4-424b-42af-bd25-19d1cc7c0635 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:25:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-07c773b9-fb1d-4e3d-913d-21949055e080 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.958s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.volume.cinder [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Update attachment failed for attachment a850ac81-f8c3-4dfd-9f31-a80fdcc1b0f0. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-89e24080-6a3e-49a7-b10c-ad7d8ebb8d2a) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-89e24080-6a3e-49a7-b10c-ad7d8ebb8d2a)
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-89e24080-6a3e-49a7-b10c-ad7d8ebb8d2a)
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Traceback (most recent call last):
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]     driver_block_device.attach_block_devices(
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]     _log_and_attach(device)
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]     bdm.attach(*attach_args, **attach_kwargs)
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]   File "/opt/stack/nova/nova/virt/block_device.py", line 852, in attach
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]     super(DriverVolBlankBlockDevice, self).attach(
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]     ret_val = method(obj, context, *args, **kwargs)
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]     self._do_attach(context, instance, volume, volume_api,
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]     self._volume_attach(context, volume, connector, instance,
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]     connection_info = volume_api.attachment_update(
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]     res = method(self, ctx, *args, **kwargs)
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]     with excutils.save_and_reraise_exception():
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]     self.force_reraise()
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]     raise self.value
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]     context, '3.44', skip_version_check=True).attachments.update(
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]     return method.func(obj, *args, **kwargs)
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]     resp = self._update('/attachments/%s' % id, body)
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]     return self._cs_request(url, 'PUT', **kwargs)
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]     return self.request(url, method, **kwargs)
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55]     raise exceptions.from_response(resp, body)
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-89e24080-6a3e-49a7-b10c-ad7d8ebb8d2a)
Nov 29 20:25:11 user nova-compute[75356]: ERROR nova.compute.manager [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] 
Nov 29 20:25:11 user nova-compute[75356]: DEBUG nova.compute.claims [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Aborting claim: <nova.compute.claims.Claim object at 0x7f830862b340> {{(pid=75356) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 29 20:25:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:12 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:25:12 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:25:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.473s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:12 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Build of instance cd109bc9-5080-4d0e-ab01-df9072335b55 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-89e24080-6a3e-49a7-b10c-ad7d8ebb8d2a) {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 29 20:25:12 user nova-compute[75356]: DEBUG nova.compute.utils [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Build of instance cd109bc9-5080-4d0e-ab01-df9072335b55 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75356) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 29 20:25:12 user nova-compute[75356]: ERROR nova.compute.manager [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Build of instance cd109bc9-5080-4d0e-ab01-df9072335b55 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-89e24080-6a3e-49a7-b10c-ad7d8ebb8d2a): nova.exception.BuildAbortException: Build of instance cd109bc9-5080-4d0e-ab01-df9072335b55 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-89e24080-6a3e-49a7-b10c-ad7d8ebb8d2a)
Nov 29 20:25:12 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Unplugging VIFs for instance {{(pid=75356) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 29 20:25:12 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1458703332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1458703332',id=25,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bed33acdfd5f48b9967d1dd68c261d78',ramdisk_id='',reservation_id='r-binghi8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2041863686',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:25:00Z,user_data=None,user_id='e395b4248b794d65915edf2d23bbbeaf',uuid=cd109bc9-5080-4d0e-ab01-df9072335b55,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93c5ab8f-7281-4fb0-94f5-966f42507c4e", "address": "fa:16:3e:87:ce:05", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c5ab8f-72", "ovs_interfaceid": "93c5ab8f-7281-4fb0-94f5-966f42507c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:25:12 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Converting VIF {"id": "93c5ab8f-7281-4fb0-94f5-966f42507c4e", "address": "fa:16:3e:87:ce:05", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c5ab8f-72", "ovs_interfaceid": "93c5ab8f-7281-4fb0-94f5-966f42507c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:25:12 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:ce:05,bridge_name='br-int',has_traffic_filtering=True,id=93c5ab8f-7281-4fb0-94f5-966f42507c4e,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c5ab8f-72') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:25:12 user nova-compute[75356]: DEBUG os_vif [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:ce:05,bridge_name='br-int',has_traffic_filtering=True,id=93c5ab8f-7281-4fb0-94f5-966f42507c4e,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c5ab8f-72') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:25:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93c5ab8f-72, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:25:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:25:12 user nova-compute[75356]: INFO os_vif [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:ce:05,bridge_name='br-int',has_traffic_filtering=True,id=93c5ab8f-7281-4fb0-94f5-966f42507c4e,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c5ab8f-72')
Nov 29 20:25:12 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Unplugged VIFs for instance {{(pid=75356) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 29 20:25:12 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:25:12 user nova-compute[75356]: DEBUG nova.network.neutron [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:25:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:13 user nova-compute[75356]: DEBUG nova.network.neutron [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:25:13 user nova-compute[75356]: INFO nova.compute.manager [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Took 0.74 seconds to deallocate network for instance.
Nov 29 20:25:13 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Detaching volume: a36da2f8-3c10-4ec7-8bc0-6838eb844a00 {{(pid=75356) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 29 20:25:13 user nova-compute[75356]: INFO nova.compute.manager [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Detaching volume a36da2f8-3c10-4ec7-8bc0-6838eb844a00
Nov 29 20:25:13 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: cd109bc9-5080-4d0e-ab01-df9072335b55] Skipping driver_detach during remote rebuild. {{(pid=75356) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 29 20:25:13 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Deleted allocations for instance cd109bc9-5080-4d0e-ab01-df9072335b55
Nov 29 20:25:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fc6f3052-2eed-4c1b-a1df-bde321204e31 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "cd109bc9-5080-4d0e-ab01-df9072335b55" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.039s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "4327336c-e3a9-4b8d-abc2-6438487b2296" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "4327336c-e3a9-4b8d-abc2-6438487b2296" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:26 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:25:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:26 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:25:26 user nova-compute[75356]: INFO nova.compute.claims [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Claim successful on node user
Nov 29 20:25:26 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:25:26 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:25:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:26 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:25:27 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:25:27 user nova-compute[75356]: DEBUG nova.network.neutron [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:25:27 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:25:27 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:25:27 user nova-compute[75356]: DEBUG nova.policy [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '081b00360a204be3bd6435807283f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6791b0c999846e2a22d5735f91ea1aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:25:27 user nova-compute[75356]: INFO nova.virt.block_device [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Booting with volume snapshot 555f02b4-27aa-4184-8ace-78fbd8c2e141 at /dev/vda
Nov 29 20:25:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:27 user nova-compute[75356]: DEBUG nova.network.neutron [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Successfully created port: 88462d48-a60f-4fc6-95f4-7c7f4c52bda1 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:25:28 user nova-compute[75356]: DEBUG nova.network.neutron [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Successfully updated port: 88462d48-a60f-4fc6-95f4-7c7f4c52bda1 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:25:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "refresh_cache-4327336c-e3a9-4b8d-abc2-6438487b2296" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:25:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquired lock "refresh_cache-4327336c-e3a9-4b8d-abc2-6438487b2296" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:25:28 user nova-compute[75356]: DEBUG nova.network.neutron [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:25:28 user nova-compute[75356]: DEBUG nova.compute.manager [req-4f2cfadd-4140-452a-b1a7-d9c10a9a720f req-600d4eed-adf2-4b27-8b9f-10fb5793ab73 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Received event network-changed-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:25:28 user nova-compute[75356]: DEBUG nova.compute.manager [req-4f2cfadd-4140-452a-b1a7-d9c10a9a720f req-600d4eed-adf2-4b27-8b9f-10fb5793ab73 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Refreshing instance network info cache due to event network-changed-88462d48-a60f-4fc6-95f4-7c7f4c52bda1. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:25:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4f2cfadd-4140-452a-b1a7-d9c10a9a720f req-600d4eed-adf2-4b27-8b9f-10fb5793ab73 service nova] Acquiring lock "refresh_cache-4327336c-e3a9-4b8d-abc2-6438487b2296" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:25:28 user nova-compute[75356]: DEBUG nova.network.neutron [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:25:28 user nova-compute[75356]: DEBUG nova.network.neutron [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Updating instance_info_cache with network_info: [{"id": "88462d48-a60f-4fc6-95f4-7c7f4c52bda1", "address": "fa:16:3e:b9:ff:5b", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88462d48-a6", "ovs_interfaceid": "88462d48-a60f-4fc6-95f4-7c7f4c52bda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:25:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Releasing lock "refresh_cache-4327336c-e3a9-4b8d-abc2-6438487b2296" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:25:29 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Instance network_info: |[{"id": "88462d48-a60f-4fc6-95f4-7c7f4c52bda1", "address": "fa:16:3e:b9:ff:5b", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88462d48-a6", "ovs_interfaceid": "88462d48-a60f-4fc6-95f4-7c7f4c52bda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:25:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4f2cfadd-4140-452a-b1a7-d9c10a9a720f req-600d4eed-adf2-4b27-8b9f-10fb5793ab73 service nova] Acquired lock "refresh_cache-4327336c-e3a9-4b8d-abc2-6438487b2296" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:25:29 user nova-compute[75356]: DEBUG nova.network.neutron [req-4f2cfadd-4140-452a-b1a7-d9c10a9a720f req-600d4eed-adf2-4b27-8b9f-10fb5793ab73 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Refreshing network info cache for port 88462d48-a60f-4fc6-95f4-7c7f4c52bda1 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:25:29 user nova-compute[75356]: DEBUG nova.network.neutron [req-4f2cfadd-4140-452a-b1a7-d9c10a9a720f req-600d4eed-adf2-4b27-8b9f-10fb5793ab73 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Updated VIF entry in instance network info cache for port 88462d48-a60f-4fc6-95f4-7c7f4c52bda1. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:25:29 user nova-compute[75356]: DEBUG nova.network.neutron [req-4f2cfadd-4140-452a-b1a7-d9c10a9a720f req-600d4eed-adf2-4b27-8b9f-10fb5793ab73 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Updating instance_info_cache with network_info: [{"id": "88462d48-a60f-4fc6-95f4-7c7f4c52bda1", "address": "fa:16:3e:b9:ff:5b", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88462d48-a6", "ovs_interfaceid": "88462d48-a60f-4fc6-95f4-7c7f4c52bda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:25:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4f2cfadd-4140-452a-b1a7-d9c10a9a720f req-600d4eed-adf2-4b27-8b9f-10fb5793ab73 service nova] Releasing lock "refresh_cache-4327336c-e3a9-4b8d-abc2-6438487b2296" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:25:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:32 user nova-compute[75356]: DEBUG os_brick.utils [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:25:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a70f810-3d28-4ab7-94d0-4f8fae51dadc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1e9f86-add3-4fa6-a1fc-5e31e94071fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9320804-bc0d-460f-b1c7-f7ab68465776]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0301b5-db6b-460c-b3a7-047f1cfa94ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:25:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:25:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:25:32 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:25:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d249b7-a102-48ce-96da-ba8aeb5732ba]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:25:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:25:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:25:32 user nova-compute[75356]: DEBUG os_brick.utils [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:25:32 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Updating existing volume attachment record: ec8abd9f-e002-4f2d-ab99-fdfb4192f675 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:25:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:25:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:25:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:25:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:25:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:25:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Acquiring lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Acquiring lock "0f9149e4-424b-42af-bd25-19d1cc7c0635-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:40 user nova-compute[75356]: INFO nova.compute.manager [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Terminating instance
Nov 29 20:25:40 user nova-compute[75356]: DEBUG nova.compute.manager [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG nova.compute.manager [req-cf43c0ed-1e90-45b6-8359-e69f4d5d2597 req-cf3db67c-c88d-4983-bc17-8cb99f28072a service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Received event network-vif-unplugged-dbd23e2b-e6d6-4942-9b2f-3db29d312a85 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cf43c0ed-1e90-45b6-8359-e69f4d5d2597 req-cf3db67c-c88d-4983-bc17-8cb99f28072a service nova] Acquiring lock "0f9149e4-424b-42af-bd25-19d1cc7c0635-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cf43c0ed-1e90-45b6-8359-e69f4d5d2597 req-cf3db67c-c88d-4983-bc17-8cb99f28072a service nova] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cf43c0ed-1e90-45b6-8359-e69f4d5d2597 req-cf3db67c-c88d-4983-bc17-8cb99f28072a service nova] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG nova.compute.manager [req-cf43c0ed-1e90-45b6-8359-e69f4d5d2597 req-cf3db67c-c88d-4983-bc17-8cb99f28072a service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] No waiting events found dispatching network-vif-unplugged-dbd23e2b-e6d6-4942-9b2f-3db29d312a85 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG nova.compute.manager [req-cf43c0ed-1e90-45b6-8359-e69f4d5d2597 req-cf3db67c-c88d-4983-bc17-8cb99f28072a service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Received event network-vif-unplugged-dbd23e2b-e6d6-4942-9b2f-3db29d312a85 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:25:40 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Instance destroyed successfully.
Nov 29 20:25:40 user nova-compute[75356]: DEBUG nova.objects.instance [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lazy-loading 'resources' on Instance uuid 0f9149e4-424b-42af-bd25-19d1cc7c0635 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:21:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-600507886',display_name='tempest-TestServerVolumeAttachmentScenario-server-600507886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-600507886',id=17,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFik+39RHiSL4lnSnsypkiiHCrlSUI6mwr3P2XGwxhEHae7mM8huI4DCIE8l+KE2H2ACBN/6+3P8B4lavm4NM1fjoh+DjffdY20pBmZ8644UeFbrp+JLCcMQuRIqSmp75Q==',key_name='tempest-keypair-1397786442',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:21:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca028c7723a1409e84ee22bbb14c3bc1',ramdisk_id='',reservation_id='r-hfhp9ux6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1320914633',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1320914633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61fe161c9d75442d9a189a35f78048f8',uuid=0f9149e4-424b-42af-bd25-19d1cc7c0635,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbd23e2b-e6d6-4942-9b2f-3db29d312a85", "address": "fa:16:3e:b4:21:8a", "network": {"id": "19745e07-fd6f-4ae7-8f23-3000120764e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1773897841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca028c7723a1409e84ee22bbb14c3bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd23e2b-e6", "ovs_interfaceid": "dbd23e2b-e6d6-4942-9b2f-3db29d312a85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Converting VIF {"id": "dbd23e2b-e6d6-4942-9b2f-3db29d312a85", "address": "fa:16:3e:b4:21:8a", "network": {"id": "19745e07-fd6f-4ae7-8f23-3000120764e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1773897841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca028c7723a1409e84ee22bbb14c3bc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd23e2b-e6", "ovs_interfaceid": "dbd23e2b-e6d6-4942-9b2f-3db29d312a85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:21:8a,bridge_name='br-int',has_traffic_filtering=True,id=dbd23e2b-e6d6-4942-9b2f-3db29d312a85,network=Network(19745e07-fd6f-4ae7-8f23-3000120764e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd23e2b-e6') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG os_vif [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:21:8a,bridge_name='br-int',has_traffic_filtering=True,id=dbd23e2b-e6d6-4942-9b2f-3db29d312a85,network=Network(19745e07-fd6f-4ae7-8f23-3000120764e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd23e2b-e6') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbd23e2b-e6, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da9e8ff7-94f4-47ca-ae7b-e069731c2e02) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:40 user nova-compute[75356]: INFO os_vif [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:21:8a,bridge_name='br-int',has_traffic_filtering=True,id=dbd23e2b-e6d6-4942-9b2f-3db29d312a85,network=Network(19745e07-fd6f-4ae7-8f23-3000120764e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd23e2b-e6')
Nov 29 20:25:40 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Deleting instance files /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635_del
Nov 29 20:25:40 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Deletion of /opt/stack/data/nova/instances/0f9149e4-424b-42af-bd25-19d1cc7c0635_del complete
Nov 29 20:25:40 user nova-compute[75356]: INFO nova.compute.manager [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 29 20:25:40 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:25:40 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Creating image(s)
Nov 29 20:25:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Did not create local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Ensure instance console log exists: /opt/stack/data/nova/instances/4327336c-e3a9-4b8d-abc2-6438487b2296/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Start _get_guest_xml network_info=[{"id": "88462d48-a60f-4fc6-95f4-7c7f4c52bda1", "address": "fa:16:3e:b9:ff:5b", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88462d48-a6", "ovs_interfaceid": "88462d48-a60f-4fc6-95f4-7c7f4c52bda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gIJSELvu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4327336c-e3a9-4b8d-abc2-6438487b2296', 'attached_at': '', 'detached_at': '', 'volume_id': '7e5b50cb-41fb-4c10-90dd-6c54f1fcef29', 'serial': '7e5b50cb-41fb-4c10-90dd-6c54f1fcef29'}, 'attachment_id': 'ec8abd9f-e002-4f2d-ab99-fdfb4192f675', 'volume_type': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:25:40 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:25:40 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gIJSELvu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:25:41 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:25:41 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:25:41 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Acquiring lock "7d27c88e-5de8-4401-aa9d-d88643b478b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Acquiring lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79ea166-90d4-412c-ad4b-ee85fad3417a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:25:41 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:25:41 user nova-compute[75356]: INFO nova.compute.manager [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Terminating instance
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c986506-b56f-408d-8f53-279fb24d85b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29] added
Nov 29 20:25:41 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[be52de20-19fe-4842-8faf-ee75cfda3fac]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5e5b5b-d81a-4ec7-b152-bcfd0b39c610]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gIJSELvu {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gIJSELvu" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc424b3-1dc9-45ad-85db-ec9a41a6b289]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gIJSELvu'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[712af003-790f-414b-b50f-e93ebc2b8990]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b229e81-2ac3-4726-925d-9ee3fa88e64e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:25:41 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:25:41 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:25:41 user nova-compute[75356]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:25:41 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:25:41 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:25:41 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:25:41 user nova-compute[75356]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:25:41 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e07b46-87ec-4232-acba-99723743a41d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29, portal: 172.16.0.220,3260]
Nov 29 20:25:41 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29, portal: 172.16.0.220,3260] successful.
Nov 29 20:25:41 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e831b27d-a802-4e25-89ec-0f389f5be930]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a404c66-7267-447d-a282-467d4afdb442]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:25:41 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:25:41 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:25:41 user nova-compute[75356]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:25:41 user nova-compute[75356]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)
Nov 29 20:25:41 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:25:41 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:25:41 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:25:41 user nova-compute[75356]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:25:41 user nova-compute[75356]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)
Nov 29 20:25:41 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[791b2590-59b9-4343-a927-34eb9f1833a7]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gIJSELvu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.compute.manager [req-9e3179ec-c200-41c2-9824-83913f830c32 req-6acc1eb6-f74f-41c0-a590-8bfccf8b2269 service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Received event network-vif-unplugged-fdc58621-94e8-4c85-bafb-a51ecd40720b {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9e3179ec-c200-41c2-9824-83913f830c32 req-6acc1eb6-f74f-41c0-a590-8bfccf8b2269 service nova] Acquiring lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9e3179ec-c200-41c2-9824-83913f830c32 req-6acc1eb6-f74f-41c0-a590-8bfccf8b2269 service nova] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9e3179ec-c200-41c2-9824-83913f830c32 req-6acc1eb6-f74f-41c0-a590-8bfccf8b2269 service nova] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.compute.manager [req-9e3179ec-c200-41c2-9824-83913f830c32 req-6acc1eb6-f74f-41c0-a590-8bfccf8b2269 service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] No waiting events found dispatching network-vif-unplugged-fdc58621-94e8-4c85-bafb-a51ecd40720b {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.compute.manager [req-9e3179ec-c200-41c2-9824-83913f830c32 req-6acc1eb6-f74f-41c0-a590-8bfccf8b2269 service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Received event network-vif-unplugged-fdc58621-94e8-4c85-bafb-a51ecd40720b for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:25:41 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Took 0.74 seconds to deallocate network for instance.
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.compute.manager [req-6187be25-a0e2-460c-9b1d-14ba9ea7c854 req-690130fb-14e8-4bf3-81c1-5d59dfb6132d service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Received event network-vif-deleted-dbd23e2b-e6d6-4942-9b2f-3db29d312a85 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:25:41 user nova-compute[75356]: INFO nova.compute.manager [req-6187be25-a0e2-460c-9b1d-14ba9ea7c854 req-690130fb-14e8-4bf3-81c1-5d59dfb6132d service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Neutron deleted interface dbd23e2b-e6d6-4942-9b2f-3db29d312a85; detaching it from the instance and deleting it from the info cache
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.network.neutron [req-6187be25-a0e2-460c-9b1d-14ba9ea7c854 req-690130fb-14e8-4bf3-81c1-5d59dfb6132d service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.compute.manager [req-6187be25-a0e2-460c-9b1d-14ba9ea7c854 req-690130fb-14e8-4bf3-81c1-5d59dfb6132d service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Detach interface failed, port_id=dbd23e2b-e6d6-4942-9b2f-3db29d312a85, reason: Instance 0f9149e4-424b-42af-bd25-19d1cc7c0635 could not be found. {{(pid=75356) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:41 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Instance destroyed successfully.
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.objects.instance [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lazy-loading 'resources' on Instance uuid 7d27c88e-5de8-4401-aa9d-d88643b478b9 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T20:21:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-219107618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1912060011',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp9h0sV8HqQQKrm9wRP86I0faDw7r9ov+BDsQBXkVs0aZuFJR32OVgyV5IeyoX7630/1HeOKAYpIohIRYAB/skYr0un2YHRwxSgPbrAhWys2tztVnD2rtF1IOLaH5rQSg==',key_name='tempest-keypair-416274752',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:24:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='509329256df34ff9b00d01614064ff91',ramdisk_id='',reservation_id='r-vk1q32sk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-829836017',owner_user_name='tempest-ServerActionsV293TestJSON-829836017-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:24:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69e09bd9b3774a6ebe0459412b688216',uuid=7d27c88e-5de8-4401-aa9d-d88643b478b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "address": "fa:16:3e:ba:30:23", "network": {"id": "a667657a-11b6-40b9-a2e8-f50c41d49b34", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355155956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509329256df34ff9b00d01614064ff91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc58621-94", "ovs_interfaceid": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Converting VIF {"id": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "address": "fa:16:3e:ba:30:23", "network": {"id": "a667657a-11b6-40b9-a2e8-f50c41d49b34", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355155956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509329256df34ff9b00d01614064ff91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc58621-94", "ovs_interfaceid": "fdc58621-94e8-4c85-bafb-a51ecd40720b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:30:23,bridge_name='br-int',has_traffic_filtering=True,id=fdc58621-94e8-4c85-bafb-a51ecd40720b,network=Network(a667657a-11b6-40b9-a2e8-f50c41d49b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc58621-94') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_vif [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:30:23,bridge_name='br-int',has_traffic_filtering=True,id=fdc58621-94e8-4c85-bafb-a51ecd40720b,network=Network(a667657a-11b6-40b9-a2e8-f50c41d49b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc58621-94') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfdc58621-94, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1c4978b-050c-45ba-91ce-b2a383d5c2b7) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:41 user nova-compute[75356]: INFO os_vif [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:30:23,bridge_name='br-int',has_traffic_filtering=True,id=fdc58621-94e8-4c85-bafb-a51ecd40720b,network=Network(a667657a-11b6-40b9-a2e8-f50c41d49b34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc58621-94')
Nov 29 20:25:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JlIeiaCP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:25:41 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:25:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:42 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Deleted allocations for instance 0f9149e4-424b-42af-bd25-19d1cc7c0635
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-281a1f19-85e7-4fec-b7fc-c72cc7492251 tempest-TestServerVolumeAttachmentScenario-1320914633 tempest-TestServerVolumeAttachmentScenario-1320914633-project-member] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.293s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26234393836356531', 'path': '/dev/sdd'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234393836356531', 'path': '/dev/sdd'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.532s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:25:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-66871523',display_name='tempest-TestVolumeBootPattern-server-66871523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-66871523',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6791b0c999846e2a22d5735f91ea1aa',ramdisk_id='',reservation_id='r-gap3vlnq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1627976633',owner_user_name='tempest-TestVolumeBootPattern-1627976633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:25:27Z,user_data=None,user_id='081b00360a204be3bd6435807283f230',uuid=4327336c-e3a9-4b8d-abc2-6438487b2296,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88462d48-a60f-4fc6-95f4-7c7f4c52bda1", "address": "fa:16:3e:b9:ff:5b", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88462d48-a6", "ovs_interfaceid": "88462d48-a60f-4fc6-95f4-7c7f4c52bda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converting VIF {"id": "88462d48-a60f-4fc6-95f4-7c7f4c52bda1", "address": "fa:16:3e:b9:ff:5b", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88462d48-a6", "ovs_interfaceid": "88462d48-a60f-4fc6-95f4-7c7f4c52bda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ff:5b,bridge_name='br-int',has_traffic_filtering=True,id=88462d48-a60f-4fc6-95f4-7c7f4c52bda1,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88462d48-a6') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG nova.objects.instance [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lazy-loading 'pci_devices' on Instance uuid 4327336c-e3a9-4b8d-abc2-6438487b2296 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df3ab64-a95a-41b6-b5a1-e988cc2fd821]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:25:42 user nova-compute[75356]: No targets found.
Nov 29 20:25:42 user nova-compute[75356]: iSNS:
Nov 29 20:25:42 user nova-compute[75356]: No targets found.
Nov 29 20:25:42 user nova-compute[75356]: STATIC:
Nov 29 20:25:42 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29
Nov 29 20:25:42 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:25:42 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:25:42 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7
Nov 29 20:25:42 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:25:42 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:25:42 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061
Nov 29 20:25:42 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:25:42 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:25:42 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f
Nov 29 20:25:42 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:25:42 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:25:42 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:25:42 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:25:42 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:25:42 user nova-compute[75356]: FIRMWARE:
Nov 29 20:25:42 user nova-compute[75356]: No targets found.
Nov 29 20:25:42 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:25:42 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:25:42 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:25:42 user nova-compute[75356]:   <uuid>4327336c-e3a9-4b8d-abc2-6438487b2296</uuid>
Nov 29 20:25:42 user nova-compute[75356]:   <name>instance-0000001a</name>
Nov 29 20:25:42 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:25:42 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:25:42 user nova-compute[75356]:   <metadata>
Nov 29 20:25:42 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:25:42 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:25:42 user nova-compute[75356]:       <nova:name>tempest-TestVolumeBootPattern-server-66871523</nova:name>
Nov 29 20:25:42 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:25:40</nova:creationTime>
Nov 29 20:25:42 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:25:42 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:25:42 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:25:42 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:25:42 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:25:42 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:25:42 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:25:42 user nova-compute[75356]:       <nova:owner>
Nov 29 20:25:42 user nova-compute[75356]:         <nova:user uuid="081b00360a204be3bd6435807283f230">tempest-TestVolumeBootPattern-1627976633-project-member</nova:user>
Nov 29 20:25:42 user nova-compute[75356]:         <nova:project uuid="f6791b0c999846e2a22d5735f91ea1aa">tempest-TestVolumeBootPattern-1627976633</nova:project>
Nov 29 20:25:42 user nova-compute[75356]:       </nova:owner>
Nov 29 20:25:42 user nova-compute[75356]:       <nova:ports>
Nov 29 20:25:42 user nova-compute[75356]:         <nova:port uuid="88462d48-a60f-4fc6-95f4-7c7f4c52bda1">
Nov 29 20:25:42 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 20:25:42 user nova-compute[75356]:         </nova:port>
Nov 29 20:25:42 user nova-compute[75356]:       </nova:ports>
Nov 29 20:25:42 user nova-compute[75356]:     </nova:instance>
Nov 29 20:25:42 user nova-compute[75356]:   </metadata>
Nov 29 20:25:42 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:25:42 user nova-compute[75356]:     <system>
Nov 29 20:25:42 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:25:42 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:25:42 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:25:42 user nova-compute[75356]:       <entry name="serial">4327336c-e3a9-4b8d-abc2-6438487b2296</entry>
Nov 29 20:25:42 user nova-compute[75356]:       <entry name="uuid">4327336c-e3a9-4b8d-abc2-6438487b2296</entry>
Nov 29 20:25:42 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:25:42 user nova-compute[75356]:     </system>
Nov 29 20:25:42 user nova-compute[75356]:   </sysinfo>
Nov 29 20:25:42 user nova-compute[75356]:   <os>
Nov 29 20:25:42 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:25:42 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:25:42 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:25:42 user nova-compute[75356]:   </os>
Nov 29 20:25:42 user nova-compute[75356]:   <features>
Nov 29 20:25:42 user nova-compute[75356]:     <acpi/>
Nov 29 20:25:42 user nova-compute[75356]:     <apic/>
Nov 29 20:25:42 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:25:42 user nova-compute[75356]:   </features>
Nov 29 20:25:42 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:25:42 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:25:42 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:25:42 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:25:42 user nova-compute[75356]:   </clock>
Nov 29 20:25:42 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:25:42 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:25:42 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:25:42 user nova-compute[75356]:   </cpu>
Nov 29 20:25:42 user nova-compute[75356]:   <devices>
Nov 29 20:25:42 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:25:42 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:25:42 user nova-compute[75356]:       <source dev="/dev/sdd"/>
Nov 29 20:25:42 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:25:42 user nova-compute[75356]:       <serial>7e5b50cb-41fb-4c10-90dd-6c54f1fcef29</serial>
Nov 29 20:25:42 user nova-compute[75356]:     </disk>
Nov 29 20:25:42 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:25:42 user nova-compute[75356]:       <mac address="fa:16:3e:b9:ff:5b"/>
Nov 29 20:25:42 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:25:42 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:25:42 user nova-compute[75356]:       <target dev="tap88462d48-a6"/>
Nov 29 20:25:42 user nova-compute[75356]:     </interface>
Nov 29 20:25:42 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:25:42 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/4327336c-e3a9-4b8d-abc2-6438487b2296/console.log" append="off"/>
Nov 29 20:25:42 user nova-compute[75356]:     </serial>
Nov 29 20:25:42 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:25:42 user nova-compute[75356]:     <video>
Nov 29 20:25:42 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:25:42 user nova-compute[75356]:     </video>
Nov 29 20:25:42 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:25:42 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:25:42 user nova-compute[75356]:     </rng>
Nov 29 20:25:42 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:25:42 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:25:42 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:25:42 user nova-compute[75356]:     </memballoon>
Nov 29 20:25:42 user nova-compute[75356]:   </devices>
Nov 29 20:25:42 user nova-compute[75356]: </domain>
Nov 29 20:25:42 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:25:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-66871523',display_name='tempest-TestVolumeBootPattern-server-66871523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-66871523',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6791b0c999846e2a22d5735f91ea1aa',ramdisk_id='',reservation_id='r-gap3vlnq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1627976633',owner_user_name='tempest-TestVolumeBootPattern-1627976633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:25:27Z,user_data=None,user_id='081b00360a204be3bd6435807283f230',uuid=4327336c-e3a9-4b8d-abc2-6438487b2296,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88462d48-a60f-4fc6-95f4-7c7f4c52bda1", "address": "fa:16:3e:b9:ff:5b", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88462d48-a6", "ovs_interfaceid": "88462d48-a60f-4fc6-95f4-7c7f4c52bda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converting VIF {"id": "88462d48-a60f-4fc6-95f4-7c7f4c52bda1", "address": "fa:16:3e:b9:ff:5b", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88462d48-a6", "ovs_interfaceid": "88462d48-a60f-4fc6-95f4-7c7f4c52bda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ff:5b,bridge_name='br-int',has_traffic_filtering=True,id=88462d48-a60f-4fc6-95f4-7c7f4c52bda1,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88462d48-a6') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG os_vif [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ff:5b,bridge_name='br-int',has_traffic_filtering=True,id=88462d48-a60f-4fc6-95f4-7c7f4c52bda1,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88462d48-a6') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60c0ad2c-e19e-59e0-9456-f9b5c8d73bb4', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e20932-af55-4571-b4e2-ca2ebaed39a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88462d48-a6, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88462d48-a6, col_values=(('qos', UUID('bdab9c6f-b448-413f-9174-e85a6724b316')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88462d48-a6, col_values=(('external_ids', {'iface-id': '88462d48-a60f-4fc6-95f4-7c7f4c52bda1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:ff:5b', 'vm-uuid': '4327336c-e3a9-4b8d-abc2-6438487b2296'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:42 user nova-compute[75356]: INFO os_vif [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ff:5b,bridge_name='br-int',has_traffic_filtering=True,id=88462d48-a60f-4fc6-95f4-7c7f4c52bda1,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88462d48-a6')
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbbda66-9190-4816-9831-518895175092]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:25:42 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:25:42 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:25:42 user nova-compute[75356]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:25:42 user nova-compute[75356]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)
Nov 29 20:25:42 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:25:42 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:25:42 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:25:42 user nova-compute[75356]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 (non-flash)
Nov 29 20:25:42 user nova-compute[75356]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)
Nov 29 20:25:42 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e4349090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061'): ({'sdc'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Removing single pathed devices sdc {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5608d5f0-50a9-4ab8-978b-ad58b845bd62]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[68060377-e7c2-4ab1-ba72-e11eadb67efc]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Flushing IO for device /dev/sdc {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac54194-4ed0-4569-a3e9-d3e5ed744e9e]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.087s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[95019e29-a031-4e9b-8b62-000fe601ccc4]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG nova.compute.manager [req-ce1b9032-7184-4cfe-8297-533136b489d4 req-f74b6572-f40d-486e-b245-c0f4d96b4510 service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Received event network-vif-plugged-dbd23e2b-e6d6-4942-9b2f-3db29d312a85 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ce1b9032-7184-4cfe-8297-533136b489d4 req-f74b6572-f40d-486e-b245-c0f4d96b4510 service nova] Acquiring lock "0f9149e4-424b-42af-bd25-19d1cc7c0635-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ce1b9032-7184-4cfe-8297-533136b489d4 req-f74b6572-f40d-486e-b245-c0f4d96b4510 service nova] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ce1b9032-7184-4cfe-8297-533136b489d4 req-f74b6572-f40d-486e-b245-c0f4d96b4510 service nova] Lock "0f9149e4-424b-42af-bd25-19d1cc7c0635-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG nova.compute.manager [req-ce1b9032-7184-4cfe-8297-533136b489d4 req-f74b6572-f40d-486e-b245-c0f4d96b4510 service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] No waiting events found dispatching network-vif-plugged-dbd23e2b-e6d6-4942-9b2f-3db29d312a85 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:25:42 user nova-compute[75356]: WARNING nova.compute.manager [req-ce1b9032-7184-4cfe-8297-533136b489d4 req-f74b6572-f40d-486e-b245-c0f4d96b4510 service nova] [instance: 0f9149e4-424b-42af-bd25-19d1cc7c0635] Received unexpected event network-vif-plugged-dbd23e2b-e6d6-4942-9b2f-3db29d312a85 for instance with vm_state deleted and task_state None.
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] No VIF found with MAC fa:16:3e:b9:ff:5b, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cb2d07-4ee3-4be0-9097-41119009dc42]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb55a482-3fdb-4732-a66c-979c75ffa37f]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061, portal: 172.16.0.220,3260]
Nov 29 20:25:42 user nova-compute[75356]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061, portal: 172.16.0.220,3260] successful.
Nov 29 20:25:42 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0150af0a-0981-4423-8a10-f67ac89c4061 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bae13f-efcd-4d9a-8d8c-55ea0d3adaf4]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] <== disconnect_volume: return (895ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:25:42 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Deleting instance files /opt/stack/data/nova/instances/7d27c88e-5de8-4401-aa9d-d88643b478b9_del
Nov 29 20:25:42 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Deletion of /opt/stack/data/nova/instances/7d27c88e-5de8-4401-aa9d-d88643b478b9_del complete
Nov 29 20:25:42 user nova-compute[75356]: INFO nova.compute.manager [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Took 1.76 seconds to destroy the instance on the hypervisor.
Nov 29 20:25:42 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:25:42 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:25:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-b302fd47-8b6b-4fb1-b60d-c0ae52fe3193 req-b706a6f5-151e-42b4-9baf-ceed63d98432 service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Received event network-vif-plugged-fdc58621-94e8-4c85-bafb-a51ecd40720b {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:25:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b302fd47-8b6b-4fb1-b60d-c0ae52fe3193 req-b706a6f5-151e-42b4-9baf-ceed63d98432 service nova] Acquiring lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b302fd47-8b6b-4fb1-b60d-c0ae52fe3193 req-b706a6f5-151e-42b4-9baf-ceed63d98432 service nova] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b302fd47-8b6b-4fb1-b60d-c0ae52fe3193 req-b706a6f5-151e-42b4-9baf-ceed63d98432 service nova] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-b302fd47-8b6b-4fb1-b60d-c0ae52fe3193 req-b706a6f5-151e-42b4-9baf-ceed63d98432 service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] No waiting events found dispatching network-vif-plugged-fdc58621-94e8-4c85-bafb-a51ecd40720b {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:25:43 user nova-compute[75356]: WARNING nova.compute.manager [req-b302fd47-8b6b-4fb1-b60d-c0ae52fe3193 req-b706a6f5-151e-42b4-9baf-ceed63d98432 service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Received unexpected event network-vif-plugged-fdc58621-94e8-4c85-bafb-a51ecd40720b for instance with vm_state active and task_state deleting.
Nov 29 20:25:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:43 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:25:43 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Took 1.08 seconds to deallocate network for instance.
Nov 29 20:25:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-be4a0939-450f-40a1-b273-0b2c4968f921 req-2ba72bd6-ff05-4431-b27c-0209228d31f1 service nova] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Received event network-vif-deleted-fdc58621-94e8-4c85-bafb-a51ecd40720b {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:25:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:44 user nova-compute[75356]: INFO nova.compute.manager [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Took 0.96 seconds to detach 1 volumes for instance.
Nov 29 20:25:44 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] [instance: 7d27c88e-5de8-4401-aa9d-d88643b478b9] Deleting volume: 0150af0a-0981-4423-8a10-f67ac89c4061 {{(pid=75356) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 20:25:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:45 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:25:45 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:25:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:45 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Deleted allocations for instance 7d27c88e-5de8-4401-aa9d-d88643b478b9
Nov 29 20:25:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5c623633-368c-4fca-a276-af5de5b4db82 tempest-ServerActionsV293TestJSON-829836017 tempest-ServerActionsV293TestJSON-829836017-project-member] Lock "7d27c88e-5de8-4401-aa9d-d88643b478b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.392s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:45 user nova-compute[75356]: DEBUG nova.compute.manager [req-1c397349-33a7-4b07-b04f-b3f0cd823f3f req-fb3081eb-26a3-4508-b1c9-3fbde9f6b1f5 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Received event network-vif-plugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:25:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1c397349-33a7-4b07-b04f-b3f0cd823f3f req-fb3081eb-26a3-4508-b1c9-3fbde9f6b1f5 service nova] Acquiring lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1c397349-33a7-4b07-b04f-b3f0cd823f3f req-fb3081eb-26a3-4508-b1c9-3fbde9f6b1f5 service nova] Lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1c397349-33a7-4b07-b04f-b3f0cd823f3f req-fb3081eb-26a3-4508-b1c9-3fbde9f6b1f5 service nova] Lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:45 user nova-compute[75356]: DEBUG nova.compute.manager [req-1c397349-33a7-4b07-b04f-b3f0cd823f3f req-fb3081eb-26a3-4508-b1c9-3fbde9f6b1f5 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] No waiting events found dispatching network-vif-plugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:25:45 user nova-compute[75356]: WARNING nova.compute.manager [req-1c397349-33a7-4b07-b04f-b3f0cd823f3f req-fb3081eb-26a3-4508-b1c9-3fbde9f6b1f5 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Received unexpected event network-vif-plugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 for instance with vm_state building and task_state spawning.
Nov 29 20:25:45 user nova-compute[75356]: DEBUG nova.compute.manager [req-1c397349-33a7-4b07-b04f-b3f0cd823f3f req-fb3081eb-26a3-4508-b1c9-3fbde9f6b1f5 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Received event network-vif-plugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:25:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1c397349-33a7-4b07-b04f-b3f0cd823f3f req-fb3081eb-26a3-4508-b1c9-3fbde9f6b1f5 service nova] Acquiring lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1c397349-33a7-4b07-b04f-b3f0cd823f3f req-fb3081eb-26a3-4508-b1c9-3fbde9f6b1f5 service nova] Lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1c397349-33a7-4b07-b04f-b3f0cd823f3f req-fb3081eb-26a3-4508-b1c9-3fbde9f6b1f5 service nova] Lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:45 user nova-compute[75356]: DEBUG nova.compute.manager [req-1c397349-33a7-4b07-b04f-b3f0cd823f3f req-fb3081eb-26a3-4508-b1c9-3fbde9f6b1f5 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] No waiting events found dispatching network-vif-plugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:25:45 user nova-compute[75356]: WARNING nova.compute.manager [req-1c397349-33a7-4b07-b04f-b3f0cd823f3f req-fb3081eb-26a3-4508-b1c9-3fbde9f6b1f5 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Received unexpected event network-vif-plugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 for instance with vm_state building and task_state spawning.
Nov 29 20:25:46 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:25:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:25:46 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Instance spawned successfully.
Nov 29 20:25:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:25:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:25:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:25:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:25:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:25:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:25:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:25:46 user nova-compute[75356]: INFO nova.compute.manager [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 29 20:25:46 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:25:46 user nova-compute[75356]: INFO nova.compute.manager [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Took 19.95 seconds to build instance.
Nov 29 20:25:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fceb5d8f-132b-4ebe-8aa2-638cf1b98b50 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "4327336c-e3a9-4b8d-abc2-6438487b2296" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.061s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "36ec2327-b376-49e4-8592-b2a077b79043" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "36ec2327-b376-49e4-8592-b2a077b79043" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:48 user nova-compute[75356]: INFO nova.compute.manager [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Detaching volume c894c707-c3c7-4972-8a6d-d54fdc63f13f
Nov 29 20:25:48 user nova-compute[75356]: INFO nova.virt.block_device [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Attempting to driver detach volume c894c707-c3c7-4972-8a6d-d54fdc63f13f from mountpoint /dev/vdb
Nov 29 20:25:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Attempting to detach device vdb from instance 36ec2327-b376-49e4-8592-b2a077b79043 from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:25:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:25:48 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:25:48 user nova-compute[75356]:   <source dev="/dev/sde"/>
Nov 29 20:25:48 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:25:48 user nova-compute[75356]:   <serial>c894c707-c3c7-4972-8a6d-d54fdc63f13f</serial>
Nov 29 20:25:48 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 20:25:48 user nova-compute[75356]: </disk>
Nov 29 20:25:48 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:25:48 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Successfully detached device vdb from instance 36ec2327-b376-49e4-8592-b2a077b79043 from the persistent domain config.
Nov 29 20:25:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 36ec2327-b376-49e4-8592-b2a077b79043 from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:25:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:25:48 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:25:48 user nova-compute[75356]:   <source dev="/dev/sde"/>
Nov 29 20:25:48 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:25:48 user nova-compute[75356]:   <serial>c894c707-c3c7-4972-8a6d-d54fdc63f13f</serial>
Nov 29 20:25:48 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 20:25:48 user nova-compute[75356]: </disk>
Nov 29 20:25:48 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:25:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 36ec2327-b376-49e4-8592-b2a077b79043 {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:25:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Acquiring lock "9751c435-4d10-46dc-86e7-39d40e8209d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "9751c435-4d10-46dc-86e7-39d40e8209d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Acquiring lock "9751c435-4d10-46dc-86e7-39d40e8209d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "9751c435-4d10-46dc-86e7-39d40e8209d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "9751c435-4d10-46dc-86e7-39d40e8209d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:50 user nova-compute[75356]: INFO nova.compute.manager [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Terminating instance
Nov 29 20:25:50 user nova-compute[75356]: DEBUG nova.compute.manager [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:25:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG nova.compute.manager [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:25:51 user nova-compute[75356]: INFO nova.compute.claims [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Claim successful on node user
Nov 29 20:25:51 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Instance destroyed successfully.
Nov 29 20:25:51 user nova-compute[75356]: DEBUG nova.objects.instance [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lazy-loading 'resources' on Instance uuid 9751c435-4d10-46dc-86e7-39d40e8209d3 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-554016873',display_name='tempest-ServersNegativeTestJSON-server-554016873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-554016873',id=2,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:17:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f191c68eb9041d289e04d64dc71ddb8',ramdisk_id='',reservation_id='r-shjuj9zn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-851047228',owner_user_name='tempest-ServersNegativeTestJSON-851047228-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:17:15Z,user_data=None,user_id='9e7fb9cda998444b912de256b9efa7e8',uuid=9751c435-4d10-46dc-86e7-39d40e8209d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21221e61-952e-4f3b-a212-dbb9cafe061d", "address": "fa:16:3e:c1:72:a4", "network": {"id": "ee89a769-4a94-475b-b835-e49cabad1f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407371162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f191c68eb9041d289e04d64dc71ddb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21221e61-95", "ovs_interfaceid": "21221e61-952e-4f3b-a212-dbb9cafe061d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Converting VIF {"id": "21221e61-952e-4f3b-a212-dbb9cafe061d", "address": "fa:16:3e:c1:72:a4", "network": {"id": "ee89a769-4a94-475b-b835-e49cabad1f93", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1407371162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f191c68eb9041d289e04d64dc71ddb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21221e61-95", "ovs_interfaceid": "21221e61-952e-4f3b-a212-dbb9cafe061d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:72:a4,bridge_name='br-int',has_traffic_filtering=True,id=21221e61-952e-4f3b-a212-dbb9cafe061d,network=Network(ee89a769-4a94-475b-b835-e49cabad1f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21221e61-95') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG os_vif [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:72:a4,bridge_name='br-int',has_traffic_filtering=True,id=21221e61-952e-4f3b-a212-dbb9cafe061d,network=Network(ee89a769-4a94-475b-b835-e49cabad1f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21221e61-95') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21221e61-95, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=236c2265-4d01-4bdb-b72b-0498251e89e3) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:51 user nova-compute[75356]: INFO os_vif [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:72:a4,bridge_name='br-int',has_traffic_filtering=True,id=21221e61-952e-4f3b-a212-dbb9cafe061d,network=Network(ee89a769-4a94-475b-b835-e49cabad1f93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21221e61-95')
Nov 29 20:25:51 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Deleting instance files /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3_del
Nov 29 20:25:51 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Deletion of /opt/stack/data/nova/instances/9751c435-4d10-46dc-86e7-39d40e8209d3_del complete
Nov 29 20:25:51 user nova-compute[75356]: INFO nova.compute.manager [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 29 20:25:51 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG nova.compute.manager [req-953e33ad-41b0-432c-ad8e-85aa08f02e80 req-07a781c0-8047-4be6-8333-a550c177b237 service nova] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Received event network-vif-unplugged-21221e61-952e-4f3b-a212-dbb9cafe061d {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-953e33ad-41b0-432c-ad8e-85aa08f02e80 req-07a781c0-8047-4be6-8333-a550c177b237 service nova] Acquiring lock "9751c435-4d10-46dc-86e7-39d40e8209d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-953e33ad-41b0-432c-ad8e-85aa08f02e80 req-07a781c0-8047-4be6-8333-a550c177b237 service nova] Lock "9751c435-4d10-46dc-86e7-39d40e8209d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-953e33ad-41b0-432c-ad8e-85aa08f02e80 req-07a781c0-8047-4be6-8333-a550c177b237 service nova] Lock "9751c435-4d10-46dc-86e7-39d40e8209d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG nova.compute.manager [req-953e33ad-41b0-432c-ad8e-85aa08f02e80 req-07a781c0-8047-4be6-8333-a550c177b237 service nova] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] No waiting events found dispatching network-vif-unplugged-21221e61-952e-4f3b-a212-dbb9cafe061d {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG nova.compute.manager [req-953e33ad-41b0-432c-ad8e-85aa08f02e80 req-07a781c0-8047-4be6-8333-a550c177b237 service nova] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Received event network-vif-unplugged-21221e61-952e-4f3b-a212-dbb9cafe061d for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG nova.compute.manager [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG nova.compute.manager [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:25:51 user nova-compute[75356]: DEBUG nova.network.neutron [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:25:51 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:25:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:25:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:25:52 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:25:52 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Creating image(s)
Nov 29 20:25:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "/opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "/opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "/opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.250s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:52 user nova-compute[75356]: DEBUG nova.policy [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e395b4248b794d65915edf2d23bbbeaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed33acdfd5f48b9967d1dd68c261d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:25:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.196s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk 1073741824" returned: 0 in 0.068s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.197s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:52 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:25:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:52 user nova-compute[75356]: DEBUG nova.compute.manager [req-379aa2d6-a1f1-4092-834e-e5ef2f190cf6 req-5339806d-b272-4ba9-8a5e-96e746c5de3b service nova] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Received event network-vif-deleted-21221e61-952e-4f3b-a212-dbb9cafe061d {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:25:52 user nova-compute[75356]: INFO nova.compute.manager [req-379aa2d6-a1f1-4092-834e-e5ef2f190cf6 req-5339806d-b272-4ba9-8a5e-96e746c5de3b service nova] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Neutron deleted interface 21221e61-952e-4f3b-a212-dbb9cafe061d; detaching it from the instance and deleting it from the info cache
Nov 29 20:25:52 user nova-compute[75356]: DEBUG nova.network.neutron [req-379aa2d6-a1f1-4092-834e-e5ef2f190cf6 req-5339806d-b272-4ba9-8a5e-96e746c5de3b service nova] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:25:52 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:25:53 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Took 1.34 seconds to deallocate network for instance.
Nov 29 20:25:53 user nova-compute[75356]: DEBUG nova.compute.manager [req-379aa2d6-a1f1-4092-834e-e5ef2f190cf6 req-5339806d-b272-4ba9-8a5e-96e746c5de3b service nova] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Detach interface failed, port_id=21221e61-952e-4f3b-a212-dbb9cafe061d, reason: Instance 9751c435-4d10-46dc-86e7-39d40e8209d3 could not be found. {{(pid=75356) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 20:25:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:53 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Cannot resize image /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:25:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:25:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Ensure instance console log exists: /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:25:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:53 user nova-compute[75356]: DEBUG nova.network.neutron [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Successfully created port: d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:25:53 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:25:53 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:25:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:53 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Deleted allocations for instance 9751c435-4d10-46dc-86e7-39d40e8209d3
Nov 29 20:25:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-49c24314-757f-40ac-8f13-4a80836dd63f tempest-ServersNegativeTestJSON-851047228 tempest-ServersNegativeTestJSON-851047228-project-member] Lock "9751c435-4d10-46dc-86e7-39d40e8209d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.726s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:53 user nova-compute[75356]: DEBUG nova.compute.manager [req-c250813a-4f03-411b-bc46-41e106a966be req-3ccbbdd7-89b4-44a8-a948-ef5e64cefc9c service nova] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Received event network-vif-plugged-21221e61-952e-4f3b-a212-dbb9cafe061d {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:25:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c250813a-4f03-411b-bc46-41e106a966be req-3ccbbdd7-89b4-44a8-a948-ef5e64cefc9c service nova] Acquiring lock "9751c435-4d10-46dc-86e7-39d40e8209d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c250813a-4f03-411b-bc46-41e106a966be req-3ccbbdd7-89b4-44a8-a948-ef5e64cefc9c service nova] Lock "9751c435-4d10-46dc-86e7-39d40e8209d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c250813a-4f03-411b-bc46-41e106a966be req-3ccbbdd7-89b4-44a8-a948-ef5e64cefc9c service nova] Lock "9751c435-4d10-46dc-86e7-39d40e8209d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:53 user nova-compute[75356]: DEBUG nova.compute.manager [req-c250813a-4f03-411b-bc46-41e106a966be req-3ccbbdd7-89b4-44a8-a948-ef5e64cefc9c service nova] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] No waiting events found dispatching network-vif-plugged-21221e61-952e-4f3b-a212-dbb9cafe061d {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:25:53 user nova-compute[75356]: WARNING nova.compute.manager [req-c250813a-4f03-411b-bc46-41e106a966be req-3ccbbdd7-89b4-44a8-a948-ef5e64cefc9c service nova] [instance: 9751c435-4d10-46dc-86e7-39d40e8209d3] Received unexpected event network-vif-plugged-21221e61-952e-4f3b-a212-dbb9cafe061d for instance with vm_state deleted and task_state None.
Nov 29 20:25:53 user nova-compute[75356]: DEBUG nova.network.neutron [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Successfully updated port: d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:25:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "refresh_cache-ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:25:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquired lock "refresh_cache-ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:25:53 user nova-compute[75356]: DEBUG nova.network.neutron [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:25:53 user nova-compute[75356]: DEBUG nova.network.neutron [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.network.neutron [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Updating instance_info_cache with network_info: [{"id": "d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4", "address": "fa:16:3e:96:21:98", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6fd1ef4-2d", "ovs_interfaceid": "d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Releasing lock "refresh_cache-ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.compute.manager [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Instance network_info: |[{"id": "d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4", "address": "fa:16:3e:96:21:98", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6fd1ef4-2d", "ovs_interfaceid": "d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Start _get_guest_xml network_info=[{"id": "d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4", "address": "fa:16:3e:96:21:98", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6fd1ef4-2d", "ovs_interfaceid": "d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:25:54 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:25:54 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:25:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1940095636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1940095636',id=27,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bed33acdfd5f48b9967d1dd68c261d78',ramdisk_id='',reservation_id='r-pzkhzskg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2041863686',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:25:52Z,user_data=None,user_id='e395b4248b794d65915edf2d23bbbeaf',uuid=ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4", "address": "fa:16:3e:96:21:98", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6fd1ef4-2d", "ovs_interfaceid": "d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Converting VIF {"id": "d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4", "address": "fa:16:3e:96:21:98", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6fd1ef4-2d", "ovs_interfaceid": "d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:21:98,bridge_name='br-int',has_traffic_filtering=True,id=d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6fd1ef4-2d') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.objects.instance [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lazy-loading 'pci_devices' on Instance uuid ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:25:54 user nova-compute[75356]:   <uuid>ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9</uuid>
Nov 29 20:25:54 user nova-compute[75356]:   <name>instance-0000001b</name>
Nov 29 20:25:54 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:25:54 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:25:54 user nova-compute[75356]:   <metadata>
Nov 29 20:25:54 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:25:54 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:25:54 user nova-compute[75356]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1940095636</nova:name>
Nov 29 20:25:54 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:25:54</nova:creationTime>
Nov 29 20:25:54 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:25:54 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:25:54 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:25:54 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:25:54 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:25:54 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:25:54 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:25:54 user nova-compute[75356]:       <nova:owner>
Nov 29 20:25:54 user nova-compute[75356]:         <nova:user uuid="e395b4248b794d65915edf2d23bbbeaf">tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member</nova:user>
Nov 29 20:25:54 user nova-compute[75356]:         <nova:project uuid="bed33acdfd5f48b9967d1dd68c261d78">tempest-ServerBootFromVolumeStableRescueTest-2041863686</nova:project>
Nov 29 20:25:54 user nova-compute[75356]:       </nova:owner>
Nov 29 20:25:54 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:25:54 user nova-compute[75356]:       <nova:ports>
Nov 29 20:25:54 user nova-compute[75356]:         <nova:port uuid="d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4">
Nov 29 20:25:54 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 20:25:54 user nova-compute[75356]:         </nova:port>
Nov 29 20:25:54 user nova-compute[75356]:       </nova:ports>
Nov 29 20:25:54 user nova-compute[75356]:     </nova:instance>
Nov 29 20:25:54 user nova-compute[75356]:   </metadata>
Nov 29 20:25:54 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:25:54 user nova-compute[75356]:     <system>
Nov 29 20:25:54 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:25:54 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:25:54 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:25:54 user nova-compute[75356]:       <entry name="serial">ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9</entry>
Nov 29 20:25:54 user nova-compute[75356]:       <entry name="uuid">ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9</entry>
Nov 29 20:25:54 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:25:54 user nova-compute[75356]:     </system>
Nov 29 20:25:54 user nova-compute[75356]:   </sysinfo>
Nov 29 20:25:54 user nova-compute[75356]:   <os>
Nov 29 20:25:54 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:25:54 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:25:54 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:25:54 user nova-compute[75356]:   </os>
Nov 29 20:25:54 user nova-compute[75356]:   <features>
Nov 29 20:25:54 user nova-compute[75356]:     <acpi/>
Nov 29 20:25:54 user nova-compute[75356]:     <apic/>
Nov 29 20:25:54 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:25:54 user nova-compute[75356]:   </features>
Nov 29 20:25:54 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:25:54 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:25:54 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:25:54 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:25:54 user nova-compute[75356]:   </clock>
Nov 29 20:25:54 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:25:54 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:25:54 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:25:54 user nova-compute[75356]:   </cpu>
Nov 29 20:25:54 user nova-compute[75356]:   <devices>
Nov 29 20:25:54 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:25:54 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:25:54 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk"/>
Nov 29 20:25:54 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:25:54 user nova-compute[75356]:     </disk>
Nov 29 20:25:54 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:25:54 user nova-compute[75356]:       <mac address="fa:16:3e:96:21:98"/>
Nov 29 20:25:54 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:25:54 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:25:54 user nova-compute[75356]:       <target dev="tapd6fd1ef4-2d"/>
Nov 29 20:25:54 user nova-compute[75356]:     </interface>
Nov 29 20:25:54 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:25:54 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/console.log" append="off"/>
Nov 29 20:25:54 user nova-compute[75356]:     </serial>
Nov 29 20:25:54 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:25:54 user nova-compute[75356]:     <video>
Nov 29 20:25:54 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:25:54 user nova-compute[75356]:     </video>
Nov 29 20:25:54 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:25:54 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:25:54 user nova-compute[75356]:     </rng>
Nov 29 20:25:54 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:25:54 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:25:54 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:25:54 user nova-compute[75356]:     </memballoon>
Nov 29 20:25:54 user nova-compute[75356]:   </devices>
Nov 29 20:25:54 user nova-compute[75356]: </domain>
Nov 29 20:25:54 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:25:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1940095636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1940095636',id=27,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bed33acdfd5f48b9967d1dd68c261d78',ramdisk_id='',reservation_id='r-pzkhzskg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2041863686',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:25:52Z,user_data=None,user_id='e395b4248b794d65915edf2d23bbbeaf',uuid=ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4", "address": "fa:16:3e:96:21:98", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6fd1ef4-2d", "ovs_interfaceid": "d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Converting VIF {"id": "d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4", "address": "fa:16:3e:96:21:98", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6fd1ef4-2d", "ovs_interfaceid": "d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:21:98,bridge_name='br-int',has_traffic_filtering=True,id=d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6fd1ef4-2d') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG os_vif [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:21:98,bridge_name='br-int',has_traffic_filtering=True,id=d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6fd1ef4-2d') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc8b308e-1b69-5e37-b14d-e8a355c0a05e', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6fd1ef4-2d, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6fd1ef4-2d, col_values=(('qos', UUID('906a18ee-d182-45e8-9129-cc20e6cc13fd')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6fd1ef4-2d, col_values=(('external_ids', {'iface-id': 'd6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:21:98', 'vm-uuid': 'ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:54 user nova-compute[75356]: INFO os_vif [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:21:98,bridge_name='br-int',has_traffic_filtering=True,id=d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6fd1ef4-2d')
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] No VIF found with MAC fa:16:3e:96:21:98, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:54 user nova-compute[75356]: INFO nova.compute.manager [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Terminating instance
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.compute.manager [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.compute.manager [req-bddebaa6-78cc-4ec1-893e-e4004e9cf8a0 req-d0cf57cc-1e02-49fc-82a7-bd6a356f94d8 service nova] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Received event network-changed-d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.compute.manager [req-bddebaa6-78cc-4ec1-893e-e4004e9cf8a0 req-d0cf57cc-1e02-49fc-82a7-bd6a356f94d8 service nova] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Refreshing instance network info cache due to event network-changed-d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-bddebaa6-78cc-4ec1-893e-e4004e9cf8a0 req-d0cf57cc-1e02-49fc-82a7-bd6a356f94d8 service nova] Acquiring lock "refresh_cache-ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-bddebaa6-78cc-4ec1-893e-e4004e9cf8a0 req-d0cf57cc-1e02-49fc-82a7-bd6a356f94d8 service nova] Acquired lock "refresh_cache-ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:25:54 user nova-compute[75356]: DEBUG nova.network.neutron [req-bddebaa6-78cc-4ec1-893e-e4004e9cf8a0 req-d0cf57cc-1e02-49fc-82a7-bd6a356f94d8 service nova] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Refreshing network info cache for port d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:25:55 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:25:55 user nova-compute[75356]: DEBUG nova.network.neutron [req-bddebaa6-78cc-4ec1-893e-e4004e9cf8a0 req-d0cf57cc-1e02-49fc-82a7-bd6a356f94d8 service nova] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Updated VIF entry in instance network info cache for port d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:25:55 user nova-compute[75356]: DEBUG nova.network.neutron [req-bddebaa6-78cc-4ec1-893e-e4004e9cf8a0 req-d0cf57cc-1e02-49fc-82a7-bd6a356f94d8 service nova] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Updating instance_info_cache with network_info: [{"id": "d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4", "address": "fa:16:3e:96:21:98", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6fd1ef4-2d", "ovs_interfaceid": "d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:25:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-bddebaa6-78cc-4ec1-893e-e4004e9cf8a0 req-d0cf57cc-1e02-49fc-82a7-bd6a356f94d8 service nova] Releasing lock "refresh_cache-ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:25:55 user nova-compute[75356]: DEBUG nova.compute.manager [req-fdc5a8cc-5056-41de-8749-fb1b6386510f req-c924440a-32e4-47e2-a853-3e2a9cc52e36 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received event network-vif-unplugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:25:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-fdc5a8cc-5056-41de-8749-fb1b6386510f req-c924440a-32e4-47e2-a853-3e2a9cc52e36 service nova] Acquiring lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-fdc5a8cc-5056-41de-8749-fb1b6386510f req-c924440a-32e4-47e2-a853-3e2a9cc52e36 service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-fdc5a8cc-5056-41de-8749-fb1b6386510f req-c924440a-32e4-47e2-a853-3e2a9cc52e36 service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:55 user nova-compute[75356]: DEBUG nova.compute.manager [req-fdc5a8cc-5056-41de-8749-fb1b6386510f req-c924440a-32e4-47e2-a853-3e2a9cc52e36 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] No waiting events found dispatching network-vif-unplugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:25:55 user nova-compute[75356]: DEBUG nova.compute.manager [req-fdc5a8cc-5056-41de-8749-fb1b6386510f req-c924440a-32e4-47e2-a853-3e2a9cc52e36 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received event network-vif-unplugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:25:55 user nova-compute[75356]: DEBUG nova.compute.manager [req-fdc5a8cc-5056-41de-8749-fb1b6386510f req-c924440a-32e4-47e2-a853-3e2a9cc52e36 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received event network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:25:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-fdc5a8cc-5056-41de-8749-fb1b6386510f req-c924440a-32e4-47e2-a853-3e2a9cc52e36 service nova] Acquiring lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-fdc5a8cc-5056-41de-8749-fb1b6386510f req-c924440a-32e4-47e2-a853-3e2a9cc52e36 service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-fdc5a8cc-5056-41de-8749-fb1b6386510f req-c924440a-32e4-47e2-a853-3e2a9cc52e36 service nova] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:55 user nova-compute[75356]: DEBUG nova.compute.manager [req-fdc5a8cc-5056-41de-8749-fb1b6386510f req-c924440a-32e4-47e2-a853-3e2a9cc52e36 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] No waiting events found dispatching network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:25:55 user nova-compute[75356]: WARNING nova.compute.manager [req-fdc5a8cc-5056-41de-8749-fb1b6386510f req-c924440a-32e4-47e2-a853-3e2a9cc52e36 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received unexpected event network-vif-plugged-bf5b9476-92db-4a94-bcdd-485ba68a4d1e for instance with vm_state active and task_state deleting.
Nov 29 20:25:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:55 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Instance destroyed successfully.
Nov 29 20:25:55 user nova-compute[75356]: DEBUG nova.objects.instance [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lazy-loading 'resources' on Instance uuid 96cbbbdb-e1cc-49da-9a9f-5b83031b235b {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2075887638',display_name='tempest-ServerActionsTestOtherB-server-2075887638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2075887638',id=5,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqmwjesnBZKKmMOP1nU5mLLaxgxAYrWKpY6AKu2j/L1exH/XrbvTGFuJ5hCGjIGc6yFau1HY0D/HH/XuWjDf7bDrvpfXRmVeDF3iS6kjnnvyZ4TUUiMwhiV4HxFj8NX1w==',key_name='tempest-keypair-1339068574',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:23:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19fa4a7548454fc4a29a625b0c819c9c',ramdisk_id='',reservation_id='r-pzj88ta7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-403173210',owner_user_name='tempest-ServerActionsTestOtherB-403173210-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:23:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e5a895cde3741d0a48cb06922ad80f8',uuid=96cbbbdb-e1cc-49da-9a9f-5b83031b235b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Converting VIF {"id": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "address": "fa:16:3e:b0:e6:d6", "network": {"id": "d5185e2d-1e16-408d-91cf-3c494b84cd52", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1795107623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19fa4a7548454fc4a29a625b0c819c9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5b9476-92", "ovs_interfaceid": "bf5b9476-92db-4a94-bcdd-485ba68a4d1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:e6:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf5b9476-92db-4a94-bcdd-485ba68a4d1e,network=Network(d5185e2d-1e16-408d-91cf-3c494b84cd52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5b9476-92') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG os_vif [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:e6:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf5b9476-92db-4a94-bcdd-485ba68a4d1e,network=Network(d5185e2d-1e16-408d-91cf-3c494b84cd52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5b9476-92') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf5b9476-92, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2044820f-ac32-4a3e-a8a1-301070273e8b) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:56 user nova-compute[75356]: INFO os_vif [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:e6:d6,bridge_name='br-int',has_traffic_filtering=True,id=bf5b9476-92db-4a94-bcdd-485ba68a4d1e,network=Network(d5185e2d-1e16-408d-91cf-3c494b84cd52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5b9476-92')
Nov 29 20:25:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wKteoRvT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:25:56 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:25:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7977640-c962-4d63-9390-b35456409c44]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:25:56 user nova-compute[75356]: No targets found.
Nov 29 20:25:56 user nova-compute[75356]: iSNS:
Nov 29 20:25:56 user nova-compute[75356]: No targets found.
Nov 29 20:25:56 user nova-compute[75356]: STATIC:
Nov 29 20:25:56 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29
Nov 29 20:25:56 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:25:56 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:25:56 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7
Nov 29 20:25:56 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:25:56 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:25:56 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f
Nov 29 20:25:56 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:25:56 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:25:56 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:25:56 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:25:56 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:25:56 user nova-compute[75356]: FIRMWARE:
Nov 29 20:25:56 user nova-compute[75356]: No targets found.
Nov 29 20:25:56 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:25:56 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:25:56 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b266cf0-5515-4139-9c05-0aecc816946c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27b7fe5-ca69-43aa-8db5-091f4eb2c53b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:25:56 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:25:56 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:25:56 user nova-compute[75356]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)
Nov 29 20:25:56 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:25:56 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:25:56 user nova-compute[75356]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 (non-flash)
Nov 29 20:25:56 user nova-compute[75356]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)
Nov 29 20:25:56 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e43495a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7'): ({'sdf'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Removing single pathed devices sdf {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ece58d7-c285-43c9-97c2-3dd8847b80ef]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[993f1ac3-04f4-453d-8d03-082560ba56cc]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Flushing IO for device /dev/sdf {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcff8a4-1dc5-4c3f-8abf-5e4ba6d8e129]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5417d8f7-2364-4870-8986-7c38ac2b927b]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] SCSI volumes sdf have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-0b59517a-c467-432a-a73a-d1460c1574e7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-0b59517a-c467-432a-a73a-d1460c1574e7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8d4003-ccd4-4de2-a990-c4e305f9baa1]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[857f7656-4c94-4656-9b8a-1fa558d2ab9d]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260]
Nov 29 20:25:56 user nova-compute[75356]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7, portal: 172.16.0.220,3260] successful.
Nov 29 20:25:56 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a07443e-a368-43b5-90b0-e96c00dc86a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff55102-d6e3-4775-b033-9684a853c6c1]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] <== disconnect_volume: return (395ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:25:56 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Deleting instance files /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b_del
Nov 29 20:25:56 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Deletion of /opt/stack/data/nova/instances/96cbbbdb-e1cc-49da-9a9f-5b83031b235b_del complete
Nov 29 20:25:56 user nova-compute[75356]: INFO nova.compute.manager [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Took 1.86 seconds to destroy the instance on the hypervisor.
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Updating instance_info_cache with network_info: [{"id": "56a80963-a1f2-429e-8474-1795928fd05c", "address": "fa:16:3e:74:bd:99", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a80963-a1", "ovs_interfaceid": "56a80963-a1f2-429e-8474-1795928fd05c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-0b59517a-c467-432a-a73a-d1460c1574e7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:25:56 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:25:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:25:57 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:25:57 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:25:57 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Took 0.93 seconds to deallocate network for instance.
Nov 29 20:25:57 user nova-compute[75356]: DEBUG nova.compute.manager [req-115bcc47-259a-483e-9567-f964828fa754 req-12805c0b-c50f-4e1d-ad2f-f8921f418930 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Received event network-vif-deleted-bf5b9476-92db-4a94-bcdd-485ba68a4d1e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:25:57 user nova-compute[75356]: INFO nova.compute.manager [req-115bcc47-259a-483e-9567-f964828fa754 req-12805c0b-c50f-4e1d-ad2f-f8921f418930 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Neutron deleted interface bf5b9476-92db-4a94-bcdd-485ba68a4d1e; detaching it from the instance and deleting it from the info cache
Nov 29 20:25:57 user nova-compute[75356]: DEBUG nova.network.neutron [req-115bcc47-259a-483e-9567-f964828fa754 req-12805c0b-c50f-4e1d-ad2f-f8921f418930 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:25:57 user nova-compute[75356]: DEBUG nova.compute.manager [req-115bcc47-259a-483e-9567-f964828fa754 req-12805c0b-c50f-4e1d-ad2f-f8921f418930 service nova] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Detach interface failed, port_id=bf5b9476-92db-4a94-bcdd-485ba68a4d1e, reason: Instance 96cbbbdb-e1cc-49da-9a9f-5b83031b235b could not be found. {{(pid=75356) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 20:25:57 user nova-compute[75356]: DEBUG nova.compute.manager [req-054ace0e-ca4d-43bf-b79c-c238bd2e0934 req-a8333158-d975-4e2a-b551-afb9898b0506 service nova] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Received event network-vif-plugged-d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:25:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-054ace0e-ca4d-43bf-b79c-c238bd2e0934 req-a8333158-d975-4e2a-b551-afb9898b0506 service nova] Acquiring lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-054ace0e-ca4d-43bf-b79c-c238bd2e0934 req-a8333158-d975-4e2a-b551-afb9898b0506 service nova] Lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-054ace0e-ca4d-43bf-b79c-c238bd2e0934 req-a8333158-d975-4e2a-b551-afb9898b0506 service nova] Lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:57 user nova-compute[75356]: DEBUG nova.compute.manager [req-054ace0e-ca4d-43bf-b79c-c238bd2e0934 req-a8333158-d975-4e2a-b551-afb9898b0506 service nova] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] No waiting events found dispatching network-vif-plugged-d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:25:57 user nova-compute[75356]: WARNING nova.compute.manager [req-054ace0e-ca4d-43bf-b79c-c238bd2e0934 req-a8333158-d975-4e2a-b551-afb9898b0506 service nova] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Received unexpected event network-vif-plugged-d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4 for instance with vm_state building and task_state spawning.
Nov 29 20:25:57 user nova-compute[75356]: DEBUG nova.compute.manager [req-054ace0e-ca4d-43bf-b79c-c238bd2e0934 req-a8333158-d975-4e2a-b551-afb9898b0506 service nova] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Received event network-vif-plugged-d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:25:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-054ace0e-ca4d-43bf-b79c-c238bd2e0934 req-a8333158-d975-4e2a-b551-afb9898b0506 service nova] Acquiring lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-054ace0e-ca4d-43bf-b79c-c238bd2e0934 req-a8333158-d975-4e2a-b551-afb9898b0506 service nova] Lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-054ace0e-ca4d-43bf-b79c-c238bd2e0934 req-a8333158-d975-4e2a-b551-afb9898b0506 service nova] Lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:57 user nova-compute[75356]: DEBUG nova.compute.manager [req-054ace0e-ca4d-43bf-b79c-c238bd2e0934 req-a8333158-d975-4e2a-b551-afb9898b0506 service nova] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] No waiting events found dispatching network-vif-plugged-d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:25:57 user nova-compute[75356]: WARNING nova.compute.manager [req-054ace0e-ca4d-43bf-b79c-c238bd2e0934 req-a8333158-d975-4e2a-b551-afb9898b0506 service nova] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Received unexpected event network-vif-plugged-d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4 for instance with vm_state building and task_state spawning.
Nov 29 20:25:58 user nova-compute[75356]: DEBUG nova.compute.manager [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:25:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:25:58 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Instance spawned successfully.
Nov 29 20:25:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:25:58 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:25:58 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:25:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:25:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:25:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:25:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:25:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:25:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:25:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:58 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:25:58 user nova-compute[75356]: INFO nova.compute.manager [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Took 6.16 seconds to spawn the instance on the hypervisor.
Nov 29 20:25:58 user nova-compute[75356]: DEBUG nova.compute.manager [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:25:58 user nova-compute[75356]: INFO nova.compute.manager [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] [instance: 96cbbbdb-e1cc-49da-9a9f-5b83031b235b] Took 0.85 seconds to detach 1 volumes for instance.
Nov 29 20:25:58 user nova-compute[75356]: INFO nova.compute.manager [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Took 7.15 seconds to build instance.
Nov 29 20:25:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bb71020d-d7fa-4323-ab17-77af03e6eb8c tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.272s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:25:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:25:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:58 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:25:58 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:25:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.482s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:59 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Deleted allocations for instance 96cbbbdb-e1cc-49da-9a9f-5b83031b235b
Nov 29 20:25:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cf863a6c-ddc5-4497-b3a8-cab268121c87 tempest-ServerActionsTestOtherB-403173210 tempest-ServerActionsTestOtherB-403173210-project-member] Lock "96cbbbdb-e1cc-49da-9a9f-5b83031b235b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.558s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:25:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:25:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:25:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:25:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:26:02 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:26:02 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:26:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=7596MB free_disk=25.160320281982422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0b59517a-c467-432a-a73a-d1460c1574e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 36ec2327-b376-49e4-8592-b2a077b79043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance db0826f0-5fdc-47a8-ae36-5059844980c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 93183110-d2e2-4da7-ab7d-73378f5e0d42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4327336c-e3a9-4b8d-abc2-6438487b2296 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 7982934b-8c0f-4403-8607-2a2679070e02 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "7982934b-8c0f-4403-8607-2a2679070e02" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "7982934b-8c0f-4403-8607-2a2679070e02" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:02 user nova-compute[75356]: INFO nova.compute.manager [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Unshelving
Nov 29 20:26:02 user nova-compute[75356]: INFO nova.virt.block_device [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Booting with volume 33171227-569e-4cbb-99a7-e0b23d6d9eb0 at /dev/vdc
Nov 29 20:26:02 user nova-compute[75356]: DEBUG os_brick.utils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8403c5-9c85-4950-b095-5ea901e64673]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[109f826d-320a-4c60-b6de-3ed0bdc31803]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d501220-374b-40b3-a39e-2d318c3ac7a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[195f2416-bdf0-4a0c-869d-6b04a6967d70]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:26:02 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:26:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e6b5e7-a4a7-48e8-8c1a-8efedfa75967]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG os_brick.utils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Updating existing volume attachment record: 75f4df99-6ca5-47c4-a818-4de598b22a82 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:26:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.630s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:03 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:26:03 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:26:03 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:26:03 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:26:03 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:26:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:26:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:08 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 36ec2327-b376-49e4-8592-b2a077b79043 is timed out.
Nov 29 20:26:08 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Successfully detached device vdb from instance 36ec2327-b376-49e4-8592-b2a077b79043 from the live domain config.
Nov 29 20:26:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:26:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrgJDozc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:26:08 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:26:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:26:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:26:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96d53f0-081b-494a-87f0-08add234d07a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:26:09 user nova-compute[75356]: No targets found.
Nov 29 20:26:09 user nova-compute[75356]: iSNS:
Nov 29 20:26:09 user nova-compute[75356]: No targets found.
Nov 29 20:26:09 user nova-compute[75356]: STATIC:
Nov 29 20:26:09 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29
Nov 29 20:26:09 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:26:09 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:26:09 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f
Nov 29 20:26:09 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:26:09 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:26:09 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:26:09 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:26:09 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:26:09 user nova-compute[75356]: FIRMWARE:
Nov 29 20:26:09 user nova-compute[75356]: No targets found.
Nov 29 20:26:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:26:09 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:26:09 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4719041f-1007-45e3-9201-0926173ae613]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13e2a38-cf2a-4ef8-829b-e3682b1c580f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:26:09 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:26:09 user nova-compute[75356]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)
Nov 29 20:26:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:26:09 user nova-compute[75356]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f (non-flash)
Nov 29 20:26:09 user nova-compute[75356]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)
Nov 29 20:26:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e44f7130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f'): ({'sde'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Removing single pathed devices sde {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e65cb2-3aab-460d-86b7-28e1e8490a7f]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[985200e7-c94a-4d05-94f1-9783acfc9c6a]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Flushing IO for device /dev/sde {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4a3621-d2e9-4787-b2e4-93f5c6728bf7]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[84da2dfb-7ae6-411a-a7ed-880536c445c8]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] SCSI volumes sde have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4cde12-ef20-46f4-8e7e-e9a0e76aa213]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eda8a37-26b6-4f62-9c19-2299fe9b73b0]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f, portal: 172.16.0.220,3260]
Nov 29 20:26:09 user nova-compute[75356]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f, portal: 172.16.0.220,3260] successful.
Nov 29 20:26:09 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c894c707-c3c7-4972-8a6d-d54fdc63f13f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfe1d26-0dad-4f8f-83a6-ba124ec2bcf9]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] <== disconnect_volume: return (334ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:26:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:26:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:11 user nova-compute[75356]: DEBUG nova.objects.instance [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lazy-loading 'flavor' on Instance uuid 36ec2327-b376-49e4-8592-b2a077b79043 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:26:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-221bc51c-536b-47ad-9e3f-d66fe6f1dfe6 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "36ec2327-b376-49e4-8592-b2a077b79043" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.304s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:11 user nova-compute[75356]: DEBUG nova.objects.instance [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lazy-loading 'pci_requests' on Instance uuid 7982934b-8c0f-4403-8607-2a2679070e02 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:26:11 user nova-compute[75356]: DEBUG nova.objects.instance [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lazy-loading 'numa_topology' on Instance uuid 7982934b-8c0f-4403-8607-2a2679070e02 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:26:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:26:11 user nova-compute[75356]: INFO nova.compute.claims [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Claim successful on node user
Nov 29 20:26:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:12 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:26:12 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:26:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:12 user nova-compute[75356]: INFO nova.network.neutron [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Updating port 2273063c-59ad-4c22-baac-b35f81cddd68 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 20:26:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "refresh_cache-7982934b-8c0f-4403-8607-2a2679070e02" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:26:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquired lock "refresh_cache-7982934b-8c0f-4403-8607-2a2679070e02" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:26:13 user nova-compute[75356]: DEBUG nova.network.neutron [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:26:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-59043f31-0e68-4b15-9088-ee94509440da req-9a0c13e3-c5f1-48e6-8d9e-eac9b4417f77 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received event network-changed-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:26:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-59043f31-0e68-4b15-9088-ee94509440da req-9a0c13e3-c5f1-48e6-8d9e-eac9b4417f77 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Refreshing instance network info cache due to event network-changed-2273063c-59ad-4c22-baac-b35f81cddd68. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:26:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-59043f31-0e68-4b15-9088-ee94509440da req-9a0c13e3-c5f1-48e6-8d9e-eac9b4417f77 service nova] Acquiring lock "refresh_cache-7982934b-8c0f-4403-8607-2a2679070e02" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:26:13 user nova-compute[75356]: DEBUG nova.network.neutron [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Updating instance_info_cache with network_info: [{"id": "2273063c-59ad-4c22-baac-b35f81cddd68", "address": "fa:16:3e:3f:8c:d9", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2273063c-59", "ovs_interfaceid": "2273063c-59ad-4c22-baac-b35f81cddd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:26:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Releasing lock "refresh_cache-7982934b-8c0f-4403-8607-2a2679070e02" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:26:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:26:13 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Creating image(s)
Nov 29 20:26:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "/opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "/opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "/opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:13 user nova-compute[75356]: DEBUG nova.objects.instance [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7982934b-8c0f-4403-8607-2a2679070e02 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:26:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-59043f31-0e68-4b15-9088-ee94509440da req-9a0c13e3-c5f1-48e6-8d9e-eac9b4417f77 service nova] Acquired lock "refresh_cache-7982934b-8c0f-4403-8607-2a2679070e02" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:26:13 user nova-compute[75356]: DEBUG nova.network.neutron [req-59043f31-0e68-4b15-9088-ee94509440da req-9a0c13e3-c5f1-48e6-8d9e-eac9b4417f77 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Refreshing network info cache for port 2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:26:13 user nova-compute[75356]: DEBUG nova.objects.base [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Object Instance<7982934b-8c0f-4403-8607-2a2679070e02> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:26:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "1b00baf7ca2f005ad497c2280811ac15efef87f7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "1b00baf7ca2f005ad497c2280811ac15efef87f7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b00baf7ca2f005ad497c2280811ac15efef87f7.part --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b00baf7ca2f005ad497c2280811ac15efef87f7.part --force-share --output=json" returned: 0 in 0.187s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:14 user nova-compute[75356]: DEBUG nova.virt.images [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] 597598e6-804f-4f4b-9b95-17f06115115b was qcow2, converting to raw {{(pid=75356) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 20:26:14 user nova-compute[75356]: DEBUG nova.privsep.utils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75356) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 20:26:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1b00baf7ca2f005ad497c2280811ac15efef87f7.part /opt/stack/data/nova/instances/_base/1b00baf7ca2f005ad497c2280811ac15efef87f7.converted {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:14 user nova-compute[75356]: DEBUG nova.network.neutron [req-59043f31-0e68-4b15-9088-ee94509440da req-9a0c13e3-c5f1-48e6-8d9e-eac9b4417f77 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Updated VIF entry in instance network info cache for port 2273063c-59ad-4c22-baac-b35f81cddd68. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:26:14 user nova-compute[75356]: DEBUG nova.network.neutron [req-59043f31-0e68-4b15-9088-ee94509440da req-9a0c13e3-c5f1-48e6-8d9e-eac9b4417f77 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Updating instance_info_cache with network_info: [{"id": "2273063c-59ad-4c22-baac-b35f81cddd68", "address": "fa:16:3e:3f:8c:d9", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2273063c-59", "ovs_interfaceid": "2273063c-59ad-4c22-baac-b35f81cddd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:26:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-59043f31-0e68-4b15-9088-ee94509440da req-9a0c13e3-c5f1-48e6-8d9e-eac9b4417f77 service nova] Releasing lock "refresh_cache-7982934b-8c0f-4403-8607-2a2679070e02" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:26:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1b00baf7ca2f005ad497c2280811ac15efef87f7.part /opt/stack/data/nova/instances/_base/1b00baf7ca2f005ad497c2280811ac15efef87f7.converted" returned: 0 in 0.430s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b00baf7ca2f005ad497c2280811ac15efef87f7.converted --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b00baf7ca2f005ad497c2280811ac15efef87f7.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "1b00baf7ca2f005ad497c2280811ac15efef87f7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.748s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b00baf7ca2f005ad497c2280811ac15efef87f7 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b00baf7ca2f005ad497c2280811ac15efef87f7 --force-share --output=json" returned: 0 in 0.179s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "1b00baf7ca2f005ad497c2280811ac15efef87f7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "1b00baf7ca2f005ad497c2280811ac15efef87f7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b00baf7ca2f005ad497c2280811ac15efef87f7 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b00baf7ca2f005ad497c2280811ac15efef87f7 --force-share --output=json" returned: 0 in 0.184s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1b00baf7ca2f005ad497c2280811ac15efef87f7,backing_fmt=raw /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1b00baf7ca2f005ad497c2280811ac15efef87f7,backing_fmt=raw /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk 1073741824" returned: 0 in 0.050s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "1b00baf7ca2f005ad497c2280811ac15efef87f7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b00baf7ca2f005ad497c2280811ac15efef87f7 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b00baf7ca2f005ad497c2280811ac15efef87f7 --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:15 user nova-compute[75356]: DEBUG nova.objects.instance [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lazy-loading 'migration_context' on Instance uuid 7982934b-8c0f-4403-8607-2a2679070e02 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:26:15 user nova-compute[75356]: DEBUG nova.objects.base [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Object Instance<7982934b-8c0f-4403-8607-2a2679070e02> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:26:15 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Rebasing disk image.
Nov 29 20:26:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.176s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 -F raw /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:16 user nova-compute[75356]: INFO nova.compute.manager [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Rescuing
Nov 29 20:26:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "refresh_cache-93183110-d2e2-4da7-ab7d-73378f5e0d42" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:26:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquired lock "refresh_cache-93183110-d2e2-4da7-ab7d-73378f5e0d42" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:26:16 user nova-compute[75356]: DEBUG nova.network.neutron [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:26:16 user nova-compute[75356]: DEBUG nova.network.neutron [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Updating instance_info_cache with network_info: [{"id": "a9883307-4927-4472-932e-b7a9354d5fe8", "address": "fa:16:3e:80:43:0b", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9883307-49", "ovs_interfaceid": "a9883307-4927-4472-932e-b7a9354d5fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:26:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Releasing lock "refresh_cache-93183110-d2e2-4da7-ab7d-73378f5e0d42" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:26:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:17 user nova-compute[75356]: DEBUG nova.compute.manager [req-c2c6700d-2f5d-481d-8b1d-5ed8bcbf36c5 req-e1c0f498-40df-4c96-8d25-1a699ec09068 service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Received event network-vif-unplugged-a9883307-4927-4472-932e-b7a9354d5fe8 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:26:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c2c6700d-2f5d-481d-8b1d-5ed8bcbf36c5 req-e1c0f498-40df-4c96-8d25-1a699ec09068 service nova] Acquiring lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c2c6700d-2f5d-481d-8b1d-5ed8bcbf36c5 req-e1c0f498-40df-4c96-8d25-1a699ec09068 service nova] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c2c6700d-2f5d-481d-8b1d-5ed8bcbf36c5 req-e1c0f498-40df-4c96-8d25-1a699ec09068 service nova] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:17 user nova-compute[75356]: DEBUG nova.compute.manager [req-c2c6700d-2f5d-481d-8b1d-5ed8bcbf36c5 req-e1c0f498-40df-4c96-8d25-1a699ec09068 service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] No waiting events found dispatching network-vif-unplugged-a9883307-4927-4472-932e-b7a9354d5fe8 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:26:17 user nova-compute[75356]: WARNING nova.compute.manager [req-c2c6700d-2f5d-481d-8b1d-5ed8bcbf36c5 req-e1c0f498-40df-4c96-8d25-1a699ec09068 service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Received unexpected event network-vif-unplugged-a9883307-4927-4472-932e-b7a9354d5fe8 for instance with vm_state active and task_state rescuing.
Nov 29 20:26:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:17 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Instance destroyed successfully.
Nov 29 20:26:17 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Attempting rescue
Nov 29 20:26:17 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75356) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 20:26:17 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Instance directory exists: not creating {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 20:26:17 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Creating image(s)
Nov 29 20:26:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "/opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "/opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "/opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.025s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:17 user nova-compute[75356]: DEBUG nova.objects.instance [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'trusted_certs' on Instance uuid 93183110-d2e2-4da7-ab7d-73378f5e0d42 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:26:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.379s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue" returned: 0 in 0.168s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.553s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.objects.instance [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'migration_context' on Instance uuid 93183110-d2e2-4da7-ab7d-73378f5e0d42 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.objects.base [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Object Instance<93183110-d2e2-4da7-ab7d-73378f5e0d42> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Start _get_guest_xml network_info=[{"id": "a9883307-4927-4472-932e-b7a9354d5fe8", "address": "fa:16:3e:80:43:0b", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "vif_mac": "fa:16:3e:80:43:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9883307-49", "ovs_interfaceid": "a9883307-4927-4472-932e-b7a9354d5fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.objects.instance [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'resources' on Instance uuid 93183110-d2e2-4da7-ab7d-73378f5e0d42 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.objects.base [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Object Instance<93183110-d2e2-4da7-ab7d-73378f5e0d42> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.objects.instance [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'numa_topology' on Instance uuid 93183110-d2e2-4da7-ab7d-73378f5e0d42 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.objects.base [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Object Instance<93183110-d2e2-4da7-ab7d-73378f5e0d42> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:26:18 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:26:18 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.objects.instance [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'vcpu_model' on Instance uuid 93183110-d2e2-4da7-ab7d-73378f5e0d42 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.objects.base [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Object Instance<93183110-d2e2-4da7-ab7d-73378f5e0d42> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:24:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-674467598',display_name='tempest-ServerRescueNegativeTestJSON-server-674467598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-674467598',id=23,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:24:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34dff0986b1d47fdaf305c87e323d19e',ramdisk_id='',reservation_id='r-ri9bq1p5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1204717931',owner_user_name='tempest-ServerRescueNegativeTestJSON-1204717931-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:24:36Z,user_data=None,user_id='00cdfe6527e04f049b5e38685bc1f257',uuid=93183110-d2e2-4da7-ab7d-73378f5e0d42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9883307-4927-4472-932e-b7a9354d5fe8", "address": "fa:16:3e:80:43:0b", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "vif_mac": "fa:16:3e:80:43:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9883307-49", "ovs_interfaceid": "a9883307-4927-4472-932e-b7a9354d5fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converting VIF {"id": "a9883307-4927-4472-932e-b7a9354d5fe8", "address": "fa:16:3e:80:43:0b", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "vif_mac": "fa:16:3e:80:43:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9883307-49", "ovs_interfaceid": "a9883307-4927-4472-932e-b7a9354d5fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:43:0b,bridge_name='br-int',has_traffic_filtering=True,id=a9883307-4927-4472-932e-b7a9354d5fe8,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9883307-49') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.objects.instance [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'pci_devices' on Instance uuid 93183110-d2e2-4da7-ab7d-73378f5e0d42 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.objects.base [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Object Instance<93183110-d2e2-4da7-ab7d-73378f5e0d42> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:26:18 user nova-compute[75356]:   <uuid>93183110-d2e2-4da7-ab7d-73378f5e0d42</uuid>
Nov 29 20:26:18 user nova-compute[75356]:   <name>instance-00000017</name>
Nov 29 20:26:18 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:26:18 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:26:18 user nova-compute[75356]:   <metadata>
Nov 29 20:26:18 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:26:18 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:26:18 user nova-compute[75356]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-674467598</nova:name>
Nov 29 20:26:18 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:26:18</nova:creationTime>
Nov 29 20:26:18 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:26:18 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:26:18 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:26:18 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:26:18 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:26:18 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:26:18 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:26:18 user nova-compute[75356]:       <nova:owner>
Nov 29 20:26:18 user nova-compute[75356]:         <nova:user uuid="00cdfe6527e04f049b5e38685bc1f257">tempest-ServerRescueNegativeTestJSON-1204717931-project-member</nova:user>
Nov 29 20:26:18 user nova-compute[75356]:         <nova:project uuid="34dff0986b1d47fdaf305c87e323d19e">tempest-ServerRescueNegativeTestJSON-1204717931</nova:project>
Nov 29 20:26:18 user nova-compute[75356]:       </nova:owner>
Nov 29 20:26:18 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:26:18 user nova-compute[75356]:       <nova:ports>
Nov 29 20:26:18 user nova-compute[75356]:         <nova:port uuid="a9883307-4927-4472-932e-b7a9354d5fe8">
Nov 29 20:26:18 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 20:26:18 user nova-compute[75356]:         </nova:port>
Nov 29 20:26:18 user nova-compute[75356]:       </nova:ports>
Nov 29 20:26:18 user nova-compute[75356]:     </nova:instance>
Nov 29 20:26:18 user nova-compute[75356]:   </metadata>
Nov 29 20:26:18 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:26:18 user nova-compute[75356]:     <system>
Nov 29 20:26:18 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:26:18 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:26:18 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:26:18 user nova-compute[75356]:       <entry name="serial">93183110-d2e2-4da7-ab7d-73378f5e0d42</entry>
Nov 29 20:26:18 user nova-compute[75356]:       <entry name="uuid">93183110-d2e2-4da7-ab7d-73378f5e0d42</entry>
Nov 29 20:26:18 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:26:18 user nova-compute[75356]:     </system>
Nov 29 20:26:18 user nova-compute[75356]:   </sysinfo>
Nov 29 20:26:18 user nova-compute[75356]:   <os>
Nov 29 20:26:18 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:26:18 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:26:18 user nova-compute[75356]:   </os>
Nov 29 20:26:18 user nova-compute[75356]:   <features>
Nov 29 20:26:18 user nova-compute[75356]:     <acpi/>
Nov 29 20:26:18 user nova-compute[75356]:     <apic/>
Nov 29 20:26:18 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:26:18 user nova-compute[75356]:   </features>
Nov 29 20:26:18 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:26:18 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:26:18 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:26:18 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:26:18 user nova-compute[75356]:   </clock>
Nov 29 20:26:18 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:26:18 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:26:18 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:26:18 user nova-compute[75356]:   </cpu>
Nov 29 20:26:18 user nova-compute[75356]:   <devices>
Nov 29 20:26:18 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:26:18 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:26:18 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue"/>
Nov 29 20:26:18 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:26:18 user nova-compute[75356]:     </disk>
Nov 29 20:26:18 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:26:18 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:26:18 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk"/>
Nov 29 20:26:18 user nova-compute[75356]:       <target dev="vdb" bus="virtio"/>
Nov 29 20:26:18 user nova-compute[75356]:     </disk>
Nov 29 20:26:18 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:26:18 user nova-compute[75356]:       <mac address="fa:16:3e:80:43:0b"/>
Nov 29 20:26:18 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:26:18 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:26:18 user nova-compute[75356]:       <target dev="tapa9883307-49"/>
Nov 29 20:26:18 user nova-compute[75356]:     </interface>
Nov 29 20:26:18 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:26:18 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/console.log" append="off"/>
Nov 29 20:26:18 user nova-compute[75356]:     </serial>
Nov 29 20:26:18 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:26:18 user nova-compute[75356]:     <video>
Nov 29 20:26:18 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:26:18 user nova-compute[75356]:     </video>
Nov 29 20:26:18 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:26:18 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:26:18 user nova-compute[75356]:     </rng>
Nov 29 20:26:18 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:26:18 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:26:18 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:26:18 user nova-compute[75356]:     </memballoon>
Nov 29 20:26:18 user nova-compute[75356]:   </devices>
Nov 29 20:26:18 user nova-compute[75356]: </domain>
Nov 29 20:26:18 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:26:18 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Instance destroyed successfully.
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] No VIF found with MAC fa:16:3e:80:43:0b, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 -F raw /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk" returned: 0 in 2.392s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Ensure instance console log exists: /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Start _get_guest_xml network_info=[{"id": "2273063c-59ad-4c22-baac-b35f81cddd68", "address": "fa:16:3e:3f:8c:d9", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2273063c-59", "ovs_interfaceid": "2273063c-59ad-4c22-baac-b35f81cddd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b5eabccd398267c558950af1711dd2cf',container_format='bare',created_at=2023-11-29T20:24:09Z,direct_url=<?>,disk_format='qcow2',id=597598e6-804f-4f4b-9b95-17f06115115b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-859860773-shelved',owner='71e99301081a4158bc9d188e2f796350',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T20:24:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdc', 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIiVTYBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '7982934b-8c0f-4403-8607-2a2679070e02', 'attached_at': '', 'detached_at': '', 'volume_id': '33171227-569e-4cbb-99a7-e0b23d6d9eb0', 'serial': '33171227-569e-4cbb-99a7-e0b23d6d9eb0'}, 'attachment_id': '75f4df99-6ca5-47c4-a818-4de598b22a82', 'volume_type': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:26:18 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:26:18 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b5eabccd398267c558950af1711dd2cf',container_format='bare',created_at=2023-11-29T20:24:09Z,direct_url=<?>,disk_format='qcow2',id=597598e6-804f-4f4b-9b95-17f06115115b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-859860773-shelved',owner='71e99301081a4158bc9d188e2f796350',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T20:24:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.objects.instance [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7982934b-8c0f-4403-8607-2a2679070e02 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.objects.base [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Object Instance<7982934b-8c0f-4403-8607-2a2679070e02> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIiVTYBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:26:18 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:26:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:26:18 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:26:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:26:18 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad965d4-c6f5-45cd-bc94-d12bb2052894]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:26:18 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d6ce90-63a9-4246-8146-a9c1898752ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0] added
Nov 29 20:26:18 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5aad732-0d89-40ca-ab93-ce612aa09ade]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d215826-ebf7-4147-8793-b97decfff666]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SIiVTYBn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SIiVTYBn" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0dac49-51a3-4d42-bc2d-d3108586f46a]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SIiVTYBn'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac038699-bb79-42a4-8862-f52c9d9f4986]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c16556-1019-4f9a-ae86-3084c0f2a70b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:26:18 user nova-compute[75356]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)
Nov 29 20:26:18 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:26:18 user nova-compute[75356]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)
Nov 29 20:26:18 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e07a555-d03a-47f9-b055-02bd60a56677]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0, portal: 172.16.0.220,3260]
Nov 29 20:26:18 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0, portal: 172.16.0.220,3260] successful.
Nov 29 20:26:18 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b878a1d-dc0e-499b-af62-4a64245217ca]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[209154ac-9331-43b2-9a68-c539ee6cc96b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:26:18 user nova-compute[75356]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)
Nov 29 20:26:18 user nova-compute[75356]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 (non-flash)
Nov 29 20:26:18 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:26:18 user nova-compute[75356]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)
Nov 29 20:26:18 user nova-compute[75356]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 (non-flash)
Nov 29 20:26:18 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1323532-836e-40c6-901a-4e8d489c7eeb]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:26:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIiVTYBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:26:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-4d99b953-fb3d-4f89-9179-c092ad379b76 req-7676ca13-264b-4932-a474-a253a73cf8f9 service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Received event network-vif-plugged-a9883307-4927-4472-932e-b7a9354d5fe8 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:26:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4d99b953-fb3d-4f89-9179-c092ad379b76 req-7676ca13-264b-4932-a474-a253a73cf8f9 service nova] Acquiring lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4d99b953-fb3d-4f89-9179-c092ad379b76 req-7676ca13-264b-4932-a474-a253a73cf8f9 service nova] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4d99b953-fb3d-4f89-9179-c092ad379b76 req-7676ca13-264b-4932-a474-a253a73cf8f9 service nova] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-4d99b953-fb3d-4f89-9179-c092ad379b76 req-7676ca13-264b-4932-a474-a253a73cf8f9 service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] No waiting events found dispatching network-vif-plugged-a9883307-4927-4472-932e-b7a9354d5fe8 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:26:19 user nova-compute[75356]: WARNING nova.compute.manager [req-4d99b953-fb3d-4f89-9179-c092ad379b76 req-7676ca13-264b-4932-a474-a253a73cf8f9 service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Received unexpected event network-vif-plugged-a9883307-4927-4472-932e-b7a9354d5fe8 for instance with vm_state active and task_state rescuing.
Nov 29 20:26:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:26:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26134646365623363', 'path': '/dev/sdc'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:26:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134646365623363', 'path': '/dev/sdc'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:26:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T20:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-859860773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-859860773',id=20,image_ref='597598e6-804f-4f4b-9b95-17f06115115b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1095450286',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:22:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='71e99301081a4158bc9d188e2f796350',ramdisk_id='',reservation_id='r-5mvrbzg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1538416601',owner_user_name='tempest-AttachVolumeShelveTestJSON-1538416601-project-member',shelved_at='2023-11-29T20:24:14.614669',shelved_host='user',shelved_image_id='597598e6-804f-4f4b-9b95-17f06115115b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:26:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecc96706ae3140ce8816c0e78e116d7d',uuid=7982934b-8c0f-4403-8607-2a2679070e02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2273063c-59ad-4c22-baac-b35f81cddd68", "address": "fa:16:3e:3f:8c:d9", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2273063c-59", "ovs_interfaceid": "2273063c-59ad-4c22-baac-b35f81cddd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:26:19 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converting VIF {"id": "2273063c-59ad-4c22-baac-b35f81cddd68", "address": "fa:16:3e:3f:8c:d9", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2273063c-59", "ovs_interfaceid": "2273063c-59ad-4c22-baac-b35f81cddd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:26:19 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:8c:d9,bridge_name='br-int',has_traffic_filtering=True,id=2273063c-59ad-4c22-baac-b35f81cddd68,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2273063c-59') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:26:19 user nova-compute[75356]: DEBUG nova.objects.instance [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lazy-loading 'pci_devices' on Instance uuid 7982934b-8c0f-4403-8607-2a2679070e02 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:26:19 user nova-compute[75356]: DEBUG nova.objects.base [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Object Instance<7982934b-8c0f-4403-8607-2a2679070e02> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:26:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:26:19 user nova-compute[75356]:   <uuid>7982934b-8c0f-4403-8607-2a2679070e02</uuid>
Nov 29 20:26:19 user nova-compute[75356]:   <name>instance-00000014</name>
Nov 29 20:26:19 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:26:19 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:26:19 user nova-compute[75356]:   <metadata>
Nov 29 20:26:19 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:26:19 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:26:19 user nova-compute[75356]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-859860773</nova:name>
Nov 29 20:26:19 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:26:18</nova:creationTime>
Nov 29 20:26:19 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:26:19 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:26:19 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:26:19 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:26:19 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:26:19 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:26:19 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:26:19 user nova-compute[75356]:       <nova:owner>
Nov 29 20:26:19 user nova-compute[75356]:         <nova:user uuid="ecc96706ae3140ce8816c0e78e116d7d">tempest-AttachVolumeShelveTestJSON-1538416601-project-member</nova:user>
Nov 29 20:26:19 user nova-compute[75356]:         <nova:project uuid="71e99301081a4158bc9d188e2f796350">tempest-AttachVolumeShelveTestJSON-1538416601</nova:project>
Nov 29 20:26:19 user nova-compute[75356]:       </nova:owner>
Nov 29 20:26:19 user nova-compute[75356]:       <nova:root type="image" uuid="597598e6-804f-4f4b-9b95-17f06115115b"/>
Nov 29 20:26:19 user nova-compute[75356]:       <nova:ports>
Nov 29 20:26:19 user nova-compute[75356]:         <nova:port uuid="2273063c-59ad-4c22-baac-b35f81cddd68">
Nov 29 20:26:19 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 20:26:19 user nova-compute[75356]:         </nova:port>
Nov 29 20:26:19 user nova-compute[75356]:       </nova:ports>
Nov 29 20:26:19 user nova-compute[75356]:     </nova:instance>
Nov 29 20:26:19 user nova-compute[75356]:   </metadata>
Nov 29 20:26:19 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:26:19 user nova-compute[75356]:     <system>
Nov 29 20:26:19 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:26:19 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:26:19 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:26:19 user nova-compute[75356]:       <entry name="serial">7982934b-8c0f-4403-8607-2a2679070e02</entry>
Nov 29 20:26:19 user nova-compute[75356]:       <entry name="uuid">7982934b-8c0f-4403-8607-2a2679070e02</entry>
Nov 29 20:26:19 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:26:19 user nova-compute[75356]:     </system>
Nov 29 20:26:19 user nova-compute[75356]:   </sysinfo>
Nov 29 20:26:19 user nova-compute[75356]:   <os>
Nov 29 20:26:19 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:26:19 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:26:19 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:26:19 user nova-compute[75356]:   </os>
Nov 29 20:26:19 user nova-compute[75356]:   <features>
Nov 29 20:26:19 user nova-compute[75356]:     <acpi/>
Nov 29 20:26:19 user nova-compute[75356]:     <apic/>
Nov 29 20:26:19 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:26:19 user nova-compute[75356]:   </features>
Nov 29 20:26:19 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:26:19 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:26:19 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:26:19 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:26:19 user nova-compute[75356]:   </clock>
Nov 29 20:26:19 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:26:19 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:26:19 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:26:19 user nova-compute[75356]:   </cpu>
Nov 29 20:26:19 user nova-compute[75356]:   <devices>
Nov 29 20:26:19 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:26:19 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:26:19 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk"/>
Nov 29 20:26:19 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:26:19 user nova-compute[75356]:     </disk>
Nov 29 20:26:19 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:26:19 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:26:19 user nova-compute[75356]:       <source dev="/dev/sdc"/>
Nov 29 20:26:19 user nova-compute[75356]:       <target dev="vdc" bus="virtio"/>
Nov 29 20:26:19 user nova-compute[75356]:       <serial>33171227-569e-4cbb-99a7-e0b23d6d9eb0</serial>
Nov 29 20:26:19 user nova-compute[75356]:     </disk>
Nov 29 20:26:19 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:26:19 user nova-compute[75356]:       <mac address="fa:16:3e:3f:8c:d9"/>
Nov 29 20:26:19 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:26:19 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:26:19 user nova-compute[75356]:       <target dev="tap2273063c-59"/>
Nov 29 20:26:19 user nova-compute[75356]:     </interface>
Nov 29 20:26:19 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:26:19 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/console.log" append="off"/>
Nov 29 20:26:19 user nova-compute[75356]:     </serial>
Nov 29 20:26:19 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:26:19 user nova-compute[75356]:     <video>
Nov 29 20:26:19 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:26:19 user nova-compute[75356]:     </video>
Nov 29 20:26:19 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:26:19 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:26:19 user nova-compute[75356]:     </rng>
Nov 29 20:26:19 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:26:19 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:26:19 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:26:19 user nova-compute[75356]:     </memballoon>
Nov 29 20:26:19 user nova-compute[75356]:   </devices>
Nov 29 20:26:19 user nova-compute[75356]: </domain>
Nov 29 20:26:19 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:26:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T20:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-859860773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-859860773',id=20,image_ref='597598e6-804f-4f4b-9b95-17f06115115b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1095450286',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:22:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='71e99301081a4158bc9d188e2f796350',ramdisk_id='',reservation_id='r-5mvrbzg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1538416601',owner_user_name='tempest-AttachVolumeShelveTestJSON-1538416601-project-member',shelved_at='2023-11-29T20:24:14.614669',shelved_host='user',shelved_image_id='597598e6-804f-4f4b-9b95-17f06115115b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:26:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecc96706ae3140ce8816c0e78e116d7d',uuid=7982934b-8c0f-4403-8607-2a2679070e02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2273063c-59ad-4c22-baac-b35f81cddd68", "address": "fa:16:3e:3f:8c:d9", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2273063c-59", "ovs_interfaceid": "2273063c-59ad-4c22-baac-b35f81cddd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:26:20 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converting VIF {"id": "2273063c-59ad-4c22-baac-b35f81cddd68", "address": "fa:16:3e:3f:8c:d9", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2273063c-59", "ovs_interfaceid": "2273063c-59ad-4c22-baac-b35f81cddd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:26:20 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:8c:d9,bridge_name='br-int',has_traffic_filtering=True,id=2273063c-59ad-4c22-baac-b35f81cddd68,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2273063c-59') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:26:20 user nova-compute[75356]: DEBUG os_vif [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:8c:d9,bridge_name='br-int',has_traffic_filtering=True,id=2273063c-59ad-4c22-baac-b35f81cddd68,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2273063c-59') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:26:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:26:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:26:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c1366a0-b27b-5498-b084-8196baff2097', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:26:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2273063c-59, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:26:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2273063c-59, col_values=(('qos', UUID('c8c6d567-bf16-41a1-87dc-ddbd028605ca')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:26:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2273063c-59, col_values=(('external_ids', {'iface-id': '2273063c-59ad-4c22-baac-b35f81cddd68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:8c:d9', 'vm-uuid': '7982934b-8c0f-4403-8607-2a2679070e02'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:26:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:26:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:20 user nova-compute[75356]: INFO os_vif [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:8c:d9,bridge_name='br-int',has_traffic_filtering=True,id=2273063c-59ad-4c22-baac-b35f81cddd68,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2273063c-59')
Nov 29 20:26:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:26:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:26:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] No VIF found with MAC fa:16:3e:3f:8c:d9, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:26:21 user nova-compute[75356]: DEBUG nova.compute.manager [req-15f72ee5-21d5-414a-bbb9-545e7a5b62fa req-e0f161e3-99c4-475c-b9ee-8e01f8c87985 service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Received event network-vif-plugged-a9883307-4927-4472-932e-b7a9354d5fe8 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:26:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-15f72ee5-21d5-414a-bbb9-545e7a5b62fa req-e0f161e3-99c4-475c-b9ee-8e01f8c87985 service nova] Acquiring lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-15f72ee5-21d5-414a-bbb9-545e7a5b62fa req-e0f161e3-99c4-475c-b9ee-8e01f8c87985 service nova] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-15f72ee5-21d5-414a-bbb9-545e7a5b62fa req-e0f161e3-99c4-475c-b9ee-8e01f8c87985 service nova] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:21 user nova-compute[75356]: DEBUG nova.compute.manager [req-15f72ee5-21d5-414a-bbb9-545e7a5b62fa req-e0f161e3-99c4-475c-b9ee-8e01f8c87985 service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] No waiting events found dispatching network-vif-plugged-a9883307-4927-4472-932e-b7a9354d5fe8 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:26:21 user nova-compute[75356]: WARNING nova.compute.manager [req-15f72ee5-21d5-414a-bbb9-545e7a5b62fa req-e0f161e3-99c4-475c-b9ee-8e01f8c87985 service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Received unexpected event network-vif-plugged-a9883307-4927-4472-932e-b7a9354d5fe8 for instance with vm_state active and task_state rescuing.
Nov 29 20:26:21 user nova-compute[75356]: DEBUG nova.compute.manager [req-15f72ee5-21d5-414a-bbb9-545e7a5b62fa req-e0f161e3-99c4-475c-b9ee-8e01f8c87985 service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Received event network-vif-plugged-a9883307-4927-4472-932e-b7a9354d5fe8 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:26:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-15f72ee5-21d5-414a-bbb9-545e7a5b62fa req-e0f161e3-99c4-475c-b9ee-8e01f8c87985 service nova] Acquiring lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-15f72ee5-21d5-414a-bbb9-545e7a5b62fa req-e0f161e3-99c4-475c-b9ee-8e01f8c87985 service nova] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-15f72ee5-21d5-414a-bbb9-545e7a5b62fa req-e0f161e3-99c4-475c-b9ee-8e01f8c87985 service nova] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:21 user nova-compute[75356]: DEBUG nova.compute.manager [req-15f72ee5-21d5-414a-bbb9-545e7a5b62fa req-e0f161e3-99c4-475c-b9ee-8e01f8c87985 service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] No waiting events found dispatching network-vif-plugged-a9883307-4927-4472-932e-b7a9354d5fe8 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:26:21 user nova-compute[75356]: WARNING nova.compute.manager [req-15f72ee5-21d5-414a-bbb9-545e7a5b62fa req-e0f161e3-99c4-475c-b9ee-8e01f8c87985 service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Received unexpected event network-vif-plugged-a9883307-4927-4472-932e-b7a9354d5fe8 for instance with vm_state active and task_state rescuing.
Nov 29 20:26:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:22 user nova-compute[75356]: DEBUG nova.compute.manager [None req-736d26ce-8003-4c20-8662-5717893ffa2e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:26:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:23 user nova-compute[75356]: DEBUG nova.compute.manager [req-371c5faf-c6c3-4773-8d2b-eaae1b5c03a1 req-b138096c-30a0-44f0-a79b-7aafc536ba3d service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received event network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:26:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-371c5faf-c6c3-4773-8d2b-eaae1b5c03a1 req-b138096c-30a0-44f0-a79b-7aafc536ba3d service nova] Acquiring lock "7982934b-8c0f-4403-8607-2a2679070e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-371c5faf-c6c3-4773-8d2b-eaae1b5c03a1 req-b138096c-30a0-44f0-a79b-7aafc536ba3d service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-371c5faf-c6c3-4773-8d2b-eaae1b5c03a1 req-b138096c-30a0-44f0-a79b-7aafc536ba3d service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:23 user nova-compute[75356]: DEBUG nova.compute.manager [req-371c5faf-c6c3-4773-8d2b-eaae1b5c03a1 req-b138096c-30a0-44f0-a79b-7aafc536ba3d service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] No waiting events found dispatching network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:26:23 user nova-compute[75356]: WARNING nova.compute.manager [req-371c5faf-c6c3-4773-8d2b-eaae1b5c03a1 req-b138096c-30a0-44f0-a79b-7aafc536ba3d service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received unexpected event network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 20:26:23 user nova-compute[75356]: DEBUG nova.compute.manager [req-371c5faf-c6c3-4773-8d2b-eaae1b5c03a1 req-b138096c-30a0-44f0-a79b-7aafc536ba3d service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received event network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:26:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-371c5faf-c6c3-4773-8d2b-eaae1b5c03a1 req-b138096c-30a0-44f0-a79b-7aafc536ba3d service nova] Acquiring lock "7982934b-8c0f-4403-8607-2a2679070e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-371c5faf-c6c3-4773-8d2b-eaae1b5c03a1 req-b138096c-30a0-44f0-a79b-7aafc536ba3d service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-371c5faf-c6c3-4773-8d2b-eaae1b5c03a1 req-b138096c-30a0-44f0-a79b-7aafc536ba3d service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:23 user nova-compute[75356]: DEBUG nova.compute.manager [req-371c5faf-c6c3-4773-8d2b-eaae1b5c03a1 req-b138096c-30a0-44f0-a79b-7aafc536ba3d service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] No waiting events found dispatching network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:26:23 user nova-compute[75356]: WARNING nova.compute.manager [req-371c5faf-c6c3-4773-8d2b-eaae1b5c03a1 req-b138096c-30a0-44f0-a79b-7aafc536ba3d service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received unexpected event network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 20:26:23 user nova-compute[75356]: DEBUG nova.compute.manager [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:26:23 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:26:23 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Instance spawned successfully.
Nov 29 20:26:23 user nova-compute[75356]: DEBUG nova.compute.manager [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:26:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-11da4e26-7f72-4777-a8b4-445439c09f39 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "7982934b-8c0f-4403-8607-2a2679070e02" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.318s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "36ec2327-b376-49e4-8592-b2a077b79043" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "36ec2327-b376-49e4-8592-b2a077b79043" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "36ec2327-b376-49e4-8592-b2a077b79043-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "36ec2327-b376-49e4-8592-b2a077b79043-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "36ec2327-b376-49e4-8592-b2a077b79043-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:38 user nova-compute[75356]: INFO nova.compute.manager [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Terminating instance
Nov 29 20:26:38 user nova-compute[75356]: DEBUG nova.compute.manager [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:26:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG nova.compute.manager [req-eb5d8ed5-a70c-4aff-b6ac-166aa79351dd req-e1f9c5a8-4fbc-499a-88b2-d1dc46ae4d6e service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Received event network-vif-unplugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-eb5d8ed5-a70c-4aff-b6ac-166aa79351dd req-e1f9c5a8-4fbc-499a-88b2-d1dc46ae4d6e service nova] Acquiring lock "36ec2327-b376-49e4-8592-b2a077b79043-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-eb5d8ed5-a70c-4aff-b6ac-166aa79351dd req-e1f9c5a8-4fbc-499a-88b2-d1dc46ae4d6e service nova] Lock "36ec2327-b376-49e4-8592-b2a077b79043-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-eb5d8ed5-a70c-4aff-b6ac-166aa79351dd req-e1f9c5a8-4fbc-499a-88b2-d1dc46ae4d6e service nova] Lock "36ec2327-b376-49e4-8592-b2a077b79043-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG nova.compute.manager [req-eb5d8ed5-a70c-4aff-b6ac-166aa79351dd req-e1f9c5a8-4fbc-499a-88b2-d1dc46ae4d6e service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] No waiting events found dispatching network-vif-unplugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG nova.compute.manager [req-eb5d8ed5-a70c-4aff-b6ac-166aa79351dd req-e1f9c5a8-4fbc-499a-88b2-d1dc46ae4d6e service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Received event network-vif-unplugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:39 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Instance destroyed successfully.
Nov 29 20:26:39 user nova-compute[75356]: DEBUG nova.objects.instance [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lazy-loading 'resources' on Instance uuid 36ec2327-b376-49e4-8592-b2a077b79043 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T20:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2086140812',display_name='tempest-ServerActionsTestOtherA-server-959033318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2086140812',id=15,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkT9y7rrd/Y5ebvEZ6un5mDuYkh3taeh/2CNWnRGvskqEqjhBdlrCLi3cPcBtL8QdOGFvHh7tZcM81p1N+u4M88CWgTrMXsWASi0tU/5YZzvvrfG6YTm/WptIWFFOdngQ==',key_name='tempest-keypair-24359724',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:23:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b14efb1a4d34a3db7a51bd79234b86b',ramdisk_id='',reservation_id='r-8udz7yf5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1000495362',owner_user_name='tempest-ServerActionsTestOtherA-1000495362-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc7cfc71d0c448cbbe8d42f8b617d8b',uuid=36ec2327-b376-49e4-8592-b2a077b79043,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "address": "fa:16:3e:2c:f4:1f", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb592a6b3-33", "ovs_interfaceid": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converting VIF {"id": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "address": "fa:16:3e:2c:f4:1f", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb592a6b3-33", "ovs_interfaceid": "b592a6b3-336d-4af0-ac33-8aa5f050fe9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:f4:1f,bridge_name='br-int',has_traffic_filtering=True,id=b592a6b3-336d-4af0-ac33-8aa5f050fe9e,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb592a6b3-33') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG os_vif [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:f4:1f,bridge_name='br-int',has_traffic_filtering=True,id=b592a6b3-336d-4af0-ac33-8aa5f050fe9e,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb592a6b3-33') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb592a6b3-33, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7129f86-5da0-4e33-859f-929c0a832b9c) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:39 user nova-compute[75356]: INFO os_vif [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:f4:1f,bridge_name='br-int',has_traffic_filtering=True,id=b592a6b3-336d-4af0-ac33-8aa5f050fe9e,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb592a6b3-33')
Nov 29 20:26:39 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Deleting instance files /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043_del
Nov 29 20:26:39 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Deletion of /opt/stack/data/nova/instances/36ec2327-b376-49e4-8592-b2a077b79043_del complete
Nov 29 20:26:39 user nova-compute[75356]: INFO nova.compute.manager [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 29 20:26:39 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:26:39 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:26:41 user nova-compute[75356]: DEBUG nova.compute.manager [req-c0df3aa9-e262-4771-9f97-366068daa13e req-ee06ac68-3284-4853-862d-bc8c6f8133c2 service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Received event network-vif-plugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:26:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c0df3aa9-e262-4771-9f97-366068daa13e req-ee06ac68-3284-4853-862d-bc8c6f8133c2 service nova] Acquiring lock "36ec2327-b376-49e4-8592-b2a077b79043-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c0df3aa9-e262-4771-9f97-366068daa13e req-ee06ac68-3284-4853-862d-bc8c6f8133c2 service nova] Lock "36ec2327-b376-49e4-8592-b2a077b79043-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c0df3aa9-e262-4771-9f97-366068daa13e req-ee06ac68-3284-4853-862d-bc8c6f8133c2 service nova] Lock "36ec2327-b376-49e4-8592-b2a077b79043-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:41 user nova-compute[75356]: DEBUG nova.compute.manager [req-c0df3aa9-e262-4771-9f97-366068daa13e req-ee06ac68-3284-4853-862d-bc8c6f8133c2 service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] No waiting events found dispatching network-vif-plugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:26:41 user nova-compute[75356]: WARNING nova.compute.manager [req-c0df3aa9-e262-4771-9f97-366068daa13e req-ee06ac68-3284-4853-862d-bc8c6f8133c2 service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Received unexpected event network-vif-plugged-b592a6b3-336d-4af0-ac33-8aa5f050fe9e for instance with vm_state active and task_state deleting.
Nov 29 20:26:41 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:26:41 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Took 1.75 seconds to deallocate network for instance.
Nov 29 20:26:41 user nova-compute[75356]: DEBUG nova.compute.manager [req-2eda0981-5d0b-474e-b64c-613604289bee req-8ce79aa3-7a5c-45db-a521-72fd13212671 service nova] [instance: 36ec2327-b376-49e4-8592-b2a077b79043] Received event network-vif-deleted-b592a6b3-336d-4af0-ac33-8aa5f050fe9e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:26:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:41 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:26:41 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:26:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:42 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Deleted allocations for instance 36ec2327-b376-49e4-8592-b2a077b79043
Nov 29 20:26:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70835010-6387-4540-9929-1a0b294ea1f3 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "36ec2327-b376-49e4-8592-b2a077b79043" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.280s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG nova.compute.manager [req-fb79d8a7-2620-4f77-9bdc-9fb9fd712d6f req-51226a7b-36e9-4ed0-afa3-1087ee83b2cd service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Received event network-changed-cca86ef6-13ce-4177-b51b-266014d38e93 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG nova.compute.manager [req-fb79d8a7-2620-4f77-9bdc-9fb9fd712d6f req-51226a7b-36e9-4ed0-afa3-1087ee83b2cd service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Refreshing instance network info cache due to event network-changed-cca86ef6-13ce-4177-b51b-266014d38e93. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-fb79d8a7-2620-4f77-9bdc-9fb9fd712d6f req-51226a7b-36e9-4ed0-afa3-1087ee83b2cd service nova] Acquiring lock "refresh_cache-6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-fb79d8a7-2620-4f77-9bdc-9fb9fd712d6f req-51226a7b-36e9-4ed0-afa3-1087ee83b2cd service nova] Acquired lock "refresh_cache-6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG nova.network.neutron [req-fb79d8a7-2620-4f77-9bdc-9fb9fd712d6f req-51226a7b-36e9-4ed0-afa3-1087ee83b2cd service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Refreshing network info cache for port cca86ef6-13ce-4177-b51b-266014d38e93 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG nova.objects.instance [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lazy-loading 'flavor' on Instance uuid 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:26:44 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Ignoring supplied device name: /dev/vdb
Nov 29 20:26:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:44 user nova-compute[75356]: INFO nova.compute.manager [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Attaching volume 3db80868-93f8-440f-9b0c-fdce8340e5b4 to /dev/vdb
Nov 29 20:26:44 user nova-compute[75356]: DEBUG os_brick.utils [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd2031f-4597-4404-8d53-d417ed123347]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[784aeb7d-0547-459c-a19f-b0d53245ca2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd297d6e-0290-451a-96ff-e19ec9d550fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[58044773-c428-4f35-a32f-36115a9560d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:26:44 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:26:44 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[185ebbfd-992d-4142-847d-46dc273f397e]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG os_brick.utils [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:26:44 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Updating existing volume attachment record: 9270cae5-3fe0-4417-887d-1fdbf740d6ec {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:26:45 user nova-compute[75356]: DEBUG nova.network.neutron [req-fb79d8a7-2620-4f77-9bdc-9fb9fd712d6f req-51226a7b-36e9-4ed0-afa3-1087ee83b2cd service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Updated VIF entry in instance network info cache for port cca86ef6-13ce-4177-b51b-266014d38e93. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:26:45 user nova-compute[75356]: DEBUG nova.network.neutron [req-fb79d8a7-2620-4f77-9bdc-9fb9fd712d6f req-51226a7b-36e9-4ed0-afa3-1087ee83b2cd service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Updating instance_info_cache with network_info: [{"id": "cca86ef6-13ce-4177-b51b-266014d38e93", "address": "fa:16:3e:f9:6e:16", "network": {"id": "c1768664-edc2-4213-80e3-64f7600eeb75", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688549704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85535b509efe4dbb81c372f9031faac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca86ef6-13", "ovs_interfaceid": "cca86ef6-13ce-4177-b51b-266014d38e93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:26:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-fb79d8a7-2620-4f77-9bdc-9fb9fd712d6f req-51226a7b-36e9-4ed0-afa3-1087ee83b2cd service nova] Releasing lock "refresh_cache-6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:26:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:47 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:26:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:47 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:26:47 user nova-compute[75356]: INFO nova.compute.claims [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Claim successful on node user
Nov 29 20:26:48 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:26:48 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:26:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:48 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:26:48 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:26:48 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:26:48 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:26:48 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:26:48 user nova-compute[75356]: DEBUG nova.policy [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbdba4f436df4dbb896258c4f4d6b180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076539532d4847719e7fcf4165872bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:26:48 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:26:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:26:48 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Creating image(s)
Nov 29 20:26:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "/opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "/opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:48 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:48 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.253s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:48 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:48 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.174s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:48 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:48 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk 1073741824" returned: 0 in 0.054s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.208s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:49 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:26:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:49 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Cannot resize image /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:26:49 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:26:49 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Ensure instance console log exists: /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:26:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:49 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Successfully created port: 8356e667-97df-4ba5-9f55-ed78fd4f4736 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:26:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Successfully updated port: 8356e667-97df-4ba5-9f55-ed78fd4f4736 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "refresh_cache-ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquired lock "refresh_cache-ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.compute.manager [req-91882477-c97e-4a2a-9fca-6edfbb91485f req-e65cf26a-5be7-4f23-9f8a-8141a23711c1 service nova] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Received event network-changed-8356e667-97df-4ba5-9f55-ed78fd4f4736 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.compute.manager [req-91882477-c97e-4a2a-9fca-6edfbb91485f req-e65cf26a-5be7-4f23-9f8a-8141a23711c1 service nova] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Refreshing instance network info cache due to event network-changed-8356e667-97df-4ba5-9f55-ed78fd4f4736. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-91882477-c97e-4a2a-9fca-6edfbb91485f req-e65cf26a-5be7-4f23-9f8a-8141a23711c1 service nova] Acquiring lock "refresh_cache-ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Updating instance_info_cache with network_info: [{"id": "8356e667-97df-4ba5-9f55-ed78fd4f4736", "address": "fa:16:3e:1d:8d:b3", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8356e667-97", "ovs_interfaceid": "8356e667-97df-4ba5-9f55-ed78fd4f4736", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Releasing lock "refresh_cache-ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Instance network_info: |[{"id": "8356e667-97df-4ba5-9f55-ed78fd4f4736", "address": "fa:16:3e:1d:8d:b3", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8356e667-97", "ovs_interfaceid": "8356e667-97df-4ba5-9f55-ed78fd4f4736", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-91882477-c97e-4a2a-9fca-6edfbb91485f req-e65cf26a-5be7-4f23-9f8a-8141a23711c1 service nova] Acquired lock "refresh_cache-ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.network.neutron [req-91882477-c97e-4a2a-9fca-6edfbb91485f req-e65cf26a-5be7-4f23-9f8a-8141a23711c1 service nova] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Refreshing network info cache for port 8356e667-97df-4ba5-9f55-ed78fd4f4736 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Start _get_guest_xml network_info=[{"id": "8356e667-97df-4ba5-9f55-ed78fd4f4736", "address": "fa:16:3e:1d:8d:b3", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8356e667-97", "ovs_interfaceid": "8356e667-97df-4ba5-9f55-ed78fd4f4736", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:26:50 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:26:50 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:26:50 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:26:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1106581222',display_name='tempest-AttachVolumeNegativeTest-server-1106581222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1106581222',id=28,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrClDax9w/BZQtjtEMfxBjEFdbLgotDQbxwxKbfhEGLpZlUzTX5Y1WIF+iYbGM9fPZvzjUYX81Z5kzYFI32po2s3igv/rUV3xMR7WLOiFtqRTmxBLI8we7T6MblZBEx2g==',key_name='tempest-keypair-526946861',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='076539532d4847719e7fcf4165872bbe',ramdisk_id='',reservation_id='r-maaq534h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1182074567',owner_user_name='tempest-AttachVolumeNegativeTest-1182074567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:26:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbdba4f436df4dbb896258c4f4d6b180',uuid=ee5bef74-04c5-4de1-8f8e-4baba05e2a6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8356e667-97df-4ba5-9f55-ed78fd4f4736", "address": "fa:16:3e:1d:8d:b3", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8356e667-97", "ovs_interfaceid": "8356e667-97df-4ba5-9f55-ed78fd4f4736", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converting VIF {"id": "8356e667-97df-4ba5-9f55-ed78fd4f4736", "address": "fa:16:3e:1d:8d:b3", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8356e667-97", "ovs_interfaceid": "8356e667-97df-4ba5-9f55-ed78fd4f4736", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:8d:b3,bridge_name='br-int',has_traffic_filtering=True,id=8356e667-97df-4ba5-9f55-ed78fd4f4736,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8356e667-97') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG nova.objects.instance [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lazy-loading 'pci_devices' on Instance uuid ee5bef74-04c5-4de1-8f8e-4baba05e2a6d {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:26:51 user nova-compute[75356]:   <uuid>ee5bef74-04c5-4de1-8f8e-4baba05e2a6d</uuid>
Nov 29 20:26:51 user nova-compute[75356]:   <name>instance-0000001c</name>
Nov 29 20:26:51 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:26:51 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:26:51 user nova-compute[75356]:   <metadata>
Nov 29 20:26:51 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:26:51 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:26:51 user nova-compute[75356]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1106581222</nova:name>
Nov 29 20:26:51 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:26:50</nova:creationTime>
Nov 29 20:26:51 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:26:51 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:26:51 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:26:51 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:26:51 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:26:51 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:26:51 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:26:51 user nova-compute[75356]:       <nova:owner>
Nov 29 20:26:51 user nova-compute[75356]:         <nova:user uuid="cbdba4f436df4dbb896258c4f4d6b180">tempest-AttachVolumeNegativeTest-1182074567-project-member</nova:user>
Nov 29 20:26:51 user nova-compute[75356]:         <nova:project uuid="076539532d4847719e7fcf4165872bbe">tempest-AttachVolumeNegativeTest-1182074567</nova:project>
Nov 29 20:26:51 user nova-compute[75356]:       </nova:owner>
Nov 29 20:26:51 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:26:51 user nova-compute[75356]:       <nova:ports>
Nov 29 20:26:51 user nova-compute[75356]:         <nova:port uuid="8356e667-97df-4ba5-9f55-ed78fd4f4736">
Nov 29 20:26:51 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 20:26:51 user nova-compute[75356]:         </nova:port>
Nov 29 20:26:51 user nova-compute[75356]:       </nova:ports>
Nov 29 20:26:51 user nova-compute[75356]:     </nova:instance>
Nov 29 20:26:51 user nova-compute[75356]:   </metadata>
Nov 29 20:26:51 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:26:51 user nova-compute[75356]:     <system>
Nov 29 20:26:51 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:26:51 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:26:51 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:26:51 user nova-compute[75356]:       <entry name="serial">ee5bef74-04c5-4de1-8f8e-4baba05e2a6d</entry>
Nov 29 20:26:51 user nova-compute[75356]:       <entry name="uuid">ee5bef74-04c5-4de1-8f8e-4baba05e2a6d</entry>
Nov 29 20:26:51 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:26:51 user nova-compute[75356]:     </system>
Nov 29 20:26:51 user nova-compute[75356]:   </sysinfo>
Nov 29 20:26:51 user nova-compute[75356]:   <os>
Nov 29 20:26:51 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:26:51 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:26:51 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:26:51 user nova-compute[75356]:   </os>
Nov 29 20:26:51 user nova-compute[75356]:   <features>
Nov 29 20:26:51 user nova-compute[75356]:     <acpi/>
Nov 29 20:26:51 user nova-compute[75356]:     <apic/>
Nov 29 20:26:51 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:26:51 user nova-compute[75356]:   </features>
Nov 29 20:26:51 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:26:51 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:26:51 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:26:51 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:26:51 user nova-compute[75356]:   </clock>
Nov 29 20:26:51 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:26:51 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:26:51 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:26:51 user nova-compute[75356]:   </cpu>
Nov 29 20:26:51 user nova-compute[75356]:   <devices>
Nov 29 20:26:51 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:26:51 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:26:51 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk"/>
Nov 29 20:26:51 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:26:51 user nova-compute[75356]:     </disk>
Nov 29 20:26:51 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:26:51 user nova-compute[75356]:       <mac address="fa:16:3e:1d:8d:b3"/>
Nov 29 20:26:51 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:26:51 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:26:51 user nova-compute[75356]:       <target dev="tap8356e667-97"/>
Nov 29 20:26:51 user nova-compute[75356]:     </interface>
Nov 29 20:26:51 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:26:51 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/console.log" append="off"/>
Nov 29 20:26:51 user nova-compute[75356]:     </serial>
Nov 29 20:26:51 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:26:51 user nova-compute[75356]:     <video>
Nov 29 20:26:51 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:26:51 user nova-compute[75356]:     </video>
Nov 29 20:26:51 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:26:51 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:26:51 user nova-compute[75356]:     </rng>
Nov 29 20:26:51 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:26:51 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:26:51 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:26:51 user nova-compute[75356]:     </memballoon>
Nov 29 20:26:51 user nova-compute[75356]:   </devices>
Nov 29 20:26:51 user nova-compute[75356]: </domain>
Nov 29 20:26:51 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:26:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1106581222',display_name='tempest-AttachVolumeNegativeTest-server-1106581222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1106581222',id=28,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrClDax9w/BZQtjtEMfxBjEFdbLgotDQbxwxKbfhEGLpZlUzTX5Y1WIF+iYbGM9fPZvzjUYX81Z5kzYFI32po2s3igv/rUV3xMR7WLOiFtqRTmxBLI8we7T6MblZBEx2g==',key_name='tempest-keypair-526946861',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='076539532d4847719e7fcf4165872bbe',ramdisk_id='',reservation_id='r-maaq534h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1182074567',owner_user_name='tempest-AttachVolumeNegativeTest-1182074567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:26:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbdba4f436df4dbb896258c4f4d6b180',uuid=ee5bef74-04c5-4de1-8f8e-4baba05e2a6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8356e667-97df-4ba5-9f55-ed78fd4f4736", "address": "fa:16:3e:1d:8d:b3", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8356e667-97", "ovs_interfaceid": "8356e667-97df-4ba5-9f55-ed78fd4f4736", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converting VIF {"id": "8356e667-97df-4ba5-9f55-ed78fd4f4736", "address": "fa:16:3e:1d:8d:b3", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8356e667-97", "ovs_interfaceid": "8356e667-97df-4ba5-9f55-ed78fd4f4736", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:8d:b3,bridge_name='br-int',has_traffic_filtering=True,id=8356e667-97df-4ba5-9f55-ed78fd4f4736,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8356e667-97') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG os_vif [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:8d:b3,bridge_name='br-int',has_traffic_filtering=True,id=8356e667-97df-4ba5-9f55-ed78fd4f4736,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8356e667-97') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95228af1-ee50-5308-bb1e-5d0591848a55', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8356e667-97, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8356e667-97, col_values=(('qos', UUID('a2ad7960-7d3d-4d9e-8f03-b3a4941c51c9')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8356e667-97, col_values=(('external_ids', {'iface-id': '8356e667-97df-4ba5-9f55-ed78fd4f4736', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:8d:b3', 'vm-uuid': 'ee5bef74-04c5-4de1-8f8e-4baba05e2a6d'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:51 user nova-compute[75356]: INFO os_vif [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:8d:b3,bridge_name='br-int',has_traffic_filtering=True,id=8356e667-97df-4ba5-9f55-ed78fd4f4736,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8356e667-97')
Nov 29 20:26:51 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] No VIF found with MAC fa:16:3e:1d:8d:b3, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG nova.network.neutron [req-91882477-c97e-4a2a-9fca-6edfbb91485f req-e65cf26a-5be7-4f23-9f8a-8141a23711c1 service nova] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Updated VIF entry in instance network info cache for port 8356e667-97df-4ba5-9f55-ed78fd4f4736. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG nova.network.neutron [req-91882477-c97e-4a2a-9fca-6edfbb91485f req-e65cf26a-5be7-4f23-9f8a-8141a23711c1 service nova] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Updating instance_info_cache with network_info: [{"id": "8356e667-97df-4ba5-9f55-ed78fd4f4736", "address": "fa:16:3e:1d:8d:b3", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8356e667-97", "ovs_interfaceid": "8356e667-97df-4ba5-9f55-ed78fd4f4736", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:26:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-91882477-c97e-4a2a-9fca-6edfbb91485f req-e65cf26a-5be7-4f23-9f8a-8141a23711c1 service nova] Releasing lock "refresh_cache-ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:26:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:53 user nova-compute[75356]: DEBUG nova.compute.manager [req-d5a186b0-5fc6-4a55-97fb-b91e82433759 req-5690a989-d3fa-4922-b9f6-8aba41fb2bf1 service nova] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Received event network-vif-plugged-8356e667-97df-4ba5-9f55-ed78fd4f4736 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:26:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d5a186b0-5fc6-4a55-97fb-b91e82433759 req-5690a989-d3fa-4922-b9f6-8aba41fb2bf1 service nova] Acquiring lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d5a186b0-5fc6-4a55-97fb-b91e82433759 req-5690a989-d3fa-4922-b9f6-8aba41fb2bf1 service nova] Lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d5a186b0-5fc6-4a55-97fb-b91e82433759 req-5690a989-d3fa-4922-b9f6-8aba41fb2bf1 service nova] Lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:53 user nova-compute[75356]: DEBUG nova.compute.manager [req-d5a186b0-5fc6-4a55-97fb-b91e82433759 req-5690a989-d3fa-4922-b9f6-8aba41fb2bf1 service nova] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] No waiting events found dispatching network-vif-plugged-8356e667-97df-4ba5-9f55-ed78fd4f4736 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:26:53 user nova-compute[75356]: WARNING nova.compute.manager [req-d5a186b0-5fc6-4a55-97fb-b91e82433759 req-5690a989-d3fa-4922-b9f6-8aba41fb2bf1 service nova] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Received unexpected event network-vif-plugged-8356e667-97df-4ba5-9f55-ed78fd4f4736 for instance with vm_state building and task_state spawning.
Nov 29 20:26:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:55 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:26:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:26:55 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Instance spawned successfully.
Nov 29 20:26:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:26:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:26:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:26:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:26:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:26:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:26:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:26:55 user nova-compute[75356]: DEBUG nova.compute.manager [req-126eb249-bdf5-4c13-a23b-5eca410cd16c req-55b45828-847d-4d01-80e7-598994baa735 service nova] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Received event network-vif-plugged-8356e667-97df-4ba5-9f55-ed78fd4f4736 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:26:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-126eb249-bdf5-4c13-a23b-5eca410cd16c req-55b45828-847d-4d01-80e7-598994baa735 service nova] Acquiring lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-126eb249-bdf5-4c13-a23b-5eca410cd16c req-55b45828-847d-4d01-80e7-598994baa735 service nova] Lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-126eb249-bdf5-4c13-a23b-5eca410cd16c req-55b45828-847d-4d01-80e7-598994baa735 service nova] Lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:55 user nova-compute[75356]: DEBUG nova.compute.manager [req-126eb249-bdf5-4c13-a23b-5eca410cd16c req-55b45828-847d-4d01-80e7-598994baa735 service nova] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] No waiting events found dispatching network-vif-plugged-8356e667-97df-4ba5-9f55-ed78fd4f4736 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:26:55 user nova-compute[75356]: WARNING nova.compute.manager [req-126eb249-bdf5-4c13-a23b-5eca410cd16c req-55b45828-847d-4d01-80e7-598994baa735 service nova] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Received unexpected event network-vif-plugged-8356e667-97df-4ba5-9f55-ed78fd4f4736 for instance with vm_state building and task_state spawning.
Nov 29 20:26:55 user nova-compute[75356]: INFO nova.compute.manager [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Took 6.72 seconds to spawn the instance on the hypervisor.
Nov 29 20:26:55 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:26:55 user nova-compute[75356]: INFO nova.compute.manager [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Took 7.51 seconds to build instance.
Nov 29 20:26:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ad37af45-6823-498c-b057-864d1e07c259 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.676s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:56 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:26:57 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:26:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRiclvpu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:26:58 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:26:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:26:58 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:26:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:26:58 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[114ae51d-bbe2-4e96-962f-a1a90ec26fd8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:26:58 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe203a8c-cdb0-4122-b9a7-e0731921bf3a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4] added
Nov 29 20:26:58 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2106dbf9-ff7e-4074-bfb3-4cc803cb19de]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d97ebab-080c-484f-996b-3d5351508d26]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TRiclvpu {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TRiclvpu" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d19de1-d5c5-4ece-b027-55e33e36f9d4]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TRiclvpu'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0390190-6e80-453c-a0e7-278e0b609e05]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b33b94-985f-4554-ae30-fae61597982b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:26:58 user nova-compute[75356]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)
Nov 29 20:26:58 user nova-compute[75356]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 (non-flash)
Nov 29 20:26:58 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:26:58 user nova-compute[75356]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)
Nov 29 20:26:58 user nova-compute[75356]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 (non-flash)
Nov 29 20:26:58 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bd7676-3e77-42de-b018-99b854884fb1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4, portal: 172.16.0.220,3260]
Nov 29 20:26:58 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4, portal: 172.16.0.220,3260] successful.
Nov 29 20:26:58 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c109aa-de25-435d-84de-dd53bc2fce5b]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4778d21-e5f1-472a-a08a-d551ea3d9879]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:26:58 user nova-compute[75356]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)
Nov 29 20:26:58 user nova-compute[75356]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 (non-flash)
Nov 29 20:26:58 user nova-compute[75356]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 (non-flash)
Nov 29 20:26:58 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:26:58 user nova-compute[75356]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)
Nov 29 20:26:58 user nova-compute[75356]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 (non-flash)
Nov 29 20:26:58 user nova-compute[75356]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 (non-flash)
Nov 29 20:26:58 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc120ca-7845-4c30-a932-7fd0119ce0ac]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:26:58 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: None {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:26:59 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Updating instance_info_cache with network_info: [{"id": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "address": "fa:16:3e:6b:b2:4e", "network": {"id": "27a8d395-36c8-4f27-89cf-f5019ccbf9a2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45448e5cb4e84c14b1114846a6ccbdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ec4756-3f", "ovs_interfaceid": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:26:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:26:59 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:26:59 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:26:59 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:26:59 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:26:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:26:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:26:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:26:59 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:26:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:26:59 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:26:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRiclvpu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:26:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:26:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '26265616431363563', 'path': '/dev/sde'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:26:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265616431363563', 'path': '/dev/sde'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:27:00 user nova-compute[75356]: DEBUG nova.objects.instance [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lazy-loading 'flavor' on Instance uuid 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:27:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk --force-share --output=json" returned: 0 in 0.438s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:27:00 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:27:00 user nova-compute[75356]:   <source dev="/dev/sde"/>
Nov 29 20:27:00 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:27:00 user nova-compute[75356]:   <serial>3db80868-93f8-440f-9b0c-fdce8340e5b4</serial>
Nov 29 20:27:00 user nova-compute[75356]: </disk>
Nov 29 20:27:00 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:27:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:27:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:27:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:27:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] No VIF found with MAC fa:16:3e:f9:6e:16, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:27:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6ed7efcd-aac9-4e1d-8f93-25d99ef7f16d tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.188s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:27:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:27:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:27:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.236s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:27:04 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:27:04 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:27:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=7384MB free_disk=25.12059783935547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:27:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:27:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:27:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0b59517a-c467-432a-a73a-d1460c1574e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:27:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:27:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance db0826f0-5fdc-47a8-ae36-5059844980c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:27:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:27:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 93183110-d2e2-4da7-ab7d-73378f5e0d42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:27:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:27:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4327336c-e3a9-4b8d-abc2-6438487b2296 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:27:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:27:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 7982934b-8c0f-4403-8607-2a2679070e02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:27:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ee5bef74-04c5-4de1-8f8e-4baba05e2a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:27:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:27:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:27:05 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:27:05 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:27:05 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:27:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.564s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:27:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:07 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:27:07 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:27:07 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:27:07 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:27:07 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:27:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "4327336c-e3a9-4b8d-abc2-6438487b2296" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:27:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "4327336c-e3a9-4b8d-abc2-6438487b2296" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:27:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:27:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:27:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:27:17 user nova-compute[75356]: INFO nova.compute.manager [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Terminating instance
Nov 29 20:27:17 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:27:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:17 user nova-compute[75356]: DEBUG nova.compute.manager [req-bff067ef-0987-43e2-9a64-d118e1395022 req-c38d709b-4b5e-4ab6-b5e4-4d31f4f60efb service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Received event network-vif-unplugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:27:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-bff067ef-0987-43e2-9a64-d118e1395022 req-c38d709b-4b5e-4ab6-b5e4-4d31f4f60efb service nova] Acquiring lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:27:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-bff067ef-0987-43e2-9a64-d118e1395022 req-c38d709b-4b5e-4ab6-b5e4-4d31f4f60efb service nova] Lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:27:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-bff067ef-0987-43e2-9a64-d118e1395022 req-c38d709b-4b5e-4ab6-b5e4-4d31f4f60efb service nova] Lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:27:17 user nova-compute[75356]: DEBUG nova.compute.manager [req-bff067ef-0987-43e2-9a64-d118e1395022 req-c38d709b-4b5e-4ab6-b5e4-4d31f4f60efb service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] No waiting events found dispatching network-vif-unplugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:27:17 user nova-compute[75356]: DEBUG nova.compute.manager [req-bff067ef-0987-43e2-9a64-d118e1395022 req-c38d709b-4b5e-4ab6-b5e4-4d31f4f60efb service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Received event network-vif-unplugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:27:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:18 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Instance destroyed successfully.
Nov 29 20:27:18 user nova-compute[75356]: DEBUG nova.objects.instance [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lazy-loading 'resources' on Instance uuid 4327336c-e3a9-4b8d-abc2-6438487b2296 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:25:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-66871523',display_name='tempest-TestVolumeBootPattern-server-66871523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-66871523',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:25:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6791b0c999846e2a22d5735f91ea1aa',ramdisk_id='',reservation_id='r-gap3vlnq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1627976633',owner_user_name='tempest-TestVolumeBootPattern-1627976633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:25:46Z,user_data=None,user_id='081b00360a204be3bd6435807283f230',uuid=4327336c-e3a9-4b8d-abc2-6438487b2296,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88462d48-a60f-4fc6-95f4-7c7f4c52bda1", "address": "fa:16:3e:b9:ff:5b", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88462d48-a6", "ovs_interfaceid": "88462d48-a60f-4fc6-95f4-7c7f4c52bda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converting VIF {"id": "88462d48-a60f-4fc6-95f4-7c7f4c52bda1", "address": "fa:16:3e:b9:ff:5b", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88462d48-a6", "ovs_interfaceid": "88462d48-a60f-4fc6-95f4-7c7f4c52bda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ff:5b,bridge_name='br-int',has_traffic_filtering=True,id=88462d48-a60f-4fc6-95f4-7c7f4c52bda1,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88462d48-a6') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG os_vif [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ff:5b,bridge_name='br-int',has_traffic_filtering=True,id=88462d48-a60f-4fc6-95f4-7c7f4c52bda1,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88462d48-a6') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88462d48-a6, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bdab9c6f-b448-413f-9174-e85a6724b316) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:18 user nova-compute[75356]: INFO os_vif [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:ff:5b,bridge_name='br-int',has_traffic_filtering=True,id=88462d48-a60f-4fc6-95f4-7c7f4c52bda1,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88462d48-a6')
Nov 29 20:27:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gIJSELvu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:27:18 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:27:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c528a354-7b70-4b22-9c39-23e397007d98]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:27:18 user nova-compute[75356]: No targets found.
Nov 29 20:27:18 user nova-compute[75356]: iSNS:
Nov 29 20:27:18 user nova-compute[75356]: No targets found.
Nov 29 20:27:18 user nova-compute[75356]: STATIC:
Nov 29 20:27:18 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29
Nov 29 20:27:18 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:27:18 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:27:18 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4
Nov 29 20:27:18 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:27:18 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:27:18 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0
Nov 29 20:27:18 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:27:18 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:27:18 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:27:18 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:27:18 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:27:18 user nova-compute[75356]: FIRMWARE:
Nov 29 20:27:18 user nova-compute[75356]: No targets found.
Nov 29 20:27:18 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:27:18 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:27:18 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[889b7aab-7972-4c00-94d0-3dc6057e28d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[073fd318-6816-4bb3-a423-6e172c1c2eb5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:27:18 user nova-compute[75356]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)
Nov 29 20:27:18 user nova-compute[75356]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 (non-flash)
Nov 29 20:27:18 user nova-compute[75356]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 (non-flash)
Nov 29 20:27:18 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:27:18 user nova-compute[75356]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 (non-flash)
Nov 29 20:27:18 user nova-compute[75356]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 (non-flash)
Nov 29 20:27:18 user nova-compute[75356]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 (non-flash)
Nov 29 20:27:18 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e443bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29'): ({'sdd'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Removing single pathed devices sdd {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01b6bdd-ff2c-456c-bd91-488cfa7262f2]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6ad2be-4396-4ea3-b144-15ab953d7da0]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Flushing IO for device /dev/sdd {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f095679-3087-438e-a883-f94e51dc7cc5]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e7127d-3ecb-43ed-ab92-4e61c82ae3fa]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] SCSI volumes sdd have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef9662e-1b87-4b84-ba32-0fe29fbfe087]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2ae6a4-4b96-4f40-aabb-e7bde17d9786]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29, portal: 172.16.0.220,3260]
Nov 29 20:27:18 user nova-compute[75356]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29, portal: 172.16.0.220,3260] successful.
Nov 29 20:27:18 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a060804-6451-4445-980c-67c654cd961f]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.433s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] <== disconnect_volume: return (435ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:27:18 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Deleting instance files /opt/stack/data/nova/instances/4327336c-e3a9-4b8d-abc2-6438487b2296_del
Nov 29 20:27:18 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Deletion of /opt/stack/data/nova/instances/4327336c-e3a9-4b8d-abc2-6438487b2296_del complete
Nov 29 20:27:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:18 user nova-compute[75356]: INFO nova.compute.manager [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Took 1.55 seconds to destroy the instance on the hypervisor.
Nov 29 20:27:18 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:27:19 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Took 0.69 seconds to deallocate network for instance.
Nov 29 20:27:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Received event network-vif-plugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] Acquiring lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] Lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] Lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] No waiting events found dispatching network-vif-plugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:27:19 user nova-compute[75356]: WARNING nova.compute.manager [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Received unexpected event network-vif-plugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 for instance with vm_state active and task_state deleting.
Nov 29 20:27:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Received event network-vif-plugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] Acquiring lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] Lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] Lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] No waiting events found dispatching network-vif-plugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:27:19 user nova-compute[75356]: WARNING nova.compute.manager [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Received unexpected event network-vif-plugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 for instance with vm_state active and task_state deleting.
Nov 29 20:27:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Received event network-vif-plugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] Acquiring lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] Lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] Lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] No waiting events found dispatching network-vif-plugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:27:19 user nova-compute[75356]: WARNING nova.compute.manager [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Received unexpected event network-vif-plugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 for instance with vm_state active and task_state deleting.
Nov 29 20:27:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Received event network-vif-unplugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] Acquiring lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] Lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] Lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] No waiting events found dispatching network-vif-unplugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Received event network-vif-unplugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Received event network-vif-plugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] Acquiring lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] Lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] Lock "4327336c-e3a9-4b8d-abc2-6438487b2296-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:27:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] No waiting events found dispatching network-vif-plugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:27:19 user nova-compute[75356]: WARNING nova.compute.manager [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Received unexpected event network-vif-plugged-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 for instance with vm_state active and task_state deleting.
Nov 29 20:27:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-c3844cab-2563-429c-a8ba-2d8716a2141c req-285c1cc1-f2ce-489b-a330-0f12bd8579b3 service nova] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Received event network-vif-deleted-88462d48-a60f-4fc6-95f4-7c7f4c52bda1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:27:20 user nova-compute[75356]: INFO nova.compute.manager [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Took 1.01 seconds to detach 1 volumes for instance.
Nov 29 20:27:20 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 4327336c-e3a9-4b8d-abc2-6438487b2296] Deleting volume: 7e5b50cb-41fb-4c10-90dd-6c54f1fcef29 {{(pid=75356) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 20:27:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:27:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:27:21 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:27:21 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:27:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:27:21 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Deleted allocations for instance 4327336c-e3a9-4b8d-abc2-6438487b2296
Nov 29 20:27:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d35a08a7-585a-4723-9bfa-59e781b7461d tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "4327336c-e3a9-4b8d-abc2-6438487b2296" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.881s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:27:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:27:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:27:34 user nova-compute[75356]: INFO nova.compute.manager [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Detaching volume 3db80868-93f8-440f-9b0c-fdce8340e5b4
Nov 29 20:27:34 user nova-compute[75356]: INFO nova.virt.block_device [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Attempting to driver detach volume 3db80868-93f8-440f-9b0c-fdce8340e5b4 from mountpoint /dev/vdb
Nov 29 20:27:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Attempting to detach device vdb from instance 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:27:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:27:35 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:27:35 user nova-compute[75356]:   <source dev="/dev/sde"/>
Nov 29 20:27:35 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:27:35 user nova-compute[75356]:   <serial>3db80868-93f8-440f-9b0c-fdce8340e5b4</serial>
Nov 29 20:27:35 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:27:35 user nova-compute[75356]: </disk>
Nov 29 20:27:35 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:27:35 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Successfully detached device vdb from instance 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f from the persistent domain config.
Nov 29 20:27:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:27:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:27:35 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:27:35 user nova-compute[75356]:   <source dev="/dev/sde"/>
Nov 29 20:27:35 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:27:35 user nova-compute[75356]:   <serial>3db80868-93f8-440f-9b0c-fdce8340e5b4</serial>
Nov 29 20:27:35 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:27:35 user nova-compute[75356]: </disk>
Nov 29 20:27:35 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:27:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:27:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:27:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:27:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:27:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:27:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:27:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:42 user nova-compute[75356]: DEBUG nova.compute.manager [None req-adfb4eca-bff9-4d01-bf4a-7d8003709ec5 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:27:42 user nova-compute[75356]: INFO nova.compute.manager [None req-adfb4eca-bff9-4d01-bf4a-7d8003709ec5 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] instance snapshotting
Nov 29 20:27:42 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-adfb4eca-bff9-4d01-bf4a-7d8003709ec5 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Beginning live snapshot process
Nov 29 20:27:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-adfb4eca-bff9-4d01-bf4a-7d8003709ec5 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json -f qcow2 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-adfb4eca-bff9-4d01-bf4a-7d8003709ec5 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-adfb4eca-bff9-4d01-bf4a-7d8003709ec5 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json -f qcow2 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:27:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-adfb4eca-bff9-4d01-bf4a-7d8003709ec5 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-adfb4eca-bff9-4d01-bf4a-7d8003709ec5 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-adfb4eca-bff9-4d01-bf4a-7d8003709ec5 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.179s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-adfb4eca-bff9-4d01-bf4a-7d8003709ec5 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_btj88za/457079f6ce6547899a09acf9b722e94f.delta 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-adfb4eca-bff9-4d01-bf4a-7d8003709ec5 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_btj88za/457079f6ce6547899a09acf9b722e94f.delta 1073741824" returned: 0 in 0.059s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:43 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-adfb4eca-bff9-4d01-bf4a-7d8003709ec5 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 20:27:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-adfb4eca-bff9-4d01-bf4a-7d8003709ec5 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:27:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-adfb4eca-bff9-4d01-bf4a-7d8003709ec5 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] COPY block job progress, current cursor: 18481152 final cursor: 75497472 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:27:45 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-adfb4eca-bff9-4d01-bf4a-7d8003709ec5 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 20:27:45 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-adfb4eca-bff9-4d01-bf4a-7d8003709ec5 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 20:27:45 user nova-compute[75356]: DEBUG nova.privsep.utils [None req-adfb4eca-bff9-4d01-bf4a-7d8003709ec5 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75356) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 20:27:45 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-adfb4eca-bff9-4d01-bf4a-7d8003709ec5 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_btj88za/457079f6ce6547899a09acf9b722e94f.delta /opt/stack/data/nova/instances/snapshots/tmp_btj88za/457079f6ce6547899a09acf9b722e94f {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:45 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-adfb4eca-bff9-4d01-bf4a-7d8003709ec5 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_btj88za/457079f6ce6547899a09acf9b722e94f.delta /opt/stack/data/nova/instances/snapshots/tmp_btj88za/457079f6ce6547899a09acf9b722e94f" returned: 0 in 0.403s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:45 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-adfb4eca-bff9-4d01-bf4a-7d8003709ec5 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Snapshot extracted, beginning image upload
Nov 29 20:27:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:27:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:27:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:27:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:27:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:49 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-adfb4eca-bff9-4d01-bf4a-7d8003709ec5 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Snapshot image upload complete
Nov 29 20:27:49 user nova-compute[75356]: INFO nova.compute.manager [None req-adfb4eca-bff9-4d01-bf4a-7d8003709ec5 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Took 6.27 seconds to snapshot the instance on the hypervisor.
Nov 29 20:27:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "7982934b-8c0f-4403-8607-2a2679070e02" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:27:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "7982934b-8c0f-4403-8607-2a2679070e02" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:27:52 user nova-compute[75356]: INFO nova.compute.manager [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Detaching volume 33171227-569e-4cbb-99a7-e0b23d6d9eb0
Nov 29 20:27:52 user nova-compute[75356]: INFO nova.virt.block_device [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Attempting to driver detach volume 33171227-569e-4cbb-99a7-e0b23d6d9eb0 from mountpoint /dev/vdc
Nov 29 20:27:52 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Attempting to detach device vdc from instance 7982934b-8c0f-4403-8607-2a2679070e02 from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:27:52 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:27:52 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:27:52 user nova-compute[75356]:   <source dev="/dev/sdc"/>
Nov 29 20:27:52 user nova-compute[75356]:   <target dev="vdc" bus="virtio"/>
Nov 29 20:27:52 user nova-compute[75356]:   <serial>33171227-569e-4cbb-99a7-e0b23d6d9eb0</serial>
Nov 29 20:27:52 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 20:27:52 user nova-compute[75356]: </disk>
Nov 29 20:27:52 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:27:52 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Successfully detached device vdc from instance 7982934b-8c0f-4403-8607-2a2679070e02 from the persistent domain config.
Nov 29 20:27:52 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 7982934b-8c0f-4403-8607-2a2679070e02 from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:27:52 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:27:52 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:27:52 user nova-compute[75356]:   <source dev="/dev/sdc"/>
Nov 29 20:27:52 user nova-compute[75356]:   <target dev="vdc" bus="virtio"/>
Nov 29 20:27:52 user nova-compute[75356]:   <serial>33171227-569e-4cbb-99a7-e0b23d6d9eb0</serial>
Nov 29 20:27:52 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 20:27:52 user nova-compute[75356]: </disk>
Nov 29 20:27:52 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:27:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 7982934b-8c0f-4403-8607-2a2679070e02 {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:27:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:55 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f is timed out.
Nov 29 20:27:55 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Successfully detached device vdb from instance 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f from the live domain config.
Nov 29 20:27:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRiclvpu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:27:55 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:27:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba481fea-1a76-4bd9-9ec7-6b339d9298fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:27:55 user nova-compute[75356]: No targets found.
Nov 29 20:27:55 user nova-compute[75356]: iSNS:
Nov 29 20:27:55 user nova-compute[75356]: No targets found.
Nov 29 20:27:55 user nova-compute[75356]: STATIC:
Nov 29 20:27:55 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4
Nov 29 20:27:55 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:27:55 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:27:55 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0
Nov 29 20:27:55 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:27:55 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:27:55 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:27:55 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:27:55 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:27:55 user nova-compute[75356]: FIRMWARE:
Nov 29 20:27:55 user nova-compute[75356]: No targets found.
Nov 29 20:27:55 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:27:55 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:27:55 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40056a3-f645-421a-9a44-41753da337b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcc36dd-4039-4417-a809-3d1f5c4a49da]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:27:55 user nova-compute[75356]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 (non-flash)
Nov 29 20:27:55 user nova-compute[75356]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 (non-flash)
Nov 29 20:27:55 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:27:55 user nova-compute[75356]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 (non-flash)
Nov 29 20:27:55 user nova-compute[75356]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 (non-flash)
Nov 29 20:27:55 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830818ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4'): ({'sde'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Removing single pathed devices sde {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06b80fc-2624-490c-a2f5-d6e6b0f0af7a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ccd4db-c44d-4d9f-aa42-e441c2c3bb6f]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Flushing IO for device /dev/sde {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf537f1-e39f-470a-acae-625149056016]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.071s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3d62f3-8ed0-4820-8d15-f0fff900a021]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] SCSI volumes sde have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc67dabe-df2d-4976-b1e1-dc30529f5ce3]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.141s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d404aa99-236c-4d24-be41-f33632cba52d]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4, portal: 172.16.0.220,3260]
Nov 29 20:27:55 user nova-compute[75356]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4, portal: 172.16.0.220,3260] successful.
Nov 29 20:27:55 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39bfe35-c99c-4679-abf2-3a80e1984164]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] <== disconnect_volume: return (411ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:27:55 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:27:56 user nova-compute[75356]: DEBUG nova.objects.instance [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lazy-loading 'flavor' on Instance uuid 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:27:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-65018fb3-95a0-42e0-8bd9-3193fb879598 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.934s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:27:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.743s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:27:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:27:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:27:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:27:56 user nova-compute[75356]: INFO nova.compute.manager [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Terminating instance
Nov 29 20:27:56 user nova-compute[75356]: DEBUG nova.compute.manager [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:27:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG nova.compute.manager [req-c4b517ea-7ae9-4166-a498-aefd439eb73b req-53bc86d3-de77-4ea4-b682-d50b1ee6b671 service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Received event network-vif-unplugged-cca86ef6-13ce-4177-b51b-266014d38e93 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c4b517ea-7ae9-4166-a498-aefd439eb73b req-53bc86d3-de77-4ea4-b682-d50b1ee6b671 service nova] Acquiring lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c4b517ea-7ae9-4166-a498-aefd439eb73b req-53bc86d3-de77-4ea4-b682-d50b1ee6b671 service nova] Lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c4b517ea-7ae9-4166-a498-aefd439eb73b req-53bc86d3-de77-4ea4-b682-d50b1ee6b671 service nova] Lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG nova.compute.manager [req-c4b517ea-7ae9-4166-a498-aefd439eb73b req-53bc86d3-de77-4ea4-b682-d50b1ee6b671 service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] No waiting events found dispatching network-vif-unplugged-cca86ef6-13ce-4177-b51b-266014d38e93 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG nova.compute.manager [req-c4b517ea-7ae9-4166-a498-aefd439eb73b req-53bc86d3-de77-4ea4-b682-d50b1ee6b671 service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Received event network-vif-unplugged-cca86ef6-13ce-4177-b51b-266014d38e93 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:57 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Instance destroyed successfully.
Nov 29 20:27:57 user nova-compute[75356]: DEBUG nova.objects.instance [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lazy-loading 'resources' on Instance uuid 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:24:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-12870285',display_name='tempest-VolumesSnapshotTestJSON-instance-12870285',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-12870285',id=24,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZQFzECYEirqcd8FJq7wBIC0Dpxn5/CZPMCjhovGV3vMRFVOSYpG88QIuVhtcxpdTAOA2MpwkWZIFLAYlykHEASRLhU/OBOiZyhbHXnmrUFx33RzOBHgkJdMc7YICn7xA==',key_name='tempest-keypair-127993307',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:24:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85535b509efe4dbb81c372f9031faac0',ramdisk_id='',reservation_id='r-xuwi9wn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-740377086',owner_user_name='tempest-VolumesSnapshotTestJSON-740377086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:24:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc9deaf0a28f4afaad9e42ecc448a23d',uuid=6ece3dd0-deb1-43b3-aaa8-bcccc61e712f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cca86ef6-13ce-4177-b51b-266014d38e93", "address": "fa:16:3e:f9:6e:16", "network": {"id": "c1768664-edc2-4213-80e3-64f7600eeb75", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688549704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85535b509efe4dbb81c372f9031faac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca86ef6-13", "ovs_interfaceid": "cca86ef6-13ce-4177-b51b-266014d38e93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Converting VIF {"id": "cca86ef6-13ce-4177-b51b-266014d38e93", "address": "fa:16:3e:f9:6e:16", "network": {"id": "c1768664-edc2-4213-80e3-64f7600eeb75", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1688549704-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85535b509efe4dbb81c372f9031faac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca86ef6-13", "ovs_interfaceid": "cca86ef6-13ce-4177-b51b-266014d38e93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:6e:16,bridge_name='br-int',has_traffic_filtering=True,id=cca86ef6-13ce-4177-b51b-266014d38e93,network=Network(c1768664-edc2-4213-80e3-64f7600eeb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcca86ef6-13') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG os_vif [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:6e:16,bridge_name='br-int',has_traffic_filtering=True,id=cca86ef6-13ce-4177-b51b-266014d38e93,network=Network(c1768664-edc2-4213-80e3-64f7600eeb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcca86ef6-13') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcca86ef6-13, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=958f4167-10d3-4583-a031-65f57636b178) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:57 user nova-compute[75356]: INFO os_vif [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:6e:16,bridge_name='br-int',has_traffic_filtering=True,id=cca86ef6-13ce-4177-b51b-266014d38e93,network=Network(c1768664-edc2-4213-80e3-64f7600eeb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcca86ef6-13')
Nov 29 20:27:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRiclvpu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:27:57 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:27:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac2e9ef-93c9-48cb-ba36-02a4e0dcbdef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:27:57 user nova-compute[75356]: No targets found.
Nov 29 20:27:57 user nova-compute[75356]: iSNS:
Nov 29 20:27:57 user nova-compute[75356]: No targets found.
Nov 29 20:27:57 user nova-compute[75356]: STATIC:
Nov 29 20:27:57 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0
Nov 29 20:27:57 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:27:57 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:27:57 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:27:57 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:27:57 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:27:57 user nova-compute[75356]: FIRMWARE:
Nov 29 20:27:57 user nova-compute[75356]: No targets found.
Nov 29 20:27:57 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:27:57 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:27:57 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3db80868-93f8-440f-9b0c-fdce8340e5b4', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[874cd8ad-c93d-4bfb-be2e-8e06ae3b4956]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcfcc50-19f5-4bdb-869b-4789424beebe]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:27:57 user nova-compute[75356]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 (non-flash)
Nov 29 20:27:57 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:27:57 user nova-compute[75356]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 (non-flash)
Nov 29 20:27:57 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830823b1c0>, {}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Disconnecting from: [] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] <== disconnect_volume: return (73ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:27:57 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Deleting instance files /opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f_del
Nov 29 20:27:57 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Deletion of /opt/stack/data/nova/instances/6ece3dd0-deb1-43b3-aaa8-bcccc61e712f_del complete
Nov 29 20:27:57 user nova-compute[75356]: INFO nova.compute.manager [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 29 20:27:57 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:27:57 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:27:58 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:27:58 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:27:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:27:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-db0826f0-5fdc-47a8-ae36-5059844980c9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:27:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-db0826f0-5fdc-47a8-ae36-5059844980c9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:27:58 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:27:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-e77c705c-e312-435c-a192-4ab45fe22a93 req-c6ea3ee0-2a3b-4bcb-866f-ebdbc6831c74 service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Received event network-vif-plugged-cca86ef6-13ce-4177-b51b-266014d38e93 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:27:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e77c705c-e312-435c-a192-4ab45fe22a93 req-c6ea3ee0-2a3b-4bcb-866f-ebdbc6831c74 service nova] Acquiring lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:27:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e77c705c-e312-435c-a192-4ab45fe22a93 req-c6ea3ee0-2a3b-4bcb-866f-ebdbc6831c74 service nova] Lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:27:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e77c705c-e312-435c-a192-4ab45fe22a93 req-c6ea3ee0-2a3b-4bcb-866f-ebdbc6831c74 service nova] Lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:27:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-e77c705c-e312-435c-a192-4ab45fe22a93 req-c6ea3ee0-2a3b-4bcb-866f-ebdbc6831c74 service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] No waiting events found dispatching network-vif-plugged-cca86ef6-13ce-4177-b51b-266014d38e93 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:27:59 user nova-compute[75356]: WARNING nova.compute.manager [req-e77c705c-e312-435c-a192-4ab45fe22a93 req-c6ea3ee0-2a3b-4bcb-866f-ebdbc6831c74 service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Received unexpected event network-vif-plugged-cca86ef6-13ce-4177-b51b-266014d38e93 for instance with vm_state active and task_state deleting.
Nov 29 20:27:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-f5f5edf6-09a8-47b2-85b9-24983feb255e req-371a29d0-f427-4417-918d-94978b58df9b service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Received event network-vif-deleted-cca86ef6-13ce-4177-b51b-266014d38e93 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:27:59 user nova-compute[75356]: INFO nova.compute.manager [req-f5f5edf6-09a8-47b2-85b9-24983feb255e req-371a29d0-f427-4417-918d-94978b58df9b service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Neutron deleted interface cca86ef6-13ce-4177-b51b-266014d38e93; detaching it from the instance and deleting it from the info cache
Nov 29 20:27:59 user nova-compute[75356]: DEBUG nova.network.neutron [req-f5f5edf6-09a8-47b2-85b9-24983feb255e req-371a29d0-f427-4417-918d-94978b58df9b service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:27:59 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:27:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-f5f5edf6-09a8-47b2-85b9-24983feb255e req-371a29d0-f427-4417-918d-94978b58df9b service nova] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Detach interface failed, port_id=cca86ef6-13ce-4177-b51b-266014d38e93, reason: Instance 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f could not be found. {{(pid=75356) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 20:27:59 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Took 1.56 seconds to deallocate network for instance.
Nov 29 20:27:59 user nova-compute[75356]: WARNING nova.volume.cinder [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Attachment 9270cae5-3fe0-4417-887d-1fdbf740d6ec does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 9270cae5-3fe0-4417-887d-1fdbf740d6ec. (HTTP 404) (Request-ID: req-afc0d3f9-ef60-4e53-a969-2dd022568519)
Nov 29 20:27:59 user nova-compute[75356]: INFO nova.compute.manager [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] [instance: 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f] Took 0.03 seconds to detach 1 volumes for instance.
Nov 29 20:27:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:27:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:27:59 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Updating instance_info_cache with network_info: [{"id": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "address": "fa:16:3e:80:ff:16", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56560c36-ae", "ovs_interfaceid": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:27:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-db0826f0-5fdc-47a8-ae36-5059844980c9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:27:59 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:27:59 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:27:59 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:27:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:27:59 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Deleted allocations for instance 6ece3dd0-deb1-43b3-aaa8-bcccc61e712f
Nov 29 20:28:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fa0fefde-2b2a-449c-b852-1c5c53710ad1 tempest-VolumesSnapshotTestJSON-740377086 tempest-VolumesSnapshotTestJSON-740377086-project-member] Lock "6ece3dd0-deb1-43b3-aaa8-bcccc61e712f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.169s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:28:00 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:28:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:28:00 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:28:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:28:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:04 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:28:04 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:28:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=7775MB free_disk=25.058185577392578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0b59517a-c467-432a-a73a-d1460c1574e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance db0826f0-5fdc-47a8-ae36-5059844980c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 93183110-d2e2-4da7-ab7d-73378f5e0d42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 7982934b-8c0f-4403-8607-2a2679070e02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ee5bef74-04c5-4de1-8f8e-4baba05e2a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing inventories for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Updating ProviderTree inventory for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Updating inventory in ProviderTree for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing aggregate associations for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a, aggregates: None {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing trait associations for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.782s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Cleaning up deleted instances {{(pid=75356) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] There are 0 instances to clean {{(pid=75356) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 20:28:04 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:28:05 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:28:05 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:28:05 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:28:05 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:28:05 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:28:05 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:28:05 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:28:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:28:08 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:28:08 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75356) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 20:28:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:28:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:28:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:28:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:28:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:13 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 7982934b-8c0f-4403-8607-2a2679070e02 is timed out.
Nov 29 20:28:13 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Successfully detached device vdc from instance 7982934b-8c0f-4403-8607-2a2679070e02 from the live domain config.
Nov 29 20:28:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIiVTYBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:28:13 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:28:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d151a0-9988-40bc-9bc9-8604842b48b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:28:13 user nova-compute[75356]: No targets found.
Nov 29 20:28:13 user nova-compute[75356]: iSNS:
Nov 29 20:28:13 user nova-compute[75356]: No targets found.
Nov 29 20:28:13 user nova-compute[75356]: STATIC:
Nov 29 20:28:13 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0
Nov 29 20:28:13 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:28:13 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:28:13 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:28:13 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:28:13 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:28:13 user nova-compute[75356]: FIRMWARE:
Nov 29 20:28:13 user nova-compute[75356]: No targets found.
Nov 29 20:28:13 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:28:13 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:28:13 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2d95cd-d00f-4107-bde8-80918df369da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[92338d3a-f1b1-4591-b139-639dbc282324]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:28:13 user nova-compute[75356]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 (non-flash)
Nov 29 20:28:13 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:28:13 user nova-compute[75356]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 (non-flash)
Nov 29 20:28:13 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8308711870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0'): ({'sdc'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Removing single pathed devices sdc {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53de524-10db-4b70-980f-1fd37099d685]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d93177-0024-437f-9344-13983d118873]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Flushing IO for device /dev/sdc {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbd0862-7d59-484c-b3f9-bd47c4ae57b0]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d464e56-4d0d-4dd7-80cc-e2c6656f0e2a]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c162ee-4584-4c51-a079-cee2bf278b1f]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[008da553-de6b-4612-9fbf-fa0dcb5a018d]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0, portal: 172.16.0.220,3260]
Nov 29 20:28:13 user nova-compute[75356]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0, portal: 172.16.0.220,3260] successful.
Nov 29 20:28:13 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33171227-569e-4cbb-99a7-e0b23d6d9eb0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ceef33e-3081-47d5-9f28-cc3d2685d69d]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] <== disconnect_volume: return (284ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:28:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:28:14 user nova-compute[75356]: DEBUG nova.objects.instance [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lazy-loading 'flavor' on Instance uuid 7982934b-8c0f-4403-8607-2a2679070e02 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:28:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b3da88c9-1bbc-4e4f-92b5-54ac8a390184 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "7982934b-8c0f-4403-8607-2a2679070e02" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.665s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:28:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:28:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:28:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:28:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:28:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:28:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:28:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:28:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:28:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "c3bb4cde-968f-4474-abcd-8dbd73300865" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "c3bb4cde-968f-4474-abcd-8dbd73300865" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:26 user nova-compute[75356]: DEBUG nova.compute.manager [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:28:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:26 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:28:26 user nova-compute[75356]: INFO nova.compute.claims [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Claim successful on node user
Nov 29 20:28:27 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG nova.compute.manager [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG nova.compute.manager [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG nova.network.neutron [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:28:27 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:28:27 user nova-compute[75356]: DEBUG nova.compute.manager [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG nova.policy [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '081b00360a204be3bd6435807283f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6791b0c999846e2a22d5735f91ea1aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:28:27 user nova-compute[75356]: INFO nova.virt.block_device [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Booting with volume 840581e9-52c9-494b-91f3-0aab3d39a460 at /dev/vda
Nov 29 20:28:27 user nova-compute[75356]: DEBUG os_brick.utils [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0d61d9-42e2-45c7-8a9c-50cb6e73895c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e016e3-520d-4681-a52c-a44eddf05b22]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca7bf16-b37a-4f71-92bd-be786237e920]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2333dfc-40e7-442d-9522-21451ef84172]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:28:27 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:28:27 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6414fb92-0dce-41de-908b-e7d599199222]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG os_brick.utils [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Updating existing volume attachment record: a2dd6e55-5730-4ed6-9108-b7fe22401ba9 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:28:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:28 user nova-compute[75356]: DEBUG nova.network.neutron [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Successfully created port: 1527f7c2-52c0-4bf7-bc50-6a4de4629933 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:28:29 user nova-compute[75356]: DEBUG nova.network.neutron [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Successfully updated port: 1527f7c2-52c0-4bf7-bc50-6a4de4629933 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:28:29 user nova-compute[75356]: DEBUG nova.compute.manager [req-bf7f08b5-6599-41e7-85a8-9f37fea45bb5 req-a1a0e082-0565-4ead-813a-7bb1b0173c88 service nova] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Received event network-changed-1527f7c2-52c0-4bf7-bc50-6a4de4629933 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:28:29 user nova-compute[75356]: DEBUG nova.compute.manager [req-bf7f08b5-6599-41e7-85a8-9f37fea45bb5 req-a1a0e082-0565-4ead-813a-7bb1b0173c88 service nova] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Refreshing instance network info cache due to event network-changed-1527f7c2-52c0-4bf7-bc50-6a4de4629933. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:28:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-bf7f08b5-6599-41e7-85a8-9f37fea45bb5 req-a1a0e082-0565-4ead-813a-7bb1b0173c88 service nova] Acquiring lock "refresh_cache-c3bb4cde-968f-4474-abcd-8dbd73300865" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:28:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-bf7f08b5-6599-41e7-85a8-9f37fea45bb5 req-a1a0e082-0565-4ead-813a-7bb1b0173c88 service nova] Acquired lock "refresh_cache-c3bb4cde-968f-4474-abcd-8dbd73300865" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:28:29 user nova-compute[75356]: DEBUG nova.network.neutron [req-bf7f08b5-6599-41e7-85a8-9f37fea45bb5 req-a1a0e082-0565-4ead-813a-7bb1b0173c88 service nova] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Refreshing network info cache for port 1527f7c2-52c0-4bf7-bc50-6a4de4629933 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:28:29 user nova-compute[75356]: DEBUG nova.network.neutron [req-bf7f08b5-6599-41e7-85a8-9f37fea45bb5 req-a1a0e082-0565-4ead-813a-7bb1b0173c88 service nova] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:28:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "refresh_cache-c3bb4cde-968f-4474-abcd-8dbd73300865" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:28:29 user nova-compute[75356]: DEBUG nova.network.neutron [req-bf7f08b5-6599-41e7-85a8-9f37fea45bb5 req-a1a0e082-0565-4ead-813a-7bb1b0173c88 service nova] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:28:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-bf7f08b5-6599-41e7-85a8-9f37fea45bb5 req-a1a0e082-0565-4ead-813a-7bb1b0173c88 service nova] Releasing lock "refresh_cache-c3bb4cde-968f-4474-abcd-8dbd73300865" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:28:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquired lock "refresh_cache-c3bb4cde-968f-4474-abcd-8dbd73300865" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:28:29 user nova-compute[75356]: DEBUG nova.network.neutron [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:28:29 user nova-compute[75356]: DEBUG nova.network.neutron [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:28:29 user nova-compute[75356]: DEBUG nova.network.neutron [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Updating instance_info_cache with network_info: [{"id": "1527f7c2-52c0-4bf7-bc50-6a4de4629933", "address": "fa:16:3e:f4:a3:a6", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1527f7c2-52", "ovs_interfaceid": "1527f7c2-52c0-4bf7-bc50-6a4de4629933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:28:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Releasing lock "refresh_cache-c3bb4cde-968f-4474-abcd-8dbd73300865" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:28:29 user nova-compute[75356]: DEBUG nova.compute.manager [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Instance network_info: |[{"id": "1527f7c2-52c0-4bf7-bc50-6a4de4629933", "address": "fa:16:3e:f4:a3:a6", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1527f7c2-52", "ovs_interfaceid": "1527f7c2-52c0-4bf7-bc50-6a4de4629933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:28:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:28:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:28:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:28:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:28:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG nova.compute.manager [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:28:36 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Creating image(s)
Nov 29 20:28:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Did not create local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Ensure instance console log exists: /opt/stack/data/nova/instances/c3bb4cde-968f-4474-abcd-8dbd73300865/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Start _get_guest_xml network_info=[{"id": "1527f7c2-52c0-4bf7-bc50-6a4de4629933", "address": "fa:16:3e:f4:a3:a6", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1527f7c2-52", "ovs_interfaceid": "1527f7c2-52c0-4bf7-bc50-6a4de4629933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJTjnqwB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c3bb4cde-968f-4474-abcd-8dbd73300865', 'attached_at': '', 'detached_at': '', 'volume_id': '840581e9-52c9-494b-91f3-0aab3d39a460', 'serial': '840581e9-52c9-494b-91f3-0aab3d39a460'}, 'attachment_id': 'a2dd6e55-5730-4ed6-9108-b7fe22401ba9', 'volume_type': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:28:36 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:28:36 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:28:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJTjnqwB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:28:36 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:28:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:28:36 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:28:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:28:36 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6f3d9b-6b44-4bad-91fd-ca52ea99e71b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:28:36 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cb072a-27df-4e3c-b88b-57292d7835a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460] added
Nov 29 20:28:36 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8eaf23-2561-4f59-afa3-53ce0df63ae2]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fca72e-27ee-4b67-bead-af0ed17c8386]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KJTjnqwB {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KJTjnqwB" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b39f01-7b7e-4514-983a-a98df4ebeb18]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KJTjnqwB'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9fc11e-b690-49e7-a6d3-7c7586bbb5af]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adacfe0-040a-414f-b2ca-fa2edaf1ca43]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:28:36 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:28:36 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9300d3a2-83d8-4384-b09a-61e504537f84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460, portal: 172.16.0.220,3260]
Nov 29 20:28:36 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460, portal: 172.16.0.220,3260] successful.
Nov 29 20:28:36 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f83b509-146a-42df-9385-43c2739d1082]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[affda910-8c16-4174-9ace-41fb31386d4d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:28:36 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:28:36 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:28:36 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:28:36 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4539a720-de1e-4d41-acd3-2d80767ee615]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:36 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: None {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJTjnqwB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '23234616533396661', 'path': '/dev/sdc'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234616533396661', 'path': '/dev/sdc'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:28:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-356243207',display_name='tempest-TestVolumeBootPattern-volume-backed-server-356243207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-356243207',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8aG/CjLOXUOcOIERtoTroIOi2RmhdEo0aPpWl6gpMlqOwhNq+TskcE9T2CDvu6H26fDbrFkib0KecKeUkagcLT+qTSskuDxdbBTxueqKyu5LTCAqjQGQM33VVaijXQzQ==',key_name='tempest-keypair-214438908',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6791b0c999846e2a22d5735f91ea1aa',ramdisk_id='',reservation_id='r-2o7cj47e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1627976633',owner_user_name='tempest-TestVolumeBootPattern-1627976633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:28:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='081b00360a204be3bd6435807283f230',uuid=c3bb4cde-968f-4474-abcd-8dbd73300865,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1527f7c2-52c0-4bf7-bc50-6a4de4629933", "address": "fa:16:3e:f4:a3:a6", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1527f7c2-52", "ovs_interfaceid": "1527f7c2-52c0-4bf7-bc50-6a4de4629933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converting VIF {"id": "1527f7c2-52c0-4bf7-bc50-6a4de4629933", "address": "fa:16:3e:f4:a3:a6", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1527f7c2-52", "ovs_interfaceid": "1527f7c2-52c0-4bf7-bc50-6a4de4629933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:a3:a6,bridge_name='br-int',has_traffic_filtering=True,id=1527f7c2-52c0-4bf7-bc50-6a4de4629933,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1527f7c2-52') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG nova.objects.instance [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lazy-loading 'pci_devices' on Instance uuid c3bb4cde-968f-4474-abcd-8dbd73300865 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:28:37 user nova-compute[75356]:   <uuid>c3bb4cde-968f-4474-abcd-8dbd73300865</uuid>
Nov 29 20:28:37 user nova-compute[75356]:   <name>instance-0000001d</name>
Nov 29 20:28:37 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:28:37 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:28:37 user nova-compute[75356]:   <metadata>
Nov 29 20:28:37 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:28:37 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:28:37 user nova-compute[75356]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-356243207</nova:name>
Nov 29 20:28:37 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:28:36</nova:creationTime>
Nov 29 20:28:37 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:28:37 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:28:37 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:28:37 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:28:37 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:28:37 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:28:37 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:28:37 user nova-compute[75356]:       <nova:owner>
Nov 29 20:28:37 user nova-compute[75356]:         <nova:user uuid="081b00360a204be3bd6435807283f230">tempest-TestVolumeBootPattern-1627976633-project-member</nova:user>
Nov 29 20:28:37 user nova-compute[75356]:         <nova:project uuid="f6791b0c999846e2a22d5735f91ea1aa">tempest-TestVolumeBootPattern-1627976633</nova:project>
Nov 29 20:28:37 user nova-compute[75356]:       </nova:owner>
Nov 29 20:28:37 user nova-compute[75356]:       <nova:ports>
Nov 29 20:28:37 user nova-compute[75356]:         <nova:port uuid="1527f7c2-52c0-4bf7-bc50-6a4de4629933">
Nov 29 20:28:37 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 20:28:37 user nova-compute[75356]:         </nova:port>
Nov 29 20:28:37 user nova-compute[75356]:       </nova:ports>
Nov 29 20:28:37 user nova-compute[75356]:     </nova:instance>
Nov 29 20:28:37 user nova-compute[75356]:   </metadata>
Nov 29 20:28:37 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:28:37 user nova-compute[75356]:     <system>
Nov 29 20:28:37 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:28:37 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:28:37 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:28:37 user nova-compute[75356]:       <entry name="serial">c3bb4cde-968f-4474-abcd-8dbd73300865</entry>
Nov 29 20:28:37 user nova-compute[75356]:       <entry name="uuid">c3bb4cde-968f-4474-abcd-8dbd73300865</entry>
Nov 29 20:28:37 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:28:37 user nova-compute[75356]:     </system>
Nov 29 20:28:37 user nova-compute[75356]:   </sysinfo>
Nov 29 20:28:37 user nova-compute[75356]:   <os>
Nov 29 20:28:37 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:28:37 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:28:37 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:28:37 user nova-compute[75356]:   </os>
Nov 29 20:28:37 user nova-compute[75356]:   <features>
Nov 29 20:28:37 user nova-compute[75356]:     <acpi/>
Nov 29 20:28:37 user nova-compute[75356]:     <apic/>
Nov 29 20:28:37 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:28:37 user nova-compute[75356]:   </features>
Nov 29 20:28:37 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:28:37 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:28:37 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:28:37 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:28:37 user nova-compute[75356]:   </clock>
Nov 29 20:28:37 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:28:37 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:28:37 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:28:37 user nova-compute[75356]:   </cpu>
Nov 29 20:28:37 user nova-compute[75356]:   <devices>
Nov 29 20:28:37 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:28:37 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:28:37 user nova-compute[75356]:       <source dev="/dev/sdc"/>
Nov 29 20:28:37 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:28:37 user nova-compute[75356]:       <serial>840581e9-52c9-494b-91f3-0aab3d39a460</serial>
Nov 29 20:28:37 user nova-compute[75356]:     </disk>
Nov 29 20:28:37 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:28:37 user nova-compute[75356]:       <mac address="fa:16:3e:f4:a3:a6"/>
Nov 29 20:28:37 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:28:37 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:28:37 user nova-compute[75356]:       <target dev="tap1527f7c2-52"/>
Nov 29 20:28:37 user nova-compute[75356]:     </interface>
Nov 29 20:28:37 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:28:37 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/c3bb4cde-968f-4474-abcd-8dbd73300865/console.log" append="off"/>
Nov 29 20:28:37 user nova-compute[75356]:     </serial>
Nov 29 20:28:37 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:28:37 user nova-compute[75356]:     <video>
Nov 29 20:28:37 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:28:37 user nova-compute[75356]:     </video>
Nov 29 20:28:37 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:28:37 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:28:37 user nova-compute[75356]:     </rng>
Nov 29 20:28:37 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:28:37 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:28:37 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:28:37 user nova-compute[75356]:     </memballoon>
Nov 29 20:28:37 user nova-compute[75356]:   </devices>
Nov 29 20:28:37 user nova-compute[75356]: </domain>
Nov 29 20:28:37 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:28:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-356243207',display_name='tempest-TestVolumeBootPattern-volume-backed-server-356243207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-356243207',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8aG/CjLOXUOcOIERtoTroIOi2RmhdEo0aPpWl6gpMlqOwhNq+TskcE9T2CDvu6H26fDbrFkib0KecKeUkagcLT+qTSskuDxdbBTxueqKyu5LTCAqjQGQM33VVaijXQzQ==',key_name='tempest-keypair-214438908',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6791b0c999846e2a22d5735f91ea1aa',ramdisk_id='',reservation_id='r-2o7cj47e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1627976633',owner_user_name='tempest-TestVolumeBootPattern-1627976633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:28:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='081b00360a204be3bd6435807283f230',uuid=c3bb4cde-968f-4474-abcd-8dbd73300865,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1527f7c2-52c0-4bf7-bc50-6a4de4629933", "address": "fa:16:3e:f4:a3:a6", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1527f7c2-52", "ovs_interfaceid": "1527f7c2-52c0-4bf7-bc50-6a4de4629933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converting VIF {"id": "1527f7c2-52c0-4bf7-bc50-6a4de4629933", "address": "fa:16:3e:f4:a3:a6", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1527f7c2-52", "ovs_interfaceid": "1527f7c2-52c0-4bf7-bc50-6a4de4629933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:a3:a6,bridge_name='br-int',has_traffic_filtering=True,id=1527f7c2-52c0-4bf7-bc50-6a4de4629933,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1527f7c2-52') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG os_vif [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:a3:a6,bridge_name='br-int',has_traffic_filtering=True,id=1527f7c2-52c0-4bf7-bc50-6a4de4629933,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1527f7c2-52') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dcf9195e-9ce6-5b04-8e44-be026c94712a', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1527f7c2-52, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1527f7c2-52, col_values=(('qos', UUID('42ad3593-1184-45fc-900f-59e872d69d16')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1527f7c2-52, col_values=(('external_ids', {'iface-id': '1527f7c2-52c0-4bf7-bc50-6a4de4629933', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:a3:a6', 'vm-uuid': 'c3bb4cde-968f-4474-abcd-8dbd73300865'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:28:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:37 user nova-compute[75356]: INFO os_vif [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:a3:a6,bridge_name='br-int',has_traffic_filtering=True,id=1527f7c2-52c0-4bf7-bc50-6a4de4629933,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1527f7c2-52')
Nov 29 20:28:38 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:28:38 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] No VIF found with MAC fa:16:3e:f4:a3:a6, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:28:38 user nova-compute[75356]: DEBUG nova.compute.manager [req-a88a10a5-2a69-4229-9f9b-671e7b56f30c req-61c6132e-79f9-4a1f-9e0e-f807060c5b14 service nova] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Received event network-changed-8356e667-97df-4ba5-9f55-ed78fd4f4736 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:28:38 user nova-compute[75356]: DEBUG nova.compute.manager [req-a88a10a5-2a69-4229-9f9b-671e7b56f30c req-61c6132e-79f9-4a1f-9e0e-f807060c5b14 service nova] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Refreshing instance network info cache due to event network-changed-8356e667-97df-4ba5-9f55-ed78fd4f4736. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:28:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a88a10a5-2a69-4229-9f9b-671e7b56f30c req-61c6132e-79f9-4a1f-9e0e-f807060c5b14 service nova] Acquiring lock "refresh_cache-ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:28:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a88a10a5-2a69-4229-9f9b-671e7b56f30c req-61c6132e-79f9-4a1f-9e0e-f807060c5b14 service nova] Acquired lock "refresh_cache-ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:28:38 user nova-compute[75356]: DEBUG nova.network.neutron [req-a88a10a5-2a69-4229-9f9b-671e7b56f30c req-61c6132e-79f9-4a1f-9e0e-f807060c5b14 service nova] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Refreshing network info cache for port 8356e667-97df-4ba5-9f55-ed78fd4f4736 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:28:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:39 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:28:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:28:39 user nova-compute[75356]: INFO nova.compute.claims [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Claim successful on node user
Nov 29 20:28:40 user nova-compute[75356]: DEBUG nova.compute.manager [req-31d5e209-854c-4987-9daf-a9597ab546cc req-caa5e383-a9fa-4672-b906-77f63be69131 service nova] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Received event network-vif-plugged-1527f7c2-52c0-4bf7-bc50-6a4de4629933 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:28:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-31d5e209-854c-4987-9daf-a9597ab546cc req-caa5e383-a9fa-4672-b906-77f63be69131 service nova] Acquiring lock "c3bb4cde-968f-4474-abcd-8dbd73300865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-31d5e209-854c-4987-9daf-a9597ab546cc req-caa5e383-a9fa-4672-b906-77f63be69131 service nova] Lock "c3bb4cde-968f-4474-abcd-8dbd73300865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-31d5e209-854c-4987-9daf-a9597ab546cc req-caa5e383-a9fa-4672-b906-77f63be69131 service nova] Lock "c3bb4cde-968f-4474-abcd-8dbd73300865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:28:40 user nova-compute[75356]: DEBUG nova.compute.manager [req-31d5e209-854c-4987-9daf-a9597ab546cc req-caa5e383-a9fa-4672-b906-77f63be69131 service nova] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] No waiting events found dispatching network-vif-plugged-1527f7c2-52c0-4bf7-bc50-6a4de4629933 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:28:40 user nova-compute[75356]: WARNING nova.compute.manager [req-31d5e209-854c-4987-9daf-a9597ab546cc req-caa5e383-a9fa-4672-b906-77f63be69131 service nova] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Received unexpected event network-vif-plugged-1527f7c2-52c0-4bf7-bc50-6a4de4629933 for instance with vm_state building and task_state spawning.
Nov 29 20:28:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:40 user nova-compute[75356]: DEBUG nova.network.neutron [req-a88a10a5-2a69-4229-9f9b-671e7b56f30c req-61c6132e-79f9-4a1f-9e0e-f807060c5b14 service nova] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Updated VIF entry in instance network info cache for port 8356e667-97df-4ba5-9f55-ed78fd4f4736. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:28:40 user nova-compute[75356]: DEBUG nova.network.neutron [req-a88a10a5-2a69-4229-9f9b-671e7b56f30c req-61c6132e-79f9-4a1f-9e0e-f807060c5b14 service nova] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Updating instance_info_cache with network_info: [{"id": "8356e667-97df-4ba5-9f55-ed78fd4f4736", "address": "fa:16:3e:1d:8d:b3", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8356e667-97", "ovs_interfaceid": "8356e667-97df-4ba5-9f55-ed78fd4f4736", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:28:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a88a10a5-2a69-4229-9f9b-671e7b56f30c req-61c6132e-79f9-4a1f-9e0e-f807060c5b14 service nova] Releasing lock "refresh_cache-ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:28:40 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:28:40 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:28:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.686s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:28:40 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:28:40 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:28:40 user nova-compute[75356]: DEBUG nova.network.neutron [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:28:40 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:28:40 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:28:40 user nova-compute[75356]: DEBUG nova.policy [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abc7cfc71d0c448cbbe8d42f8b617d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b14efb1a4d34a3db7a51bd79234b86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:28:40 user nova-compute[75356]: INFO nova.virt.block_device [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Booting with volume 33217dc4-b5a2-4843-87d8-ca6acb430f09 at /dev/vda
Nov 29 20:28:41 user nova-compute[75356]: DEBUG os_brick.utils [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50542c2-bf9d-4284-8916-42f88c08fb35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb49a368-5775-46c0-a619-fcca30b87309]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b205458-4f30-4c24-a205-b0bd9b9bec33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d67a234-3bc5-47f3-acb2-f50c1b833815]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:28:41 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:28:41 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bc8aa8-fa5f-46ec-8088-d9aa30dae625]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG os_brick.utils [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Updating existing volume attachment record: 4acbe837-b094-4f8b-98e2-2104bfcb9316 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG nova.objects.instance [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lazy-loading 'flavor' on Instance uuid ee5bef74-04c5-4de1-8f8e-4baba05e2a6d {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG nova.network.neutron [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Successfully created port: 803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:28:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:42 user nova-compute[75356]: INFO nova.compute.manager [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Attaching volume 5fcdf78a-5709-4998-bb2e-cd3b21393f4b to /dev/vdb
Nov 29 20:28:42 user nova-compute[75356]: DEBUG os_brick.utils [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG nova.compute.manager [req-5a5c5033-e193-4bf3-bb15-afff206421fa req-7b897f70-8751-4802-9a09-cd1a35664a29 service nova] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Received event network-vif-plugged-1527f7c2-52c0-4bf7-bc50-6a4de4629933 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5a5c5033-e193-4bf3-bb15-afff206421fa req-7b897f70-8751-4802-9a09-cd1a35664a29 service nova] Acquiring lock "c3bb4cde-968f-4474-abcd-8dbd73300865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5a5c5033-e193-4bf3-bb15-afff206421fa req-7b897f70-8751-4802-9a09-cd1a35664a29 service nova] Lock "c3bb4cde-968f-4474-abcd-8dbd73300865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5a5c5033-e193-4bf3-bb15-afff206421fa req-7b897f70-8751-4802-9a09-cd1a35664a29 service nova] Lock "c3bb4cde-968f-4474-abcd-8dbd73300865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG nova.compute.manager [req-5a5c5033-e193-4bf3-bb15-afff206421fa req-7b897f70-8751-4802-9a09-cd1a35664a29 service nova] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] No waiting events found dispatching network-vif-plugged-1527f7c2-52c0-4bf7-bc50-6a4de4629933 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:28:42 user nova-compute[75356]: WARNING nova.compute.manager [req-5a5c5033-e193-4bf3-bb15-afff206421fa req-7b897f70-8751-4802-9a09-cd1a35664a29 service nova] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Received unexpected event network-vif-plugged-1527f7c2-52c0-4bf7-bc50-6a4de4629933 for instance with vm_state building and task_state spawning.
Nov 29 20:28:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e26c77d-3aad-4d41-8ac5-49d168f1b4e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1097fc-e53c-49e6-8357-21b0a9b56c15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG nova.compute.manager [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[333c3e8d-5085-4cc8-9f22-6fa363b93f43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4118edec-b274-4cb7-a5d0-3819cb534cc5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:28:42 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Instance spawned successfully.
Nov 29 20:28:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:28:42 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:28:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbbe54a-9dd4-4f12-821e-9396731805a0]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG os_brick.utils [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Updating existing volume attachment record: 77ef75e4-9875-44d4-9bcf-7a755d9496a1 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:42 user nova-compute[75356]: INFO nova.compute.manager [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Took 6.07 seconds to spawn the instance on the hypervisor.
Nov 29 20:28:42 user nova-compute[75356]: DEBUG nova.compute.manager [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:28:42 user nova-compute[75356]: INFO nova.compute.manager [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Took 15.85 seconds to build instance.
Nov 29 20:28:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-167764ac-1cb4-40c8-b641-55a3d5364419 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "c3bb4cde-968f-4474-abcd-8dbd73300865" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.976s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG nova.network.neutron [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Successfully updated port: 803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "refresh_cache-873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquired lock "refresh_cache-873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG nova.network.neutron [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "7982934b-8c0f-4403-8607-2a2679070e02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "7982934b-8c0f-4403-8607-2a2679070e02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "7982934b-8c0f-4403-8607-2a2679070e02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:28:43 user nova-compute[75356]: INFO nova.compute.manager [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Terminating instance
Nov 29 20:28:43 user nova-compute[75356]: DEBUG nova.compute.manager [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG nova.network.neutron [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG nova.network.neutron [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Updating instance_info_cache with network_info: [{"id": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "address": "fa:16:3e:ed:a6:4a", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c2f7e-7d", "ovs_interfaceid": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Releasing lock "refresh_cache-873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Instance network_info: |[{"id": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "address": "fa:16:3e:ed:a6:4a", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c2f7e-7d", "ovs_interfaceid": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:43 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Instance destroyed successfully.
Nov 29 20:28:43 user nova-compute[75356]: DEBUG nova.objects.instance [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lazy-loading 'resources' on Instance uuid 7982934b-8c0f-4403-8607-2a2679070e02 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T20:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-859860773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-859860773',id=20,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB61jWQLvhl105AL/kOrG2alsz/RIWF011SgEudyJwJKmlKy4g4wrMvyGGcKLeZjIEL23ogtBjthvwquYW/ZXfCmfVBm47cAiaZ3AkaXj9dYDhiFzXqQnT7zoPPd4sjddA==',key_name='tempest-keypair-1095450286',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:26:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71e99301081a4158bc9d188e2f796350',ramdisk_id='',reservation_id='r-5mvrbzg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1538416601',owner_user_name='tempest-AttachVolumeShelveTestJSON-1538416601-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:26:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecc96706ae3140ce8816c0e78e116d7d',uuid=7982934b-8c0f-4403-8607-2a2679070e02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2273063c-59ad-4c22-baac-b35f81cddd68", "address": "fa:16:3e:3f:8c:d9", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2273063c-59", "ovs_interfaceid": "2273063c-59ad-4c22-baac-b35f81cddd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converting VIF {"id": "2273063c-59ad-4c22-baac-b35f81cddd68", "address": "fa:16:3e:3f:8c:d9", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2273063c-59", "ovs_interfaceid": "2273063c-59ad-4c22-baac-b35f81cddd68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:8c:d9,bridge_name='br-int',has_traffic_filtering=True,id=2273063c-59ad-4c22-baac-b35f81cddd68,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2273063c-59') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG os_vif [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:8c:d9,bridge_name='br-int',has_traffic_filtering=True,id=2273063c-59ad-4c22-baac-b35f81cddd68,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2273063c-59') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2273063c-59, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:28:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8c6d567-bf16-41a1-87dc-ddbd028605ca) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:28:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:28:44 user nova-compute[75356]: INFO os_vif [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:8c:d9,bridge_name='br-int',has_traffic_filtering=True,id=2273063c-59ad-4c22-baac-b35f81cddd68,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2273063c-59')
Nov 29 20:28:44 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Deleting instance files /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02_del
Nov 29 20:28:44 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Deletion of /opt/stack/data/nova/instances/7982934b-8c0f-4403-8607-2a2679070e02_del complete
Nov 29 20:28:44 user nova-compute[75356]: DEBUG nova.compute.manager [req-27ca8383-2f39-411c-8dd9-362599b4c10f req-10449aa8-9624-4184-aadb-f89f5e625388 service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Received event network-changed-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:28:44 user nova-compute[75356]: DEBUG nova.compute.manager [req-27ca8383-2f39-411c-8dd9-362599b4c10f req-10449aa8-9624-4184-aadb-f89f5e625388 service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Refreshing instance network info cache due to event network-changed-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:28:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-27ca8383-2f39-411c-8dd9-362599b4c10f req-10449aa8-9624-4184-aadb-f89f5e625388 service nova] Acquiring lock "refresh_cache-873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:28:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-27ca8383-2f39-411c-8dd9-362599b4c10f req-10449aa8-9624-4184-aadb-f89f5e625388 service nova] Acquired lock "refresh_cache-873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:28:44 user nova-compute[75356]: DEBUG nova.network.neutron [req-27ca8383-2f39-411c-8dd9-362599b4c10f req-10449aa8-9624-4184-aadb-f89f5e625388 service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Refreshing network info cache for port 803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:28:44 user nova-compute[75356]: DEBUG nova.compute.manager [req-3d0d9eb0-dd7e-4954-962e-db6baf1003bd req-862c42a3-4f9c-4445-85be-34ef765ac002 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received event network-vif-unplugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:28:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3d0d9eb0-dd7e-4954-962e-db6baf1003bd req-862c42a3-4f9c-4445-85be-34ef765ac002 service nova] Acquiring lock "7982934b-8c0f-4403-8607-2a2679070e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3d0d9eb0-dd7e-4954-962e-db6baf1003bd req-862c42a3-4f9c-4445-85be-34ef765ac002 service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3d0d9eb0-dd7e-4954-962e-db6baf1003bd req-862c42a3-4f9c-4445-85be-34ef765ac002 service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:28:44 user nova-compute[75356]: DEBUG nova.compute.manager [req-3d0d9eb0-dd7e-4954-962e-db6baf1003bd req-862c42a3-4f9c-4445-85be-34ef765ac002 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] No waiting events found dispatching network-vif-unplugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:28:44 user nova-compute[75356]: DEBUG nova.compute.manager [req-3d0d9eb0-dd7e-4954-962e-db6baf1003bd req-862c42a3-4f9c-4445-85be-34ef765ac002 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received event network-vif-unplugged-2273063c-59ad-4c22-baac-b35f81cddd68 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:28:44 user nova-compute[75356]: INFO nova.compute.manager [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Took 1.09 seconds to destroy the instance on the hypervisor.
Nov 29 20:28:44 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:28:44 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:28:44 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:28:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:45 user nova-compute[75356]: DEBUG nova.network.neutron [req-27ca8383-2f39-411c-8dd9-362599b4c10f req-10449aa8-9624-4184-aadb-f89f5e625388 service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Updated VIF entry in instance network info cache for port 803c2f7e-7d7c-46aa-b1a8-63165a13b9a1. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:28:45 user nova-compute[75356]: DEBUG nova.network.neutron [req-27ca8383-2f39-411c-8dd9-362599b4c10f req-10449aa8-9624-4184-aadb-f89f5e625388 service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Updating instance_info_cache with network_info: [{"id": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "address": "fa:16:3e:ed:a6:4a", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c2f7e-7d", "ovs_interfaceid": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:28:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-27ca8383-2f39-411c-8dd9-362599b4c10f req-10449aa8-9624-4184-aadb-f89f5e625388 service nova] Releasing lock "refresh_cache-873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:28:46 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Took 2.02 seconds to deallocate network for instance.
Nov 29 20:28:46 user nova-compute[75356]: DEBUG nova.compute.manager [req-fb49a33f-044f-4ef2-beac-e4b74e08ce43 req-26fd1657-3ad9-4bdb-9c0c-212a70e76103 service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received event network-vif-deleted-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG nova.compute.manager [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received event network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] Acquiring lock "7982934b-8c0f-4403-8607-2a2679070e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG nova.compute.manager [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] No waiting events found dispatching network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:28:46 user nova-compute[75356]: WARNING nova.compute.manager [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received unexpected event network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 for instance with vm_state active and task_state deleting.
Nov 29 20:28:46 user nova-compute[75356]: DEBUG nova.compute.manager [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received event network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] Acquiring lock "7982934b-8c0f-4403-8607-2a2679070e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG nova.compute.manager [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] No waiting events found dispatching network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:28:46 user nova-compute[75356]: WARNING nova.compute.manager [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received unexpected event network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 for instance with vm_state active and task_state deleting.
Nov 29 20:28:46 user nova-compute[75356]: DEBUG nova.compute.manager [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received event network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] Acquiring lock "7982934b-8c0f-4403-8607-2a2679070e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG nova.compute.manager [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] No waiting events found dispatching network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:28:46 user nova-compute[75356]: WARNING nova.compute.manager [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received unexpected event network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 for instance with vm_state active and task_state deleting.
Nov 29 20:28:46 user nova-compute[75356]: DEBUG nova.compute.manager [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received event network-vif-unplugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] Acquiring lock "7982934b-8c0f-4403-8607-2a2679070e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG nova.compute.manager [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] No waiting events found dispatching network-vif-unplugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG nova.compute.manager [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received event network-vif-unplugged-2273063c-59ad-4c22-baac-b35f81cddd68 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG nova.compute.manager [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received event network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] Acquiring lock "7982934b-8c0f-4403-8607-2a2679070e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] Lock "7982934b-8c0f-4403-8607-2a2679070e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG nova.compute.manager [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] No waiting events found dispatching network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:28:46 user nova-compute[75356]: WARNING nova.compute.manager [req-54ad2d87-d3b0-4b65-8e99-4d48ce8ecf28 req-72d19cf4-c312-4173-82a2-a87cad380d7c service nova] [instance: 7982934b-8c0f-4403-8607-2a2679070e02] Received unexpected event network-vif-plugged-2273063c-59ad-4c22-baac-b35f81cddd68 for instance with vm_state active and task_state deleting.
Nov 29 20:28:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:28:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:28:46 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Deleted allocations for instance 7982934b-8c0f-4403-8607-2a2679070e02
Nov 29 20:28:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1e27a0a8-e598-4d2a-b846-d862fd36d50a tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "7982934b-8c0f-4403-8607-2a2679070e02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.832s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:28:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:28:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:52 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:28:52 user nova-compute[75356]: INFO nova.compute.claims [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Claim successful on node user
Nov 29 20:28:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:52 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:28:52 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:28:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.629s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:28:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:28:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:28:53 user nova-compute[75356]: DEBUG nova.network.neutron [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:28:53 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:28:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:28:53 user nova-compute[75356]: DEBUG nova.policy [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e395b4248b794d65915edf2d23bbbeaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed33acdfd5f48b9967d1dd68c261d78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:28:53 user nova-compute[75356]: INFO nova.virt.block_device [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Booting with volume-backed-image 6ec9e8df-1fe5-47a2-a649-880c9c3e5f36 at /dev/vda
Nov 29 20:28:53 user nova-compute[75356]: DEBUG nova.network.neutron [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Successfully created port: 084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:28:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:54 user nova-compute[75356]: DEBUG nova.network.neutron [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Successfully updated port: 084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:28:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "refresh_cache-c477f425-e9ce-4b3a-b21a-8bf04401ad0b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:28:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquired lock "refresh_cache-c477f425-e9ce-4b3a-b21a-8bf04401ad0b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:28:54 user nova-compute[75356]: DEBUG nova.network.neutron [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:28:54 user nova-compute[75356]: DEBUG nova.compute.manager [req-edc20d23-c79c-4b6d-ba61-5f0bffca1043 req-0c8ff2e4-8534-451f-836b-87abd299a7fe service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received event network-changed-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:28:54 user nova-compute[75356]: DEBUG nova.compute.manager [req-edc20d23-c79c-4b6d-ba61-5f0bffca1043 req-0c8ff2e4-8534-451f-836b-87abd299a7fe service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Refreshing instance network info cache due to event network-changed-084eeeb2-bcff-437d-ac75-85936e641045. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:28:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-edc20d23-c79c-4b6d-ba61-5f0bffca1043 req-0c8ff2e4-8534-451f-836b-87abd299a7fe service nova] Acquiring lock "refresh_cache-c477f425-e9ce-4b3a-b21a-8bf04401ad0b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:28:54 user nova-compute[75356]: DEBUG nova.network.neutron [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:28:55 user nova-compute[75356]: DEBUG nova.network.neutron [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Updating instance_info_cache with network_info: [{"id": "084eeeb2-bcff-437d-ac75-85936e641045", "address": "fa:16:3e:a1:86:c2", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084eeeb2-bc", "ovs_interfaceid": "084eeeb2-bcff-437d-ac75-85936e641045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:28:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Releasing lock "refresh_cache-c477f425-e9ce-4b3a-b21a-8bf04401ad0b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:28:55 user nova-compute[75356]: DEBUG nova.compute.manager [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Instance network_info: |[{"id": "084eeeb2-bcff-437d-ac75-85936e641045", "address": "fa:16:3e:a1:86:c2", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084eeeb2-bc", "ovs_interfaceid": "084eeeb2-bcff-437d-ac75-85936e641045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:28:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-edc20d23-c79c-4b6d-ba61-5f0bffca1043 req-0c8ff2e4-8534-451f-836b-87abd299a7fe service nova] Acquired lock "refresh_cache-c477f425-e9ce-4b3a-b21a-8bf04401ad0b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:28:55 user nova-compute[75356]: DEBUG nova.network.neutron [req-edc20d23-c79c-4b6d-ba61-5f0bffca1043 req-0c8ff2e4-8534-451f-836b-87abd299a7fe service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Refreshing network info cache for port 084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:28:56 user nova-compute[75356]: DEBUG nova.network.neutron [req-edc20d23-c79c-4b6d-ba61-5f0bffca1043 req-0c8ff2e4-8534-451f-836b-87abd299a7fe service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Updated VIF entry in instance network info cache for port 084eeeb2-bcff-437d-ac75-85936e641045. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:28:56 user nova-compute[75356]: DEBUG nova.network.neutron [req-edc20d23-c79c-4b6d-ba61-5f0bffca1043 req-0c8ff2e4-8534-451f-836b-87abd299a7fe service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Updating instance_info_cache with network_info: [{"id": "084eeeb2-bcff-437d-ac75-85936e641045", "address": "fa:16:3e:a1:86:c2", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084eeeb2-bc", "ovs_interfaceid": "084eeeb2-bcff-437d-ac75-85936e641045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:28:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-edc20d23-c79c-4b6d-ba61-5f0bffca1043 req-0c8ff2e4-8534-451f-836b-87abd299a7fe service nova] Releasing lock "refresh_cache-c477f425-e9ce-4b3a-b21a-8bf04401ad0b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:28:57 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:28:57 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:28:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "1e818d19-e8e8-4e41-83b4-53888ea21c93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:58 user nova-compute[75356]: DEBUG nova.compute.manager [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:28:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:58 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:28:58 user nova-compute[75356]: INFO nova.compute.claims [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Claim successful on node user
Nov 29 20:28:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:28:59 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:28:59 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:28:59 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:28:59 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:28:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.683s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:28:59 user nova-compute[75356]: DEBUG nova.compute.manager [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:28:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:28:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:28:59 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:28:59 user nova-compute[75356]: DEBUG nova.compute.manager [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:28:59 user nova-compute[75356]: DEBUG nova.network.neutron [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:28:59 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:28:59 user nova-compute[75356]: DEBUG nova.compute.manager [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:28:59 user nova-compute[75356]: DEBUG nova.policy [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a111049bab1401cbe074a03692b43af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b97f9fbbb34b22ab013e1892dc91c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:28:59 user nova-compute[75356]: DEBUG nova.compute.manager [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:28:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:28:59 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Creating image(s)
Nov 29 20:28:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "/opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:28:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "/opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.017s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:28:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "2a2834f55fdcae3559c708e72fc6a4141faf8438" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:28:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "2a2834f55fdcae3559c708e72fc6a4141faf8438" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a2834f55fdcae3559c708e72fc6a4141faf8438.part --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:00 user nova-compute[75356]: DEBUG nova.network.neutron [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Successfully created port: 34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:29:00 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Updating instance_info_cache with network_info: [{"id": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "address": "fa:16:3e:91:30:da", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a14e591-f6", "ovs_interfaceid": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:29:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a2834f55fdcae3559c708e72fc6a4141faf8438.part --force-share --output=json" returned: 0 in 0.202s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:00 user nova-compute[75356]: DEBUG nova.virt.images [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] 107e2895-8c31-433b-b0ad-c9cadf20f693 was qcow2, converting to raw {{(pid=75356) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 20:29:00 user nova-compute[75356]: DEBUG nova.privsep.utils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75356) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 20:29:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2a2834f55fdcae3559c708e72fc6a4141faf8438.part /opt/stack/data/nova/instances/_base/2a2834f55fdcae3559c708e72fc6a4141faf8438.converted {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:29:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.network.neutron [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Successfully updated port: 34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "refresh_cache-1e818d19-e8e8-4e41-83b4-53888ea21c93" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquired lock "refresh_cache-1e818d19-e8e8-4e41-83b4-53888ea21c93" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.network.neutron [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.compute.manager [req-a9511c03-c135-4afa-b1c3-65aa2a7bbe08 req-5aafd5fd-3f9f-4bfc-bce8-6db16295e1c2 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Received event network-changed-34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.compute.manager [req-a9511c03-c135-4afa-b1c3-65aa2a7bbe08 req-5aafd5fd-3f9f-4bfc-bce8-6db16295e1c2 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Refreshing instance network info cache due to event network-changed-34d23443-7a73-4de5-972d-6c33ecf3e589. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a9511c03-c135-4afa-b1c3-65aa2a7bbe08 req-5aafd5fd-3f9f-4bfc-bce8-6db16295e1c2 service nova] Acquiring lock "refresh_cache-1e818d19-e8e8-4e41-83b4-53888ea21c93" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2a2834f55fdcae3559c708e72fc6a4141faf8438.part /opt/stack/data/nova/instances/_base/2a2834f55fdcae3559c708e72fc6a4141faf8438.converted" returned: 0 in 0.613s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a2834f55fdcae3559c708e72fc6a4141faf8438.converted --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpDYLhsZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:29:01 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:29:01 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:29:01 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b -p 172.16.0.220:3260" returned: 21 in 0.068s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7445a84-0a42-400b-a5db-d618fbc6fd4a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:29:01 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a2834f55fdcae3559c708e72fc6a4141faf8438.converted --force-share --output=json" returned: 0 in 0.245s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "2a2834f55fdcae3559c708e72fc6a4141faf8438" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.653s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[572d95a8-8105-4d04-bdc7-e1f3b775798c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b] added
Nov 29 20:29:01 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a2834f55fdcae3559c708e72fc6a4141faf8438 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.079s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1172bb-5ce0-42ac-a6a7-5e9812f7e575]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb27ea1-a20f-4977-8d90-ea3e262a154a]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XpDYLhsZ {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XpDYLhsZ" returned: 0 in 0.031s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f2179e-2192-42a9-915f-fac6b0fa4132]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XpDYLhsZ'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab43f3c-36dc-45ce-960a-f4dac94f20a7]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.network.neutron [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:29:01 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Creating image(s)
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Did not create local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Ensure instance console log exists: /opt/stack/data/nova/instances/873a45a7-a06f-4bcd-b517-d6f0ade7e5a3/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Start _get_guest_xml network_info=[{"id": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "address": "fa:16:3e:ed:a6:4a", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c2f7e-7d", "ovs_interfaceid": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixFVyosu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '873a45a7-a06f-4bcd-b517-d6f0ade7e5a3', 'attached_at': '', 'detached_at': '', 'volume_id': '33217dc4-b5a2-4843-87d8-ca6acb430f09', 'serial': '33217dc4-b5a2-4843-87d8-ca6acb430f09'}, 'attachment_id': '4acbe837-b094-4f8b-98e2-2104bfcb9316', 'volume_type': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a2834f55fdcae3559c708e72fc6a4141faf8438 --force-share --output=json" returned: 0 in 0.234s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91815c3-7374-4c23-bb68-e7ee33ebf73f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "2a2834f55fdcae3559c708e72fc6a4141faf8438" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "2a2834f55fdcae3559c708e72fc6a4141faf8438" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a2834f55fdcae3559c708e72fc6a4141faf8438 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:29:01 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:29:01 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:29:01 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:29:01 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:01 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:29:01 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixFVyosu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:29:01 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[167d2f9a-7ca5-47d3-8552-75fc623cd75a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b, portal: 172.16.0.220,3260]
Nov 29 20:29:01 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b, portal: 172.16.0.220,3260] successful.
Nov 29 20:29:01 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[587d0747-bd74-4c64-9f40-67c2d4e744aa]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e6edaf-0aa0-42d0-9909-44a1d66a9c6d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:29:01 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:29:01 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:29:01 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:29:01 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:29:01 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:29:01 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.569s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a2834f55fdcae3559c708e72fc6a4141faf8438 --force-share --output=json" returned: 0 in 0.219s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a2834f55fdcae3559c708e72fc6a4141faf8438,backing_fmt=raw /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f409d1-53ca-4459-b2a0-33f08a0837ac]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpDYLhsZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a2834f55fdcae3559c708e72fc6a4141faf8438,backing_fmt=raw /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk 1073741824" returned: 0 in 0.058s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "2a2834f55fdcae3559c708e72fc6a4141faf8438" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a2834f55fdcae3559c708e72fc6a4141faf8438 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:01 user nova-compute[75356]: DEBUG nova.network.neutron [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Updating instance_info_cache with network_info: [{"id": "34d23443-7a73-4de5-972d-6c33ecf3e589", "address": "fa:16:3e:74:01:d5", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d23443-7a", "ovs_interfaceid": "34d23443-7a73-4de5-972d-6c33ecf3e589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Releasing lock "refresh_cache-1e818d19-e8e8-4e41-83b4-53888ea21c93" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.compute.manager [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Instance network_info: |[{"id": "34d23443-7a73-4de5-972d-6c33ecf3e589", "address": "fa:16:3e:74:01:d5", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d23443-7a", "ovs_interfaceid": "34d23443-7a73-4de5-972d-6c33ecf3e589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a9511c03-c135-4afa-b1c3-65aa2a7bbe08 req-5aafd5fd-3f9f-4bfc-bce8-6db16295e1c2 service nova] Acquired lock "refresh_cache-1e818d19-e8e8-4e41-83b4-53888ea21c93" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.network.neutron [req-a9511c03-c135-4afa-b1c3-65aa2a7bbe08 req-5aafd5fd-3f9f-4bfc-bce8-6db16295e1c2 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Refreshing network info cache for port 34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a2834f55fdcae3559c708e72fc6a4141faf8438 --force-share --output=json" returned: 0 in 0.194s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Cannot resize image /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Ensure instance console log exists: /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Start _get_guest_xml network_info=[{"id": "34d23443-7a73-4de5-972d-6c33ecf3e589", "address": "fa:16:3e:74:01:d5", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d23443-7a", "ovs_interfaceid": "34d23443-7a73-4de5-972d-6c33ecf3e589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:28:54Z,direct_url=<?>,disk_format='qcow2',id=107e2895-8c31-433b-b0ad-c9cadf20f693,min_disk=0,min_ram=0,name='tempest-scenario-img--1774309791',owner='11b97f9fbbb34b22ab013e1892dc91c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:28:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '107e2895-8c31-433b-b0ad-c9cadf20f693'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:29:02 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:29:02 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:29:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:28:54Z,direct_url=<?>,disk_format='qcow2',id=107e2895-8c31-433b-b0ad-c9cadf20f693,min_disk=0,min_ram=0,name='tempest-scenario-img--1774309791',owner='11b97f9fbbb34b22ab013e1892dc91c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:28:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:28:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-432095143',display_name='tempest-TestMinimumBasicScenario-server-432095143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-432095143',id=32,image_ref='107e2895-8c31-433b-b0ad-c9cadf20f693',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP20ADnO7ShB+++7hmlI1hDB+A3N0a6D8B4tazU/BSZ85WXgZZgkMXZKn//STQQevmVFinZMFXAAXQnCpTqyk3d8kwk47aFVBtiCC7Ft6IAn9HES9kUWYi4ZuFJyH0hDuA==',key_name='tempest-TestMinimumBasicScenario-1504152284',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11b97f9fbbb34b22ab013e1892dc91c1',ramdisk_id='',reservation_id='r-65b73uo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='107e2895-8c31-433b-b0ad-c9cadf20f693',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1742449158',owner_user_name='tempest-TestMinimumBasicScenario-1742449158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:29:00Z,user_data=None,user_id='4a111049bab1401cbe074a03692b43af',uuid=1e818d19-e8e8-4e41-83b4-53888ea21c93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34d23443-7a73-4de5-972d-6c33ecf3e589", "address": "fa:16:3e:74:01:d5", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d23443-7a", "ovs_interfaceid": "34d23443-7a73-4de5-972d-6c33ecf3e589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Converting VIF {"id": "34d23443-7a73-4de5-972d-6c33ecf3e589", "address": "fa:16:3e:74:01:d5", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d23443-7a", "ovs_interfaceid": "34d23443-7a73-4de5-972d-6c33ecf3e589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:01:d5,bridge_name='br-int',has_traffic_filtering=True,id=34d23443-7a73-4de5-972d-6c33ecf3e589,network=Network(7408e82d-2d0b-45c2-8f7d-1b4c69cc6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d23443-7a') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.objects.instance [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e818d19-e8e8-4e41-83b4-53888ea21c93 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:29:02 user nova-compute[75356]:   <uuid>1e818d19-e8e8-4e41-83b4-53888ea21c93</uuid>
Nov 29 20:29:02 user nova-compute[75356]:   <name>instance-00000020</name>
Nov 29 20:29:02 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:29:02 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:29:02 user nova-compute[75356]:   <metadata>
Nov 29 20:29:02 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:29:02 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:29:02 user nova-compute[75356]:       <nova:name>tempest-TestMinimumBasicScenario-server-432095143</nova:name>
Nov 29 20:29:02 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:29:02</nova:creationTime>
Nov 29 20:29:02 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:29:02 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:29:02 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:29:02 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:29:02 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:29:02 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:29:02 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:29:02 user nova-compute[75356]:       <nova:owner>
Nov 29 20:29:02 user nova-compute[75356]:         <nova:user uuid="4a111049bab1401cbe074a03692b43af">tempest-TestMinimumBasicScenario-1742449158-project-member</nova:user>
Nov 29 20:29:02 user nova-compute[75356]:         <nova:project uuid="11b97f9fbbb34b22ab013e1892dc91c1">tempest-TestMinimumBasicScenario-1742449158</nova:project>
Nov 29 20:29:02 user nova-compute[75356]:       </nova:owner>
Nov 29 20:29:02 user nova-compute[75356]:       <nova:root type="image" uuid="107e2895-8c31-433b-b0ad-c9cadf20f693"/>
Nov 29 20:29:02 user nova-compute[75356]:       <nova:ports>
Nov 29 20:29:02 user nova-compute[75356]:         <nova:port uuid="34d23443-7a73-4de5-972d-6c33ecf3e589">
Nov 29 20:29:02 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 20:29:02 user nova-compute[75356]:         </nova:port>
Nov 29 20:29:02 user nova-compute[75356]:       </nova:ports>
Nov 29 20:29:02 user nova-compute[75356]:     </nova:instance>
Nov 29 20:29:02 user nova-compute[75356]:   </metadata>
Nov 29 20:29:02 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:29:02 user nova-compute[75356]:     <system>
Nov 29 20:29:02 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:29:02 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:29:02 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:29:02 user nova-compute[75356]:       <entry name="serial">1e818d19-e8e8-4e41-83b4-53888ea21c93</entry>
Nov 29 20:29:02 user nova-compute[75356]:       <entry name="uuid">1e818d19-e8e8-4e41-83b4-53888ea21c93</entry>
Nov 29 20:29:02 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:29:02 user nova-compute[75356]:     </system>
Nov 29 20:29:02 user nova-compute[75356]:   </sysinfo>
Nov 29 20:29:02 user nova-compute[75356]:   <os>
Nov 29 20:29:02 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:29:02 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:29:02 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:29:02 user nova-compute[75356]:   </os>
Nov 29 20:29:02 user nova-compute[75356]:   <features>
Nov 29 20:29:02 user nova-compute[75356]:     <acpi/>
Nov 29 20:29:02 user nova-compute[75356]:     <apic/>
Nov 29 20:29:02 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:29:02 user nova-compute[75356]:   </features>
Nov 29 20:29:02 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:29:02 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:29:02 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:29:02 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:29:02 user nova-compute[75356]:   </clock>
Nov 29 20:29:02 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:29:02 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:29:02 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:29:02 user nova-compute[75356]:   </cpu>
Nov 29 20:29:02 user nova-compute[75356]:   <devices>
Nov 29 20:29:02 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:29:02 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:29:02 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk"/>
Nov 29 20:29:02 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:29:02 user nova-compute[75356]:     </disk>
Nov 29 20:29:02 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:29:02 user nova-compute[75356]:       <mac address="fa:16:3e:74:01:d5"/>
Nov 29 20:29:02 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:29:02 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:29:02 user nova-compute[75356]:       <target dev="tap34d23443-7a"/>
Nov 29 20:29:02 user nova-compute[75356]:     </interface>
Nov 29 20:29:02 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:29:02 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/console.log" append="off"/>
Nov 29 20:29:02 user nova-compute[75356]:     </serial>
Nov 29 20:29:02 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:29:02 user nova-compute[75356]:     <video>
Nov 29 20:29:02 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:29:02 user nova-compute[75356]:     </video>
Nov 29 20:29:02 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:29:02 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:29:02 user nova-compute[75356]:     </rng>
Nov 29 20:29:02 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:29:02 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:29:02 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:29:02 user nova-compute[75356]:     </memballoon>
Nov 29 20:29:02 user nova-compute[75356]:   </devices>
Nov 29 20:29:02 user nova-compute[75356]: </domain>
Nov 29 20:29:02 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:28:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-432095143',display_name='tempest-TestMinimumBasicScenario-server-432095143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-432095143',id=32,image_ref='107e2895-8c31-433b-b0ad-c9cadf20f693',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP20ADnO7ShB+++7hmlI1hDB+A3N0a6D8B4tazU/BSZ85WXgZZgkMXZKn//STQQevmVFinZMFXAAXQnCpTqyk3d8kwk47aFVBtiCC7Ft6IAn9HES9kUWYi4ZuFJyH0hDuA==',key_name='tempest-TestMinimumBasicScenario-1504152284',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11b97f9fbbb34b22ab013e1892dc91c1',ramdisk_id='',reservation_id='r-65b73uo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='107e2895-8c31-433b-b0ad-c9cadf20f693',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1742449158',owner_user_name='tempest-TestMinimumBasicScenario-1742449158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:29:00Z,user_data=None,user_id='4a111049bab1401cbe074a03692b43af',uuid=1e818d19-e8e8-4e41-83b4-53888ea21c93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34d23443-7a73-4de5-972d-6c33ecf3e589", "address": "fa:16:3e:74:01:d5", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d23443-7a", "ovs_interfaceid": "34d23443-7a73-4de5-972d-6c33ecf3e589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Converting VIF {"id": "34d23443-7a73-4de5-972d-6c33ecf3e589", "address": "fa:16:3e:74:01:d5", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d23443-7a", "ovs_interfaceid": "34d23443-7a73-4de5-972d-6c33ecf3e589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:01:d5,bridge_name='br-int',has_traffic_filtering=True,id=34d23443-7a73-4de5-972d-6c33ecf3e589,network=Network(7408e82d-2d0b-45c2-8f7d-1b4c69cc6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d23443-7a') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG os_vif [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:01:d5,bridge_name='br-int',has_traffic_filtering=True,id=34d23443-7a73-4de5-972d-6c33ecf3e589,network=Network(7408e82d-2d0b-45c2-8f7d-1b4c69cc6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d23443-7a') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '164fd096-7965-5b77-99f4-272f881d6676', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34d23443-7a, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap34d23443-7a, col_values=(('qos', UUID('1b338131-2b82-4f07-a751-88efab52fc5b')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap34d23443-7a, col_values=(('external_ids', {'iface-id': '34d23443-7a73-4de5-972d-6c33ecf3e589', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:01:d5', 'vm-uuid': '1e818d19-e8e8-4e41-83b4-53888ea21c93'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:02 user nova-compute[75356]: INFO os_vif [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:01:d5,bridge_name='br-int',has_traffic_filtering=True,id=34d23443-7a73-4de5-972d-6c33ecf3e589,network=Network(7408e82d-2d0b-45c2-8f7d-1b4c69cc6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d23443-7a')
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] No VIF found with MAC fa:16:3e:74:01:d5, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.network.neutron [req-a9511c03-c135-4afa-b1c3-65aa2a7bbe08 req-5aafd5fd-3f9f-4bfc-bce8-6db16295e1c2 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Updated VIF entry in instance network info cache for port 34d23443-7a73-4de5-972d-6c33ecf3e589. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.network.neutron [req-a9511c03-c135-4afa-b1c3-65aa2a7bbe08 req-5aafd5fd-3f9f-4bfc-bce8-6db16295e1c2 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Updating instance_info_cache with network_info: [{"id": "34d23443-7a73-4de5-972d-6c33ecf3e589", "address": "fa:16:3e:74:01:d5", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d23443-7a", "ovs_interfaceid": "34d23443-7a73-4de5-972d-6c33ecf3e589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a9511c03-c135-4afa-b1c3-65aa2a7bbe08 req-5aafd5fd-3f9f-4bfc-bce8-6db16295e1c2 service nova] Releasing lock "refresh_cache-1e818d19-e8e8-4e41-83b4-53888ea21c93" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.629s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] <== connect_volume: return (1632ms) {'type': 'block', 'scsi_wwn': '26536646430343432', 'path': '/dev/sdd'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536646430343432', 'path': '/dev/sdd'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.130s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:29:02 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:29:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:29:02 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.objects.instance [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lazy-loading 'flavor' on Instance uuid ee5bef74-04c5-4de1-8f8e-4baba05e2a6d {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8eea7f5-8a49-4faf-a5e6-976b03a693c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:29:02 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:29:02 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:29:02 user nova-compute[75356]:   <source dev="/dev/sdd"/>
Nov 29 20:29:02 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:29:02 user nova-compute[75356]:   <serial>5fcdf78a-5709-4998-bb2e-cd3b21393f4b</serial>
Nov 29 20:29:02 user nova-compute[75356]: </disk>
Nov 29 20:29:02 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e905e54-34cf-4ff8-b82e-c71a702280d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09] added
Nov 29 20:29:02 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5551915-955a-4755-b7f7-b4c33a9a775f]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd67c7a-74bf-4a25-8ff8-90e0eb985e5c]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ixFVyosu {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ixFVyosu" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f8e35e-54f1-4348-9ca1-dfe75ec6dffa]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ixFVyosu'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b062e16c-f13e-4414-8dda-5e6f26f6ba4c]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c7c6d4-af9a-40c8-9c2a-40543ce43464]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:29:03 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:29:03 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:29:03 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:29:03 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:29:03 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:29:03 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be469b2-f93f-4167-8299-bb7889030af8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09, portal: 172.16.0.220,3260]
Nov 29 20:29:03 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09, portal: 172.16.0.220,3260] successful.
Nov 29 20:29:03 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d7071d-d5da-4fdc-a706-0cb886bc6814]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b272ba-f7ec-40ec-884e-374957e014eb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:29:03 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:29:03 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:29:03 user nova-compute[75356]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:29:03 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:29:03 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:29:03 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:29:03 user nova-compute[75356]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:29:03 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[946270bc-33f2-412b-9d90-760582548488]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixFVyosu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] No VIF found with MAC fa:16:3e:1d:8d:b3, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] <== connect_volume: return (2526ms) {'type': 'block', 'scsi_wwn': '26264626138366233', 'path': '/dev/sde'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264626138366233', 'path': '/dev/sde'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:28:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2053095889',display_name='tempest-ServerActionsTestOtherA-server-2053095889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2053095889',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBES/hmUhRPMEp7jxGNAJkTADe+ykaGX7onK5o5CXk4BGHWdyPerc54MOJxjy4wx3hHylMSlWH2Wjk+mHShNqdbk6ZSJg34jMi+lLZfOCW4j+M+c+q1Lzq5VJUbAeMltLBQ==',key_name='tempest-keypair-777625238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b14efb1a4d34a3db7a51bd79234b86b',ramdisk_id='',reservation_id='r-nplu3go6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1000495362',owner_user_name='tempest-ServerActionsTestOtherA-1000495362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:28:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc7cfc71d0c448cbbe8d42f8b617d8b',uuid=873a45a7-a06f-4bcd-b517-d6f0ade7e5a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "address": "fa:16:3e:ed:a6:4a", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c2f7e-7d", "ovs_interfaceid": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converting VIF {"id": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "address": "fa:16:3e:ed:a6:4a", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c2f7e-7d", "ovs_interfaceid": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:4a,bridge_name='br-int',has_traffic_filtering=True,id=803c2f7e-7d7c-46aa-b1a8-63165a13b9a1,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803c2f7e-7d') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG nova.objects.instance [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lazy-loading 'pci_devices' on Instance uuid 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG os_brick.utils [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:29:04 user nova-compute[75356]:   <uuid>873a45a7-a06f-4bcd-b517-d6f0ade7e5a3</uuid>
Nov 29 20:29:04 user nova-compute[75356]:   <name>instance-0000001e</name>
Nov 29 20:29:04 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:29:04 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:29:04 user nova-compute[75356]:   <metadata>
Nov 29 20:29:04 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:29:04 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:29:04 user nova-compute[75356]:       <nova:name>tempest-ServerActionsTestOtherA-server-2053095889</nova:name>
Nov 29 20:29:04 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:29:01</nova:creationTime>
Nov 29 20:29:04 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:29:04 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:29:04 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:29:04 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:29:04 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:29:04 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:29:04 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:29:04 user nova-compute[75356]:       <nova:owner>
Nov 29 20:29:04 user nova-compute[75356]:         <nova:user uuid="abc7cfc71d0c448cbbe8d42f8b617d8b">tempest-ServerActionsTestOtherA-1000495362-project-member</nova:user>
Nov 29 20:29:04 user nova-compute[75356]:         <nova:project uuid="8b14efb1a4d34a3db7a51bd79234b86b">tempest-ServerActionsTestOtherA-1000495362</nova:project>
Nov 29 20:29:04 user nova-compute[75356]:       </nova:owner>
Nov 29 20:29:04 user nova-compute[75356]:       <nova:ports>
Nov 29 20:29:04 user nova-compute[75356]:         <nova:port uuid="803c2f7e-7d7c-46aa-b1a8-63165a13b9a1">
Nov 29 20:29:04 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 20:29:04 user nova-compute[75356]:         </nova:port>
Nov 29 20:29:04 user nova-compute[75356]:       </nova:ports>
Nov 29 20:29:04 user nova-compute[75356]:     </nova:instance>
Nov 29 20:29:04 user nova-compute[75356]:   </metadata>
Nov 29 20:29:04 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:29:04 user nova-compute[75356]:     <system>
Nov 29 20:29:04 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:29:04 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:29:04 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:29:04 user nova-compute[75356]:       <entry name="serial">873a45a7-a06f-4bcd-b517-d6f0ade7e5a3</entry>
Nov 29 20:29:04 user nova-compute[75356]:       <entry name="uuid">873a45a7-a06f-4bcd-b517-d6f0ade7e5a3</entry>
Nov 29 20:29:04 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:29:04 user nova-compute[75356]:     </system>
Nov 29 20:29:04 user nova-compute[75356]:   </sysinfo>
Nov 29 20:29:04 user nova-compute[75356]:   <os>
Nov 29 20:29:04 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:29:04 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:29:04 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:29:04 user nova-compute[75356]:   </os>
Nov 29 20:29:04 user nova-compute[75356]:   <features>
Nov 29 20:29:04 user nova-compute[75356]:     <acpi/>
Nov 29 20:29:04 user nova-compute[75356]:     <apic/>
Nov 29 20:29:04 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:29:04 user nova-compute[75356]:   </features>
Nov 29 20:29:04 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:29:04 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:29:04 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:29:04 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:29:04 user nova-compute[75356]:   </clock>
Nov 29 20:29:04 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:29:04 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:29:04 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:29:04 user nova-compute[75356]:   </cpu>
Nov 29 20:29:04 user nova-compute[75356]:   <devices>
Nov 29 20:29:04 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:29:04 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:29:04 user nova-compute[75356]:       <source dev="/dev/sde"/>
Nov 29 20:29:04 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:29:04 user nova-compute[75356]:       <serial>33217dc4-b5a2-4843-87d8-ca6acb430f09</serial>
Nov 29 20:29:04 user nova-compute[75356]:     </disk>
Nov 29 20:29:04 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:29:04 user nova-compute[75356]:       <mac address="fa:16:3e:ed:a6:4a"/>
Nov 29 20:29:04 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:29:04 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:29:04 user nova-compute[75356]:       <target dev="tap803c2f7e-7d"/>
Nov 29 20:29:04 user nova-compute[75356]:     </interface>
Nov 29 20:29:04 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:29:04 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/873a45a7-a06f-4bcd-b517-d6f0ade7e5a3/console.log" append="off"/>
Nov 29 20:29:04 user nova-compute[75356]:     </serial>
Nov 29 20:29:04 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:29:04 user nova-compute[75356]:     <video>
Nov 29 20:29:04 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:29:04 user nova-compute[75356]:     </video>
Nov 29 20:29:04 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:29:04 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:29:04 user nova-compute[75356]:     </rng>
Nov 29 20:29:04 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:29:04 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:29:04 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:29:04 user nova-compute[75356]:     </memballoon>
Nov 29 20:29:04 user nova-compute[75356]:   </devices>
Nov 29 20:29:04 user nova-compute[75356]: </domain>
Nov 29 20:29:04 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:28:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2053095889',display_name='tempest-ServerActionsTestOtherA-server-2053095889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2053095889',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBES/hmUhRPMEp7jxGNAJkTADe+ykaGX7onK5o5CXk4BGHWdyPerc54MOJxjy4wx3hHylMSlWH2Wjk+mHShNqdbk6ZSJg34jMi+lLZfOCW4j+M+c+q1Lzq5VJUbAeMltLBQ==',key_name='tempest-keypair-777625238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b14efb1a4d34a3db7a51bd79234b86b',ramdisk_id='',reservation_id='r-nplu3go6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1000495362',owner_user_name='tempest-ServerActionsTestOtherA-1000495362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:28:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc7cfc71d0c448cbbe8d42f8b617d8b',uuid=873a45a7-a06f-4bcd-b517-d6f0ade7e5a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "address": "fa:16:3e:ed:a6:4a", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c2f7e-7d", "ovs_interfaceid": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converting VIF {"id": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "address": "fa:16:3e:ed:a6:4a", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c2f7e-7d", "ovs_interfaceid": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:4a,bridge_name='br-int',has_traffic_filtering=True,id=803c2f7e-7d7c-46aa-b1a8-63165a13b9a1,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803c2f7e-7d') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG os_vif [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:4a,bridge_name='br-int',has_traffic_filtering=True,id=803c2f7e-7d7c-46aa-b1a8-63165a13b9a1,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803c2f7e-7d') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae2f3ae-d910-49aa-b7f2-e1b12e919bd0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7966181a-1e7f-5dbb-a2a4-82bbe38f1404', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-281ca1bf-8f31-4c32-b352-dced49f72076 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.422s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap803c2f7e-7d, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap803c2f7e-7d, col_values=(('qos', UUID('e602859a-308d-4857-80fc-88baeace9ff0')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap803c2f7e-7d, col_values=(('external_ids', {'iface-id': '803c2f7e-7d7c-46aa-b1a8-63165a13b9a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:a6:4a', 'vm-uuid': '873a45a7-a06f-4bcd-b517-d6f0ade7e5a3'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:04 user nova-compute[75356]: INFO os_vif [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:4a,bridge_name='br-int',has_traffic_filtering=True,id=803c2f7e-7d7c-46aa-b1a8-63165a13b9a1,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803c2f7e-7d')
Nov 29 20:29:04 user nova-compute[75356]: DEBUG nova.compute.manager [req-ef02cde4-8809-49f1-b26a-f8c7e8ba918a req-594f97f3-b878-49e2-8996-d507fc34be2d service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Received event network-vif-plugged-34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ef02cde4-8809-49f1-b26a-f8c7e8ba918a req-594f97f3-b878-49e2-8996-d507fc34be2d service nova] Acquiring lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ef02cde4-8809-49f1-b26a-f8c7e8ba918a req-594f97f3-b878-49e2-8996-d507fc34be2d service nova] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ef02cde4-8809-49f1-b26a-f8c7e8ba918a req-594f97f3-b878-49e2-8996-d507fc34be2d service nova] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG nova.compute.manager [req-ef02cde4-8809-49f1-b26a-f8c7e8ba918a req-594f97f3-b878-49e2-8996-d507fc34be2d service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] No waiting events found dispatching network-vif-plugged-34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:29:04 user nova-compute[75356]: WARNING nova.compute.manager [req-ef02cde4-8809-49f1-b26a-f8c7e8ba918a req-594f97f3-b878-49e2-8996-d507fc34be2d service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Received unexpected event network-vif-plugged-34d23443-7a73-4de5-972d-6c33ecf3e589 for instance with vm_state building and task_state spawning.
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.030s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ca05de-e622-4cc6-9f31-5697da5dc8d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc665656-1809-459d-8d87-8cc7bd3a032c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf2f0bb-fde2-4917-ad1b-5f784420fabc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] No VIF found with MAC fa:16:3e:ed:a6:4a, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:29:04 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed33c6a-5b9d-4883-ad0f-d5c3278dd7a7]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG os_brick.utils [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] <== get_connector_properties: return (217ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Updating existing volume attachment record: 2b70ac89-f88b-4296-ae3a-d231cd258eb0 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.compute.manager [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-5d4151ff-27ce-497c-ae80-3f869a3f734c req-c38315da-09fb-40bf-924f-df3b802181df service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Received event network-vif-plugged-34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5d4151ff-27ce-497c-ae80-3f869a3f734c req-c38315da-09fb-40bf-924f-df3b802181df service nova] Acquiring lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5d4151ff-27ce-497c-ae80-3f869a3f734c req-c38315da-09fb-40bf-924f-df3b802181df service nova] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5d4151ff-27ce-497c-ae80-3f869a3f734c req-c38315da-09fb-40bf-924f-df3b802181df service nova] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-5d4151ff-27ce-497c-ae80-3f869a3f734c req-c38315da-09fb-40bf-924f-df3b802181df service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] No waiting events found dispatching network-vif-plugged-34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:29:08 user nova-compute[75356]: WARNING nova.compute.manager [req-5d4151ff-27ce-497c-ae80-3f869a3f734c req-c38315da-09fb-40bf-924f-df3b802181df service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Received unexpected event network-vif-plugged-34d23443-7a73-4de5-972d-6c33ecf3e589 for instance with vm_state building and task_state spawning.
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-5d4151ff-27ce-497c-ae80-3f869a3f734c req-c38315da-09fb-40bf-924f-df3b802181df service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Received event network-vif-plugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5d4151ff-27ce-497c-ae80-3f869a3f734c req-c38315da-09fb-40bf-924f-df3b802181df service nova] Acquiring lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5d4151ff-27ce-497c-ae80-3f869a3f734c req-c38315da-09fb-40bf-924f-df3b802181df service nova] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5d4151ff-27ce-497c-ae80-3f869a3f734c req-c38315da-09fb-40bf-924f-df3b802181df service nova] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-5d4151ff-27ce-497c-ae80-3f869a3f734c req-c38315da-09fb-40bf-924f-df3b802181df service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] No waiting events found dispatching network-vif-plugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:29:08 user nova-compute[75356]: WARNING nova.compute.manager [req-5d4151ff-27ce-497c-ae80-3f869a3f734c req-c38315da-09fb-40bf-924f-df3b802181df service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Received unexpected event network-vif-plugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 for instance with vm_state building and task_state spawning.
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-5d4151ff-27ce-497c-ae80-3f869a3f734c req-c38315da-09fb-40bf-924f-df3b802181df service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Received event network-vif-plugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5d4151ff-27ce-497c-ae80-3f869a3f734c req-c38315da-09fb-40bf-924f-df3b802181df service nova] Acquiring lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5d4151ff-27ce-497c-ae80-3f869a3f734c req-c38315da-09fb-40bf-924f-df3b802181df service nova] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5d4151ff-27ce-497c-ae80-3f869a3f734c req-c38315da-09fb-40bf-924f-df3b802181df service nova] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-5d4151ff-27ce-497c-ae80-3f869a3f734c req-c38315da-09fb-40bf-924f-df3b802181df service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] No waiting events found dispatching network-vif-plugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:29:08 user nova-compute[75356]: WARNING nova.compute.manager [req-5d4151ff-27ce-497c-ae80-3f869a3f734c req-c38315da-09fb-40bf-924f-df3b802181df service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Received unexpected event network-vif-plugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 for instance with vm_state building and task_state spawning.
Nov 29 20:29:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "4b4df05b-79b4-401b-8fb2-4d3de35c5509" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "4b4df05b-79b4-401b-8fb2-4d3de35c5509" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:08 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Instance spawned successfully.
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:29:08 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Instance spawned successfully.
Nov 29 20:29:08 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:29:08 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=7796MB free_disk=25.009967803955078GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:08 user nova-compute[75356]: INFO nova.compute.manager [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Took 9.15 seconds to spawn the instance on the hypervisor.
Nov 29 20:29:08 user nova-compute[75356]: DEBUG nova.compute.manager [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:29:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0b59517a-c467-432a-a73a-d1460c1574e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:29:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:29:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance db0826f0-5fdc-47a8-ae36-5059844980c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:29:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:29:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 93183110-d2e2-4da7-ab7d-73378f5e0d42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:29:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:29:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ee5bef74-04c5-4de1-8f8e-4baba05e2a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:29:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance c3bb4cde-968f-4474-abcd-8dbd73300865 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:29:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:29:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance c477f425-e9ce-4b3a-b21a-8bf04401ad0b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:29:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 1e818d19-e8e8-4e41-83b4-53888ea21c93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:29:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4b4df05b-79b4-401b-8fb2-4d3de35c5509 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 29 20:29:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:29:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:29:09 user nova-compute[75356]: INFO nova.compute.manager [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Took 7.50 seconds to spawn the instance on the hypervisor.
Nov 29 20:29:09 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:29:09 user nova-compute[75356]: INFO nova.compute.manager [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Took 10.52 seconds to build instance.
Nov 29 20:29:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f804cd4e-525b-4c4c-a19f-4c01fbbefded tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.646s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:09 user nova-compute[75356]: INFO nova.compute.manager [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Took 29.42 seconds to build instance.
Nov 29 20:29:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d9900f13-bf2e-43f3-a972-1dab30816a90 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.809s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:09 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:29:09 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:29:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:29:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.187s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.023s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:09 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:29:09 user nova-compute[75356]: INFO nova.compute.claims [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Claim successful on node user
Nov 29 20:29:10 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:29:10 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:29:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.740s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:10 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:29:10 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:29:10 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:29:10 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:29:10 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:29:10 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:29:10 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:29:10 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:29:10 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:29:10 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:29:10 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:29:10 user nova-compute[75356]: DEBUG nova.policy [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbdba4f436df4dbb896258c4f4d6b180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076539532d4847719e7fcf4165872bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:29:10 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:29:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:29:10 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Creating image(s)
Nov 29 20:29:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b4df05b-79b4-401b-8fb2-4d3de35c5509/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "/opt/stack/data/nova/instances/4b4df05b-79b4-401b-8fb2-4d3de35c5509/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "/opt/stack/data/nova/instances/4b4df05b-79b4-401b-8fb2-4d3de35c5509/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.227s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:11 user nova-compute[75356]: INFO nova.compute.manager [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Rescuing
Nov 29 20:29:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "refresh_cache-4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:29:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquired lock "refresh_cache-4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:29:11 user nova-compute[75356]: DEBUG nova.network.neutron [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:29:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.260s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/4b4df05b-79b4-401b-8fb2-4d3de35c5509/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/4b4df05b-79b4-401b-8fb2-4d3de35c5509/disk 1073741824" returned: 0 in 0.092s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.358s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.244s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:11 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b4df05b-79b4-401b-8fb2-4d3de35c5509/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:29:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4df05b-79b4-401b-8fb2-4d3de35c5509/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4df05b-79b4-401b-8fb2-4d3de35c5509/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:12 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Cannot resize image /opt/stack/data/nova/instances/4b4df05b-79b4-401b-8fb2-4d3de35c5509/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:29:12 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:29:12 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Ensure instance console log exists: /opt/stack/data/nova/instances/4b4df05b-79b4-401b-8fb2-4d3de35c5509/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:29:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:12 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Successfully created port: e1105bed-a3a6-49a8-87a7-775c72fa6bdf {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:29:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:12 user nova-compute[75356]: DEBUG nova.network.neutron [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Updating instance_info_cache with network_info: [{"id": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "address": "fa:16:3e:91:30:da", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a14e591-f6", "ovs_interfaceid": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:29:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Releasing lock "refresh_cache-4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:29:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:12 user nova-compute[75356]: DEBUG nova.compute.manager [req-3db7b941-9919-425f-bf3b-e457973125c6 req-34747b7a-9dee-464a-b398-60744fa590d4 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received event network-vif-unplugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:29:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3db7b941-9919-425f-bf3b-e457973125c6 req-34747b7a-9dee-464a-b398-60744fa590d4 service nova] Acquiring lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3db7b941-9919-425f-bf3b-e457973125c6 req-34747b7a-9dee-464a-b398-60744fa590d4 service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3db7b941-9919-425f-bf3b-e457973125c6 req-34747b7a-9dee-464a-b398-60744fa590d4 service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:12 user nova-compute[75356]: DEBUG nova.compute.manager [req-3db7b941-9919-425f-bf3b-e457973125c6 req-34747b7a-9dee-464a-b398-60744fa590d4 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] No waiting events found dispatching network-vif-unplugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:29:12 user nova-compute[75356]: WARNING nova.compute.manager [req-3db7b941-9919-425f-bf3b-e457973125c6 req-34747b7a-9dee-464a-b398-60744fa590d4 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received unexpected event network-vif-unplugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 for instance with vm_state active and task_state rescuing.
Nov 29 20:29:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Successfully updated port: e1105bed-a3a6-49a8-87a7-775c72fa6bdf {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "refresh_cache-4b4df05b-79b4-401b-8fb2-4d3de35c5509" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquired lock "refresh_cache-4b4df05b-79b4-401b-8fb2-4d3de35c5509" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-218cb775-83a5-4b28-a038-d601e6c28727 req-78d78890-71fa-4ec6-800f-da899898872a service nova] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Received event network-changed-e1105bed-a3a6-49a8-87a7-775c72fa6bdf {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-218cb775-83a5-4b28-a038-d601e6c28727 req-78d78890-71fa-4ec6-800f-da899898872a service nova] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Refreshing instance network info cache due to event network-changed-e1105bed-a3a6-49a8-87a7-775c72fa6bdf. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-218cb775-83a5-4b28-a038-d601e6c28727 req-78d78890-71fa-4ec6-800f-da899898872a service nova] Acquiring lock "refresh_cache-4b4df05b-79b4-401b-8fb2-4d3de35c5509" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:29:13 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Instance destroyed successfully.
Nov 29 20:29:13 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Attempting rescue
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75356) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Instance directory exists: not creating {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 20:29:13 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Creating image(s)
Nov 29 20:29:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "/opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "/opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.objects.instance [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Updating instance_info_cache with network_info: [{"id": "e1105bed-a3a6-49a8-87a7-775c72fa6bdf", "address": "fa:16:3e:cd:25:e4", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1105bed-a3", "ovs_interfaceid": "e1105bed-a3a6-49a8-87a7-775c72fa6bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.225s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk.rescue {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Releasing lock "refresh_cache-4b4df05b-79b4-401b-8fb2-4d3de35c5509" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Instance network_info: |[{"id": "e1105bed-a3a6-49a8-87a7-775c72fa6bdf", "address": "fa:16:3e:cd:25:e4", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1105bed-a3", "ovs_interfaceid": "e1105bed-a3a6-49a8-87a7-775c72fa6bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-218cb775-83a5-4b28-a038-d601e6c28727 req-78d78890-71fa-4ec6-800f-da899898872a service nova] Acquired lock "refresh_cache-4b4df05b-79b4-401b-8fb2-4d3de35c5509" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.network.neutron [req-218cb775-83a5-4b28-a038-d601e6c28727 req-78d78890-71fa-4ec6-800f-da899898872a service nova] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Refreshing network info cache for port e1105bed-a3a6-49a8-87a7-775c72fa6bdf {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Start _get_guest_xml network_info=[{"id": "e1105bed-a3a6-49a8-87a7-775c72fa6bdf", "address": "fa:16:3e:cd:25:e4", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1105bed-a3", "ovs_interfaceid": "e1105bed-a3a6-49a8-87a7-775c72fa6bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk.rescue" returned: 0 in 0.066s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.objects.instance [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'migration_context' on Instance uuid 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.objects.base [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Object Instance<4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Start _get_guest_xml network_info=[{"id": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "address": "fa:16:3e:91:30:da", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "vif_mac": "fa:16:3e:91:30:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a14e591-f6", "ovs_interfaceid": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.objects.instance [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'resources' on Instance uuid 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:29:13 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:29:13 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.objects.base [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Object Instance<4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.objects.instance [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'numa_topology' on Instance uuid 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:29:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2067025810',display_name='tempest-AttachVolumeNegativeTest-server-2067025810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2067025810',id=33,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZzdinCw4nR6UNsZVEwq+vfmgRlRHYEnK37PktlqZD6P3AIPJvuVWwzGk96AIX+Uf1n83Hq6qKxgsbK08auUVsHzU9xndC2auhEdqvA9IryOM13zoIe2PcdycYB1nJDAw==',key_name='tempest-keypair-1026617711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='076539532d4847719e7fcf4165872bbe',ramdisk_id='',reservation_id='r-ufza06j2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1182074567',owner_user_name='tempest-AttachVolumeNegativeTest-1182074567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbdba4f436df4dbb896258c4f4d6b180',uuid=4b4df05b-79b4-401b-8fb2-4d3de35c5509,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1105bed-a3a6-49a8-87a7-775c72fa6bdf", "address": "fa:16:3e:cd:25:e4", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1105bed-a3", "ovs_interfaceid": "e1105bed-a3a6-49a8-87a7-775c72fa6bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converting VIF {"id": "e1105bed-a3a6-49a8-87a7-775c72fa6bdf", "address": "fa:16:3e:cd:25:e4", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1105bed-a3", "ovs_interfaceid": "e1105bed-a3a6-49a8-87a7-775c72fa6bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:25:e4,bridge_name='br-int',has_traffic_filtering=True,id=e1105bed-a3a6-49a8-87a7-775c72fa6bdf,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1105bed-a3') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.objects.instance [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b4df05b-79b4-401b-8fb2-4d3de35c5509 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.objects.base [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Object Instance<4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:29:13 user nova-compute[75356]:   <uuid>4b4df05b-79b4-401b-8fb2-4d3de35c5509</uuid>
Nov 29 20:29:13 user nova-compute[75356]:   <name>instance-00000021</name>
Nov 29 20:29:13 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:29:13 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:29:13 user nova-compute[75356]:   <metadata>
Nov 29 20:29:13 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:29:13 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:29:13 user nova-compute[75356]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2067025810</nova:name>
Nov 29 20:29:13 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:29:13</nova:creationTime>
Nov 29 20:29:13 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:29:13 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:29:13 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:29:13 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:29:13 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:29:13 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:29:13 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:29:13 user nova-compute[75356]:       <nova:owner>
Nov 29 20:29:13 user nova-compute[75356]:         <nova:user uuid="cbdba4f436df4dbb896258c4f4d6b180">tempest-AttachVolumeNegativeTest-1182074567-project-member</nova:user>
Nov 29 20:29:13 user nova-compute[75356]:         <nova:project uuid="076539532d4847719e7fcf4165872bbe">tempest-AttachVolumeNegativeTest-1182074567</nova:project>
Nov 29 20:29:13 user nova-compute[75356]:       </nova:owner>
Nov 29 20:29:13 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:29:13 user nova-compute[75356]:       <nova:ports>
Nov 29 20:29:13 user nova-compute[75356]:         <nova:port uuid="e1105bed-a3a6-49a8-87a7-775c72fa6bdf">
Nov 29 20:29:13 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 20:29:13 user nova-compute[75356]:         </nova:port>
Nov 29 20:29:13 user nova-compute[75356]:       </nova:ports>
Nov 29 20:29:13 user nova-compute[75356]:     </nova:instance>
Nov 29 20:29:13 user nova-compute[75356]:   </metadata>
Nov 29 20:29:13 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:29:13 user nova-compute[75356]:     <system>
Nov 29 20:29:13 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:29:13 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:29:13 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:29:13 user nova-compute[75356]:       <entry name="serial">4b4df05b-79b4-401b-8fb2-4d3de35c5509</entry>
Nov 29 20:29:13 user nova-compute[75356]:       <entry name="uuid">4b4df05b-79b4-401b-8fb2-4d3de35c5509</entry>
Nov 29 20:29:13 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:29:13 user nova-compute[75356]:     </system>
Nov 29 20:29:13 user nova-compute[75356]:   </sysinfo>
Nov 29 20:29:13 user nova-compute[75356]:   <os>
Nov 29 20:29:13 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:29:13 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:29:13 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:29:13 user nova-compute[75356]:   </os>
Nov 29 20:29:13 user nova-compute[75356]:   <features>
Nov 29 20:29:13 user nova-compute[75356]:     <acpi/>
Nov 29 20:29:13 user nova-compute[75356]:     <apic/>
Nov 29 20:29:13 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:29:13 user nova-compute[75356]:   </features>
Nov 29 20:29:13 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:29:13 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:29:13 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:29:13 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:29:13 user nova-compute[75356]:   </clock>
Nov 29 20:29:13 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:29:13 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:29:13 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:29:13 user nova-compute[75356]:   </cpu>
Nov 29 20:29:13 user nova-compute[75356]:   <devices>
Nov 29 20:29:13 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:29:13 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:29:13 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/4b4df05b-79b4-401b-8fb2-4d3de35c5509/disk"/>
Nov 29 20:29:13 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:29:13 user nova-compute[75356]:     </disk>
Nov 29 20:29:13 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:29:13 user nova-compute[75356]:       <mac address="fa:16:3e:cd:25:e4"/>
Nov 29 20:29:13 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:29:13 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:29:13 user nova-compute[75356]:       <target dev="tape1105bed-a3"/>
Nov 29 20:29:13 user nova-compute[75356]:     </interface>
Nov 29 20:29:13 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:29:13 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/4b4df05b-79b4-401b-8fb2-4d3de35c5509/console.log" append="off"/>
Nov 29 20:29:13 user nova-compute[75356]:     </serial>
Nov 29 20:29:13 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:29:13 user nova-compute[75356]:     <video>
Nov 29 20:29:13 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:29:13 user nova-compute[75356]:     </video>
Nov 29 20:29:13 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:29:13 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:29:13 user nova-compute[75356]:     </rng>
Nov 29 20:29:13 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:29:13 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:29:13 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:29:13 user nova-compute[75356]:     </memballoon>
Nov 29 20:29:13 user nova-compute[75356]:   </devices>
Nov 29 20:29:13 user nova-compute[75356]: </domain>
Nov 29 20:29:13 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:29:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2067025810',display_name='tempest-AttachVolumeNegativeTest-server-2067025810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2067025810',id=33,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZzdinCw4nR6UNsZVEwq+vfmgRlRHYEnK37PktlqZD6P3AIPJvuVWwzGk96AIX+Uf1n83Hq6qKxgsbK08auUVsHzU9xndC2auhEdqvA9IryOM13zoIe2PcdycYB1nJDAw==',key_name='tempest-keypair-1026617711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='076539532d4847719e7fcf4165872bbe',ramdisk_id='',reservation_id='r-ufza06j2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1182074567',owner_user_name='tempest-AttachVolumeNegativeTest-1182074567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbdba4f436df4dbb896258c4f4d6b180',uuid=4b4df05b-79b4-401b-8fb2-4d3de35c5509,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1105bed-a3a6-49a8-87a7-775c72fa6bdf", "address": "fa:16:3e:cd:25:e4", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1105bed-a3", "ovs_interfaceid": "e1105bed-a3a6-49a8-87a7-775c72fa6bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converting VIF {"id": "e1105bed-a3a6-49a8-87a7-775c72fa6bdf", "address": "fa:16:3e:cd:25:e4", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1105bed-a3", "ovs_interfaceid": "e1105bed-a3a6-49a8-87a7-775c72fa6bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:25:e4,bridge_name='br-int',has_traffic_filtering=True,id=e1105bed-a3a6-49a8-87a7-775c72fa6bdf,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1105bed-a3') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG os_vif [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:25:e4,bridge_name='br-int',has_traffic_filtering=True,id=e1105bed-a3a6-49a8-87a7-775c72fa6bdf,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1105bed-a3') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '93d29660-3c12-5f48-9288-64419fded204', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:13 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:29:13 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:29:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.objects.instance [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1105bed-a3, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1105bed-a3, col_values=(('qos', UUID('b765ff42-3ca5-460b-80e9-08a40365347b')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1105bed-a3, col_values=(('external_ids', {'iface-id': 'e1105bed-a3a6-49a8-87a7-775c72fa6bdf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:25:e4', 'vm-uuid': '4b4df05b-79b4-401b-8fb2-4d3de35c5509'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:13 user nova-compute[75356]: DEBUG nova.objects.base [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Object Instance<4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:24:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-524234962',display_name='tempest-ServerRescueNegativeTestJSON-server-524234962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-524234962',id=22,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:24:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34dff0986b1d47fdaf305c87e323d19e',ramdisk_id='',reservation_id='r-fdzu3fqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1204717931',owner_user_name='tempest-ServerRescueNegativeTestJSON-1204717931-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:24:36Z,user_data=None,user_id='00cdfe6527e04f049b5e38685bc1f257',uuid=4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "address": "fa:16:3e:91:30:da", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "vif_mac": "fa:16:3e:91:30:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a14e591-f6", "ovs_interfaceid": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converting VIF {"id": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "address": "fa:16:3e:91:30:da", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "vif_mac": "fa:16:3e:91:30:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a14e591-f6", "ovs_interfaceid": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:30:da,bridge_name='br-int',has_traffic_filtering=True,id=0a14e591-f6b5-4199-90fe-a7a40182e6c7,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a14e591-f6') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.objects.instance [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:14 user nova-compute[75356]: INFO os_vif [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:25:e4,bridge_name='br-int',has_traffic_filtering=True,id=e1105bed-a3a6-49a8-87a7-775c72fa6bdf,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1105bed-a3')
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.objects.base [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Object Instance<4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:29:14 user nova-compute[75356]:   <uuid>4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1</uuid>
Nov 29 20:29:14 user nova-compute[75356]:   <name>instance-00000016</name>
Nov 29 20:29:14 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:29:14 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:29:14 user nova-compute[75356]:   <metadata>
Nov 29 20:29:14 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:29:14 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:29:14 user nova-compute[75356]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-524234962</nova:name>
Nov 29 20:29:14 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:29:13</nova:creationTime>
Nov 29 20:29:14 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:29:14 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:29:14 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:29:14 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:29:14 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:29:14 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:29:14 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:29:14 user nova-compute[75356]:       <nova:owner>
Nov 29 20:29:14 user nova-compute[75356]:         <nova:user uuid="00cdfe6527e04f049b5e38685bc1f257">tempest-ServerRescueNegativeTestJSON-1204717931-project-member</nova:user>
Nov 29 20:29:14 user nova-compute[75356]:         <nova:project uuid="34dff0986b1d47fdaf305c87e323d19e">tempest-ServerRescueNegativeTestJSON-1204717931</nova:project>
Nov 29 20:29:14 user nova-compute[75356]:       </nova:owner>
Nov 29 20:29:14 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:29:14 user nova-compute[75356]:       <nova:ports>
Nov 29 20:29:14 user nova-compute[75356]:         <nova:port uuid="0a14e591-f6b5-4199-90fe-a7a40182e6c7">
Nov 29 20:29:14 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 20:29:14 user nova-compute[75356]:         </nova:port>
Nov 29 20:29:14 user nova-compute[75356]:       </nova:ports>
Nov 29 20:29:14 user nova-compute[75356]:     </nova:instance>
Nov 29 20:29:14 user nova-compute[75356]:   </metadata>
Nov 29 20:29:14 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:29:14 user nova-compute[75356]:     <system>
Nov 29 20:29:14 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:29:14 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:29:14 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:29:14 user nova-compute[75356]:       <entry name="serial">4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1</entry>
Nov 29 20:29:14 user nova-compute[75356]:       <entry name="uuid">4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1</entry>
Nov 29 20:29:14 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:29:14 user nova-compute[75356]:     </system>
Nov 29 20:29:14 user nova-compute[75356]:   </sysinfo>
Nov 29 20:29:14 user nova-compute[75356]:   <os>
Nov 29 20:29:14 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:29:14 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:29:14 user nova-compute[75356]:   </os>
Nov 29 20:29:14 user nova-compute[75356]:   <features>
Nov 29 20:29:14 user nova-compute[75356]:     <acpi/>
Nov 29 20:29:14 user nova-compute[75356]:     <apic/>
Nov 29 20:29:14 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:29:14 user nova-compute[75356]:   </features>
Nov 29 20:29:14 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:29:14 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:29:14 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:29:14 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:29:14 user nova-compute[75356]:   </clock>
Nov 29 20:29:14 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:29:14 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:29:14 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:29:14 user nova-compute[75356]:   </cpu>
Nov 29 20:29:14 user nova-compute[75356]:   <devices>
Nov 29 20:29:14 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:29:14 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:29:14 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk.rescue"/>
Nov 29 20:29:14 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:29:14 user nova-compute[75356]:     </disk>
Nov 29 20:29:14 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:29:14 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:29:14 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk"/>
Nov 29 20:29:14 user nova-compute[75356]:       <target dev="vdb" bus="virtio"/>
Nov 29 20:29:14 user nova-compute[75356]:     </disk>
Nov 29 20:29:14 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:29:14 user nova-compute[75356]:       <mac address="fa:16:3e:91:30:da"/>
Nov 29 20:29:14 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:29:14 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:29:14 user nova-compute[75356]:       <target dev="tap0a14e591-f6"/>
Nov 29 20:29:14 user nova-compute[75356]:     </interface>
Nov 29 20:29:14 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:29:14 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/console.log" append="off"/>
Nov 29 20:29:14 user nova-compute[75356]:     </serial>
Nov 29 20:29:14 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:29:14 user nova-compute[75356]:     <video>
Nov 29 20:29:14 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:29:14 user nova-compute[75356]:     </video>
Nov 29 20:29:14 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:29:14 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:29:14 user nova-compute[75356]:     </rng>
Nov 29 20:29:14 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:29:14 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:29:14 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:29:14 user nova-compute[75356]:     </memballoon>
Nov 29 20:29:14 user nova-compute[75356]:   </devices>
Nov 29 20:29:14 user nova-compute[75356]: </domain>
Nov 29 20:29:14 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:29:14 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Instance destroyed successfully.
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] No VIF found with MAC fa:16:3e:cd:25:e4, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] No VIF found with MAC fa:16:3e:91:30:da, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.network.neutron [req-218cb775-83a5-4b28-a038-d601e6c28727 req-78d78890-71fa-4ec6-800f-da899898872a service nova] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Updated VIF entry in instance network info cache for port e1105bed-a3a6-49a8-87a7-775c72fa6bdf. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.network.neutron [req-218cb775-83a5-4b28-a038-d601e6c28727 req-78d78890-71fa-4ec6-800f-da899898872a service nova] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Updating instance_info_cache with network_info: [{"id": "e1105bed-a3a6-49a8-87a7-775c72fa6bdf", "address": "fa:16:3e:cd:25:e4", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1105bed-a3", "ovs_interfaceid": "e1105bed-a3a6-49a8-87a7-775c72fa6bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-218cb775-83a5-4b28-a038-d601e6c28727 req-78d78890-71fa-4ec6-800f-da899898872a service nova] Releasing lock "refresh_cache-4b4df05b-79b4-401b-8fb2-4d3de35c5509" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:29:14 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Creating image(s)
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Did not create local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Ensure instance console log exists: /opt/stack/data/nova/instances/c477f425-e9ce-4b3a-b21a-8bf04401ad0b/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Start _get_guest_xml network_info=[{"id": "084eeeb2-bcff-437d-ac75-85936e641045", "address": "fa:16:3e:a1:86:c2", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084eeeb2-bc", "ovs_interfaceid": "084eeeb2-bcff-437d-ac75-85936e641045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGgkRYyn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c477f425-e9ce-4b3a-b21a-8bf04401ad0b', 'attached_at': '', 'detached_at': '', 'volume_id': '18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8', 'serial': '18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8'}, 'attachment_id': '2b70ac89-f88b-4296-ae3a-d231cd258eb0', 'volume_type': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:29:14 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:29:14 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGgkRYyn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:29:14 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:29:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:29:14 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:29:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:29:14 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d3de16-bd50-4c2a-b255-592697844d00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:29:14 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7b62a9-1b4c-4828-9734-5c2867876173]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8] added
Nov 29 20:29:14 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.053s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15b81ba-fe7a-45a3-b3bd-7dbee5acdcf9]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe42aa2-e4a9-4915-9083-ebe000f46036]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eGgkRYyn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eGgkRYyn" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[46edeab7-21fd-431c-81ad-af13d4b650fd]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eGgkRYyn'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7559fa18-7138-41b2-b7f1-c8539986c09b]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6016f93-bf86-4261-823f-e94e49f170fd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:29:14 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:29:14 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:29:14 user nova-compute[75356]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:29:14 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:29:14 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:29:14 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:29:14 user nova-compute[75356]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:29:14 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[215300fd-fabe-4e39-91aa-2162b077c502]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8, portal: 172.16.0.220,3260]
Nov 29 20:29:14 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8, portal: 172.16.0.220,3260] successful.
Nov 29 20:29:14 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[038499ad-6418-4e09-8d1c-cff41b920c02]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.compute.manager [req-cf1ba076-8403-492f-be93-259660ff70ea req-0025bd25-51fe-457d-a252-11dafdeb4379 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received event network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cf1ba076-8403-492f-be93-259660ff70ea req-0025bd25-51fe-457d-a252-11dafdeb4379 service nova] Acquiring lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cf1ba076-8403-492f-be93-259660ff70ea req-0025bd25-51fe-457d-a252-11dafdeb4379 service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cf1ba076-8403-492f-be93-259660ff70ea req-0025bd25-51fe-457d-a252-11dafdeb4379 service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG nova.compute.manager [req-cf1ba076-8403-492f-be93-259660ff70ea req-0025bd25-51fe-457d-a252-11dafdeb4379 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] No waiting events found dispatching network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:29:14 user nova-compute[75356]: WARNING nova.compute.manager [req-cf1ba076-8403-492f-be93-259660ff70ea req-0025bd25-51fe-457d-a252-11dafdeb4379 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received unexpected event network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 for instance with vm_state active and task_state rescuing.
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f4420f-413e-4be0-b1bc-d747e76eb1f5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:29:14 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:29:14 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:29:14 user nova-compute[75356]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:29:14 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:29:14 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:29:14 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:29:14 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:29:14 user nova-compute[75356]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:29:14 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:29:14 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:29:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce647e2e-fb56-4b2d-b42b-9ab5275eea49]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:15 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:29:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGgkRYyn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '26362343662386439', 'path': '/dev/sdf'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362343662386439', 'path': '/dev/sdf'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:28:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1570981937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1570981937',id=31,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bed33acdfd5f48b9967d1dd68c261d78',ramdisk_id='',reservation_id='r-oglasv8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2041863686',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:28:53Z,user_data=None,user_id='e395b4248b794d65915edf2d23bbbeaf',uuid=c477f425-e9ce-4b3a-b21a-8bf04401ad0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "084eeeb2-bcff-437d-ac75-85936e641045", "address": "fa:16:3e:a1:86:c2", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084eeeb2-bc", "ovs_interfaceid": "084eeeb2-bcff-437d-ac75-85936e641045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Converting VIF {"id": "084eeeb2-bcff-437d-ac75-85936e641045", "address": "fa:16:3e:a1:86:c2", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084eeeb2-bc", "ovs_interfaceid": "084eeeb2-bcff-437d-ac75-85936e641045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:86:c2,bridge_name='br-int',has_traffic_filtering=True,id=084eeeb2-bcff-437d-ac75-85936e641045,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084eeeb2-bc') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG nova.objects.instance [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lazy-loading 'pci_devices' on Instance uuid c477f425-e9ce-4b3a-b21a-8bf04401ad0b {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:29:16 user nova-compute[75356]:   <uuid>c477f425-e9ce-4b3a-b21a-8bf04401ad0b</uuid>
Nov 29 20:29:16 user nova-compute[75356]:   <name>instance-0000001f</name>
Nov 29 20:29:16 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:29:16 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:29:16 user nova-compute[75356]:   <metadata>
Nov 29 20:29:16 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:29:16 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:29:16 user nova-compute[75356]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1570981937</nova:name>
Nov 29 20:29:16 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:29:14</nova:creationTime>
Nov 29 20:29:16 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:29:16 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:29:16 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:29:16 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:29:16 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:29:16 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:29:16 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:29:16 user nova-compute[75356]:       <nova:owner>
Nov 29 20:29:16 user nova-compute[75356]:         <nova:user uuid="e395b4248b794d65915edf2d23bbbeaf">tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member</nova:user>
Nov 29 20:29:16 user nova-compute[75356]:         <nova:project uuid="bed33acdfd5f48b9967d1dd68c261d78">tempest-ServerBootFromVolumeStableRescueTest-2041863686</nova:project>
Nov 29 20:29:16 user nova-compute[75356]:       </nova:owner>
Nov 29 20:29:16 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:29:16 user nova-compute[75356]:       <nova:ports>
Nov 29 20:29:16 user nova-compute[75356]:         <nova:port uuid="084eeeb2-bcff-437d-ac75-85936e641045">
Nov 29 20:29:16 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 20:29:16 user nova-compute[75356]:         </nova:port>
Nov 29 20:29:16 user nova-compute[75356]:       </nova:ports>
Nov 29 20:29:16 user nova-compute[75356]:     </nova:instance>
Nov 29 20:29:16 user nova-compute[75356]:   </metadata>
Nov 29 20:29:16 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:29:16 user nova-compute[75356]:     <system>
Nov 29 20:29:16 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:29:16 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:29:16 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:29:16 user nova-compute[75356]:       <entry name="serial">c477f425-e9ce-4b3a-b21a-8bf04401ad0b</entry>
Nov 29 20:29:16 user nova-compute[75356]:       <entry name="uuid">c477f425-e9ce-4b3a-b21a-8bf04401ad0b</entry>
Nov 29 20:29:16 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:29:16 user nova-compute[75356]:     </system>
Nov 29 20:29:16 user nova-compute[75356]:   </sysinfo>
Nov 29 20:29:16 user nova-compute[75356]:   <os>
Nov 29 20:29:16 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:29:16 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:29:16 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:29:16 user nova-compute[75356]:   </os>
Nov 29 20:29:16 user nova-compute[75356]:   <features>
Nov 29 20:29:16 user nova-compute[75356]:     <acpi/>
Nov 29 20:29:16 user nova-compute[75356]:     <apic/>
Nov 29 20:29:16 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:29:16 user nova-compute[75356]:   </features>
Nov 29 20:29:16 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:29:16 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:29:16 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:29:16 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:29:16 user nova-compute[75356]:   </clock>
Nov 29 20:29:16 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:29:16 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:29:16 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:29:16 user nova-compute[75356]:   </cpu>
Nov 29 20:29:16 user nova-compute[75356]:   <devices>
Nov 29 20:29:16 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:29:16 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:29:16 user nova-compute[75356]:       <source dev="/dev/sdf"/>
Nov 29 20:29:16 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:29:16 user nova-compute[75356]:       <serial>18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8</serial>
Nov 29 20:29:16 user nova-compute[75356]:     </disk>
Nov 29 20:29:16 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:29:16 user nova-compute[75356]:       <mac address="fa:16:3e:a1:86:c2"/>
Nov 29 20:29:16 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:29:16 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:29:16 user nova-compute[75356]:       <target dev="tap084eeeb2-bc"/>
Nov 29 20:29:16 user nova-compute[75356]:     </interface>
Nov 29 20:29:16 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:29:16 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/c477f425-e9ce-4b3a-b21a-8bf04401ad0b/console.log" append="off"/>
Nov 29 20:29:16 user nova-compute[75356]:     </serial>
Nov 29 20:29:16 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:29:16 user nova-compute[75356]:     <video>
Nov 29 20:29:16 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:29:16 user nova-compute[75356]:     </video>
Nov 29 20:29:16 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:29:16 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:29:16 user nova-compute[75356]:     </rng>
Nov 29 20:29:16 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:29:16 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:29:16 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:29:16 user nova-compute[75356]:     </memballoon>
Nov 29 20:29:16 user nova-compute[75356]:   </devices>
Nov 29 20:29:16 user nova-compute[75356]: </domain>
Nov 29 20:29:16 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:28:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1570981937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1570981937',id=31,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bed33acdfd5f48b9967d1dd68c261d78',ramdisk_id='',reservation_id='r-oglasv8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2041863686',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:28:53Z,user_data=None,user_id='e395b4248b794d65915edf2d23bbbeaf',uuid=c477f425-e9ce-4b3a-b21a-8bf04401ad0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "084eeeb2-bcff-437d-ac75-85936e641045", "address": "fa:16:3e:a1:86:c2", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084eeeb2-bc", "ovs_interfaceid": "084eeeb2-bcff-437d-ac75-85936e641045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Converting VIF {"id": "084eeeb2-bcff-437d-ac75-85936e641045", "address": "fa:16:3e:a1:86:c2", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084eeeb2-bc", "ovs_interfaceid": "084eeeb2-bcff-437d-ac75-85936e641045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:86:c2,bridge_name='br-int',has_traffic_filtering=True,id=084eeeb2-bcff-437d-ac75-85936e641045,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084eeeb2-bc') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG os_vif [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:86:c2,bridge_name='br-int',has_traffic_filtering=True,id=084eeeb2-bcff-437d-ac75-85936e641045,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084eeeb2-bc') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b5af15e-9047-5857-981c-b02b583d2a8e', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap084eeeb2-bc, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap084eeeb2-bc, col_values=(('qos', UUID('b6686e28-b211-4a8a-97dd-ed34f58bdbb9')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap084eeeb2-bc, col_values=(('external_ids', {'iface-id': '084eeeb2-bcff-437d-ac75-85936e641045', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:86:c2', 'vm-uuid': 'c477f425-e9ce-4b3a-b21a-8bf04401ad0b'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:16 user nova-compute[75356]: INFO os_vif [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:86:c2,bridge_name='br-int',has_traffic_filtering=True,id=084eeeb2-bcff-437d-ac75-85936e641045,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084eeeb2-bc')
Nov 29 20:29:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] No VIF found with MAC fa:16:3e:a1:86:c2, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-c0ca10ee-96cf-4901-a10b-20a7f653591a req-f2d76fc6-88cc-4f4a-b3ac-b94830e300b8 service nova] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Received event network-vif-plugged-e1105bed-a3a6-49a8-87a7-775c72fa6bdf {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c0ca10ee-96cf-4901-a10b-20a7f653591a req-f2d76fc6-88cc-4f4a-b3ac-b94830e300b8 service nova] Acquiring lock "4b4df05b-79b4-401b-8fb2-4d3de35c5509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c0ca10ee-96cf-4901-a10b-20a7f653591a req-f2d76fc6-88cc-4f4a-b3ac-b94830e300b8 service nova] Lock "4b4df05b-79b4-401b-8fb2-4d3de35c5509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c0ca10ee-96cf-4901-a10b-20a7f653591a req-f2d76fc6-88cc-4f4a-b3ac-b94830e300b8 service nova] Lock "4b4df05b-79b4-401b-8fb2-4d3de35c5509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-c0ca10ee-96cf-4901-a10b-20a7f653591a req-f2d76fc6-88cc-4f4a-b3ac-b94830e300b8 service nova] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] No waiting events found dispatching network-vif-plugged-e1105bed-a3a6-49a8-87a7-775c72fa6bdf {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:29:16 user nova-compute[75356]: WARNING nova.compute.manager [req-c0ca10ee-96cf-4901-a10b-20a7f653591a req-f2d76fc6-88cc-4f4a-b3ac-b94830e300b8 service nova] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Received unexpected event network-vif-plugged-e1105bed-a3a6-49a8-87a7-775c72fa6bdf for instance with vm_state building and task_state spawning.
Nov 29 20:29:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-2a717d26-cee5-464e-93b4-f09657136241 req-890213e3-fe33-4ec0-a694-d9e80e9f3306 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received event network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:29:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2a717d26-cee5-464e-93b4-f09657136241 req-890213e3-fe33-4ec0-a694-d9e80e9f3306 service nova] Acquiring lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2a717d26-cee5-464e-93b4-f09657136241 req-890213e3-fe33-4ec0-a694-d9e80e9f3306 service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2a717d26-cee5-464e-93b4-f09657136241 req-890213e3-fe33-4ec0-a694-d9e80e9f3306 service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-2a717d26-cee5-464e-93b4-f09657136241 req-890213e3-fe33-4ec0-a694-d9e80e9f3306 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] No waiting events found dispatching network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:29:18 user nova-compute[75356]: WARNING nova.compute.manager [req-2a717d26-cee5-464e-93b4-f09657136241 req-890213e3-fe33-4ec0-a694-d9e80e9f3306 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received unexpected event network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 for instance with vm_state active and task_state rescuing.
Nov 29 20:29:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-3363ea47-d736-4777-990c-c99bec90effb req-3b9c7e9a-9ba2-4833-b2e9-71297cde07f9 service nova] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Received event network-vif-plugged-e1105bed-a3a6-49a8-87a7-775c72fa6bdf {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:29:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3363ea47-d736-4777-990c-c99bec90effb req-3b9c7e9a-9ba2-4833-b2e9-71297cde07f9 service nova] Acquiring lock "4b4df05b-79b4-401b-8fb2-4d3de35c5509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3363ea47-d736-4777-990c-c99bec90effb req-3b9c7e9a-9ba2-4833-b2e9-71297cde07f9 service nova] Lock "4b4df05b-79b4-401b-8fb2-4d3de35c5509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3363ea47-d736-4777-990c-c99bec90effb req-3b9c7e9a-9ba2-4833-b2e9-71297cde07f9 service nova] Lock "4b4df05b-79b4-401b-8fb2-4d3de35c5509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-3363ea47-d736-4777-990c-c99bec90effb req-3b9c7e9a-9ba2-4833-b2e9-71297cde07f9 service nova] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] No waiting events found dispatching network-vif-plugged-e1105bed-a3a6-49a8-87a7-775c72fa6bdf {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:29:18 user nova-compute[75356]: WARNING nova.compute.manager [req-3363ea47-d736-4777-990c-c99bec90effb req-3b9c7e9a-9ba2-4833-b2e9-71297cde07f9 service nova] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Received unexpected event network-vif-plugged-e1105bed-a3a6-49a8-87a7-775c72fa6bdf for instance with vm_state building and task_state spawning.
Nov 29 20:29:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-f2802551-3b3f-484d-9a88-e30abb1dab87 req-15b7a4d2-2904-4375-909d-dc99859ecb8e service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received event network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:29:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f2802551-3b3f-484d-9a88-e30abb1dab87 req-15b7a4d2-2904-4375-909d-dc99859ecb8e service nova] Acquiring lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f2802551-3b3f-484d-9a88-e30abb1dab87 req-15b7a4d2-2904-4375-909d-dc99859ecb8e service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f2802551-3b3f-484d-9a88-e30abb1dab87 req-15b7a4d2-2904-4375-909d-dc99859ecb8e service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-f2802551-3b3f-484d-9a88-e30abb1dab87 req-15b7a4d2-2904-4375-909d-dc99859ecb8e service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] No waiting events found dispatching network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:29:20 user nova-compute[75356]: WARNING nova.compute.manager [req-f2802551-3b3f-484d-9a88-e30abb1dab87 req-15b7a4d2-2904-4375-909d-dc99859ecb8e service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received unexpected event network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 for instance with vm_state active and task_state rescuing.
Nov 29 20:29:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-f2802551-3b3f-484d-9a88-e30abb1dab87 req-15b7a4d2-2904-4375-909d-dc99859ecb8e service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:29:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f2802551-3b3f-484d-9a88-e30abb1dab87 req-15b7a4d2-2904-4375-909d-dc99859ecb8e service nova] Acquiring lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f2802551-3b3f-484d-9a88-e30abb1dab87 req-15b7a4d2-2904-4375-909d-dc99859ecb8e service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f2802551-3b3f-484d-9a88-e30abb1dab87 req-15b7a4d2-2904-4375-909d-dc99859ecb8e service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-f2802551-3b3f-484d-9a88-e30abb1dab87 req-15b7a4d2-2904-4375-909d-dc99859ecb8e service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] No waiting events found dispatching network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:29:20 user nova-compute[75356]: WARNING nova.compute.manager [req-f2802551-3b3f-484d-9a88-e30abb1dab87 req-15b7a4d2-2904-4375-909d-dc99859ecb8e service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received unexpected event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 for instance with vm_state building and task_state spawning.
Nov 29 20:29:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-f2802551-3b3f-484d-9a88-e30abb1dab87 req-15b7a4d2-2904-4375-909d-dc99859ecb8e service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:29:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f2802551-3b3f-484d-9a88-e30abb1dab87 req-15b7a4d2-2904-4375-909d-dc99859ecb8e service nova] Acquiring lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f2802551-3b3f-484d-9a88-e30abb1dab87 req-15b7a4d2-2904-4375-909d-dc99859ecb8e service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f2802551-3b3f-484d-9a88-e30abb1dab87 req-15b7a4d2-2904-4375-909d-dc99859ecb8e service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-f2802551-3b3f-484d-9a88-e30abb1dab87 req-15b7a4d2-2904-4375-909d-dc99859ecb8e service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] No waiting events found dispatching network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:29:20 user nova-compute[75356]: WARNING nova.compute.manager [req-f2802551-3b3f-484d-9a88-e30abb1dab87 req-15b7a4d2-2904-4375-909d-dc99859ecb8e service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received unexpected event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 for instance with vm_state building and task_state spawning.
Nov 29 20:29:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:21 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:29:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:29:21 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Instance spawned successfully.
Nov 29 20:29:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:29:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:21 user nova-compute[75356]: INFO nova.compute.manager [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Took 10.40 seconds to spawn the instance on the hypervisor.
Nov 29 20:29:21 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:29:21 user nova-compute[75356]: INFO nova.compute.manager [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Took 12.71 seconds to build instance.
Nov 29 20:29:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ccdf67d3-0865-46b8-a78e-c86b2cc339e3 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "4b4df05b-79b4-401b-8fb2-4d3de35c5509" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.870s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:21 user nova-compute[75356]: DEBUG nova.compute.manager [None req-a3e3d182-b5fe-4698-91cf-9fe84e9885b6 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:29:21 user nova-compute[75356]: DEBUG nova.compute.manager [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:29:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:29:21 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Instance spawned successfully.
Nov 29 20:29:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:29:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:21 user nova-compute[75356]: INFO nova.compute.manager [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Took 7.22 seconds to spawn the instance on the hypervisor.
Nov 29 20:29:21 user nova-compute[75356]: DEBUG nova.compute.manager [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:29:21 user nova-compute[75356]: INFO nova.compute.manager [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Took 29.59 seconds to build instance.
Nov 29 20:29:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-62218d9b-e40d-4f41-a88c-f8de0c4184d7 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.714s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:39 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:29:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:29:39 user nova-compute[75356]: INFO nova.compute.claims [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Claim successful on node user
Nov 29 20:29:39 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:29:39 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:29:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:40 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:29:40 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:29:40 user nova-compute[75356]: DEBUG nova.network.neutron [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:29:40 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:29:40 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:29:40 user nova-compute[75356]: DEBUG nova.policy [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecc96706ae3140ce8816c0e78e116d7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71e99301081a4158bc9d188e2f796350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:29:40 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:29:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:29:40 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Creating image(s)
Nov 29 20:29:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "/opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "/opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.370s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.184s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk 1073741824" returned: 0 in 0.128s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.223s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:41 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:29:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:41 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:41 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Cannot resize image /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:29:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:29:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Ensure instance console log exists: /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:29:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:41 user nova-compute[75356]: DEBUG nova.network.neutron [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Successfully created port: 617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:29:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.network.neutron [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Successfully updated port: 617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "refresh_cache-ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquired lock "refresh_cache-ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.network.neutron [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-b93c01cb-6255-4b3f-851b-650546b5baad req-cac4a5a3-3ef9-4786-9219-d78798b08a52 service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Received event network-changed-617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-b93c01cb-6255-4b3f-851b-650546b5baad req-cac4a5a3-3ef9-4786-9219-d78798b08a52 service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Refreshing instance network info cache due to event network-changed-617944a3-eb1e-431e-8b2f-f3090e4947e4. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b93c01cb-6255-4b3f-851b-650546b5baad req-cac4a5a3-3ef9-4786-9219-d78798b08a52 service nova] Acquiring lock "refresh_cache-ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.network.neutron [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.network.neutron [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Updating instance_info_cache with network_info: [{"id": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "address": "fa:16:3e:03:0f:9e", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617944a3-eb", "ovs_interfaceid": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Releasing lock "refresh_cache-ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Instance network_info: |[{"id": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "address": "fa:16:3e:03:0f:9e", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617944a3-eb", "ovs_interfaceid": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b93c01cb-6255-4b3f-851b-650546b5baad req-cac4a5a3-3ef9-4786-9219-d78798b08a52 service nova] Acquired lock "refresh_cache-ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.network.neutron [req-b93c01cb-6255-4b3f-851b-650546b5baad req-cac4a5a3-3ef9-4786-9219-d78798b08a52 service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Refreshing network info cache for port 617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Start _get_guest_xml network_info=[{"id": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "address": "fa:16:3e:03:0f:9e", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617944a3-eb", "ovs_interfaceid": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:29:43 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:29:43 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746543629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746543629',id=34,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoBYhUZTHHk0CREN0lXpO01HfOR1JC0gy8IkTdtaqmqYZSwBX5tvSh0xRk0q4YRJyhgG6K0SdzHAwxFF/zK8Mb+8/lRRNokeiBDcNpDtwZ4Op8oi1jdXBF3LvLyPmY1Tg==',key_name='tempest-keypair-1798007487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71e99301081a4158bc9d188e2f796350',ramdisk_id='',reservation_id='r-np63f8g4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1538416601',owner_user_name='tempest-AttachVolumeShelveTestJSON-1538416601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecc96706ae3140ce8816c0e78e116d7d',uuid=ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "address": "fa:16:3e:03:0f:9e", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617944a3-eb", "ovs_interfaceid": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converting VIF {"id": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "address": "fa:16:3e:03:0f:9e", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617944a3-eb", "ovs_interfaceid": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:0f:9e,bridge_name='br-int',has_traffic_filtering=True,id=617944a3-eb1e-431e-8b2f-f3090e4947e4,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617944a3-eb') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.objects.instance [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lazy-loading 'pci_devices' on Instance uuid ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:29:43 user nova-compute[75356]:   <uuid>ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb</uuid>
Nov 29 20:29:43 user nova-compute[75356]:   <name>instance-00000022</name>
Nov 29 20:29:43 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:29:43 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:29:43 user nova-compute[75356]:   <metadata>
Nov 29 20:29:43 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:29:43 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:29:43 user nova-compute[75356]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1746543629</nova:name>
Nov 29 20:29:43 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:29:43</nova:creationTime>
Nov 29 20:29:43 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:29:43 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:29:43 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:29:43 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:29:43 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:29:43 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:29:43 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:29:43 user nova-compute[75356]:       <nova:owner>
Nov 29 20:29:43 user nova-compute[75356]:         <nova:user uuid="ecc96706ae3140ce8816c0e78e116d7d">tempest-AttachVolumeShelveTestJSON-1538416601-project-member</nova:user>
Nov 29 20:29:43 user nova-compute[75356]:         <nova:project uuid="71e99301081a4158bc9d188e2f796350">tempest-AttachVolumeShelveTestJSON-1538416601</nova:project>
Nov 29 20:29:43 user nova-compute[75356]:       </nova:owner>
Nov 29 20:29:43 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:29:43 user nova-compute[75356]:       <nova:ports>
Nov 29 20:29:43 user nova-compute[75356]:         <nova:port uuid="617944a3-eb1e-431e-8b2f-f3090e4947e4">
Nov 29 20:29:43 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 20:29:43 user nova-compute[75356]:         </nova:port>
Nov 29 20:29:43 user nova-compute[75356]:       </nova:ports>
Nov 29 20:29:43 user nova-compute[75356]:     </nova:instance>
Nov 29 20:29:43 user nova-compute[75356]:   </metadata>
Nov 29 20:29:43 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:29:43 user nova-compute[75356]:     <system>
Nov 29 20:29:43 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:29:43 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:29:43 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:29:43 user nova-compute[75356]:       <entry name="serial">ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb</entry>
Nov 29 20:29:43 user nova-compute[75356]:       <entry name="uuid">ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb</entry>
Nov 29 20:29:43 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:29:43 user nova-compute[75356]:     </system>
Nov 29 20:29:43 user nova-compute[75356]:   </sysinfo>
Nov 29 20:29:43 user nova-compute[75356]:   <os>
Nov 29 20:29:43 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:29:43 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:29:43 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:29:43 user nova-compute[75356]:   </os>
Nov 29 20:29:43 user nova-compute[75356]:   <features>
Nov 29 20:29:43 user nova-compute[75356]:     <acpi/>
Nov 29 20:29:43 user nova-compute[75356]:     <apic/>
Nov 29 20:29:43 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:29:43 user nova-compute[75356]:   </features>
Nov 29 20:29:43 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:29:43 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:29:43 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:29:43 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:29:43 user nova-compute[75356]:   </clock>
Nov 29 20:29:43 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:29:43 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:29:43 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:29:43 user nova-compute[75356]:   </cpu>
Nov 29 20:29:43 user nova-compute[75356]:   <devices>
Nov 29 20:29:43 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:29:43 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:29:43 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk"/>
Nov 29 20:29:43 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:29:43 user nova-compute[75356]:     </disk>
Nov 29 20:29:43 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:29:43 user nova-compute[75356]:       <mac address="fa:16:3e:03:0f:9e"/>
Nov 29 20:29:43 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:29:43 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:29:43 user nova-compute[75356]:       <target dev="tap617944a3-eb"/>
Nov 29 20:29:43 user nova-compute[75356]:     </interface>
Nov 29 20:29:43 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:29:43 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/console.log" append="off"/>
Nov 29 20:29:43 user nova-compute[75356]:     </serial>
Nov 29 20:29:43 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:29:43 user nova-compute[75356]:     <video>
Nov 29 20:29:43 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:29:43 user nova-compute[75356]:     </video>
Nov 29 20:29:43 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:29:43 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:29:43 user nova-compute[75356]:     </rng>
Nov 29 20:29:43 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:29:43 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:29:43 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:29:43 user nova-compute[75356]:     </memballoon>
Nov 29 20:29:43 user nova-compute[75356]:   </devices>
Nov 29 20:29:43 user nova-compute[75356]: </domain>
Nov 29 20:29:43 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746543629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746543629',id=34,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoBYhUZTHHk0CREN0lXpO01HfOR1JC0gy8IkTdtaqmqYZSwBX5tvSh0xRk0q4YRJyhgG6K0SdzHAwxFF/zK8Mb+8/lRRNokeiBDcNpDtwZ4Op8oi1jdXBF3LvLyPmY1Tg==',key_name='tempest-keypair-1798007487',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71e99301081a4158bc9d188e2f796350',ramdisk_id='',reservation_id='r-np63f8g4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1538416601',owner_user_name='tempest-AttachVolumeShelveTestJSON-1538416601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecc96706ae3140ce8816c0e78e116d7d',uuid=ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "address": "fa:16:3e:03:0f:9e", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617944a3-eb", "ovs_interfaceid": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converting VIF {"id": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "address": "fa:16:3e:03:0f:9e", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617944a3-eb", "ovs_interfaceid": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:0f:9e,bridge_name='br-int',has_traffic_filtering=True,id=617944a3-eb1e-431e-8b2f-f3090e4947e4,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617944a3-eb') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG os_vif [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:0f:9e,bridge_name='br-int',has_traffic_filtering=True,id=617944a3-eb1e-431e-8b2f-f3090e4947e4,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617944a3-eb') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:29:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a30e5997-5fc7-5bdb-a957-44fd2db6bf89', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:29:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap617944a3-eb, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap617944a3-eb, col_values=(('qos', UUID('6c6e932d-35f3-40b7-92c3-97e7bfc00fd9')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap617944a3-eb, col_values=(('external_ids', {'iface-id': '617944a3-eb1e-431e-8b2f-f3090e4947e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:0f:9e', 'vm-uuid': 'ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:29:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:29:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:44 user nova-compute[75356]: INFO os_vif [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:0f:9e,bridge_name='br-int',has_traffic_filtering=True,id=617944a3-eb1e-431e-8b2f-f3090e4947e4,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617944a3-eb')
Nov 29 20:29:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:29:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] No VIF found with MAC fa:16:3e:03:0f:9e, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:29:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:45 user nova-compute[75356]: DEBUG nova.network.neutron [req-b93c01cb-6255-4b3f-851b-650546b5baad req-cac4a5a3-3ef9-4786-9219-d78798b08a52 service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Updated VIF entry in instance network info cache for port 617944a3-eb1e-431e-8b2f-f3090e4947e4. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:29:45 user nova-compute[75356]: DEBUG nova.network.neutron [req-b93c01cb-6255-4b3f-851b-650546b5baad req-cac4a5a3-3ef9-4786-9219-d78798b08a52 service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Updating instance_info_cache with network_info: [{"id": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "address": "fa:16:3e:03:0f:9e", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617944a3-eb", "ovs_interfaceid": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:29:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b93c01cb-6255-4b3f-851b-650546b5baad req-cac4a5a3-3ef9-4786-9219-d78798b08a52 service nova] Releasing lock "refresh_cache-ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:29:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:47 user nova-compute[75356]: DEBUG nova.compute.manager [req-e36ef2c6-d399-4ce6-8bdd-81cdc30ad7f2 req-3f26a76e-2513-4b92-8c73-2de79545bcaa service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Received event network-vif-plugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:29:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e36ef2c6-d399-4ce6-8bdd-81cdc30ad7f2 req-3f26a76e-2513-4b92-8c73-2de79545bcaa service nova] Acquiring lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e36ef2c6-d399-4ce6-8bdd-81cdc30ad7f2 req-3f26a76e-2513-4b92-8c73-2de79545bcaa service nova] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e36ef2c6-d399-4ce6-8bdd-81cdc30ad7f2 req-3f26a76e-2513-4b92-8c73-2de79545bcaa service nova] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:47 user nova-compute[75356]: DEBUG nova.compute.manager [req-e36ef2c6-d399-4ce6-8bdd-81cdc30ad7f2 req-3f26a76e-2513-4b92-8c73-2de79545bcaa service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] No waiting events found dispatching network-vif-plugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:29:47 user nova-compute[75356]: WARNING nova.compute.manager [req-e36ef2c6-d399-4ce6-8bdd-81cdc30ad7f2 req-3f26a76e-2513-4b92-8c73-2de79545bcaa service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Received unexpected event network-vif-plugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 for instance with vm_state building and task_state spawning.
Nov 29 20:29:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:48 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:29:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:29:48 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Instance spawned successfully.
Nov 29 20:29:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:29:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:29:48 user nova-compute[75356]: INFO nova.compute.manager [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Took 8.09 seconds to spawn the instance on the hypervisor.
Nov 29 20:29:48 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:29:48 user nova-compute[75356]: INFO nova.compute.manager [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Took 8.99 seconds to build instance.
Nov 29 20:29:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5fbacd9c-6e27-4b80-a658-dc872cfd3034 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.120s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:49 user nova-compute[75356]: DEBUG nova.compute.manager [req-d115461f-2fab-43da-b433-a913523aa01e req-746abcdf-4bbc-40b3-b572-39decef4484c service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Received event network-vif-plugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:29:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d115461f-2fab-43da-b433-a913523aa01e req-746abcdf-4bbc-40b3-b572-39decef4484c service nova] Acquiring lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d115461f-2fab-43da-b433-a913523aa01e req-746abcdf-4bbc-40b3-b572-39decef4484c service nova] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d115461f-2fab-43da-b433-a913523aa01e req-746abcdf-4bbc-40b3-b572-39decef4484c service nova] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:49 user nova-compute[75356]: DEBUG nova.compute.manager [req-d115461f-2fab-43da-b433-a913523aa01e req-746abcdf-4bbc-40b3-b572-39decef4484c service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] No waiting events found dispatching network-vif-plugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:29:49 user nova-compute[75356]: WARNING nova.compute.manager [req-d115461f-2fab-43da-b433-a913523aa01e req-746abcdf-4bbc-40b3-b572-39decef4484c service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Received unexpected event network-vif-plugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 for instance with vm_state active and task_state None.
Nov 29 20:29:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Acquiring lock "9033b98b-fb6a-4702-8308-68363c60c6dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:55 user nova-compute[75356]: DEBUG nova.compute.manager [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:29:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:29:56 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:29:56 user nova-compute[75356]: INFO nova.compute.claims [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Claim successful on node user
Nov 29 20:29:56 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:29:56 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:29:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:29:56 user nova-compute[75356]: DEBUG nova.compute.manager [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:29:56 user nova-compute[75356]: DEBUG nova.compute.manager [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:29:56 user nova-compute[75356]: DEBUG nova.network.neutron [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:29:56 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:29:56 user nova-compute[75356]: DEBUG nova.compute.manager [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:29:56 user nova-compute[75356]: DEBUG nova.policy [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f5c736b58ab4ccc913b8efbd8d4365f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b022c8a86cda4a7c90d96d60a8261cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:29:56 user nova-compute[75356]: INFO nova.virt.block_device [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Booting with volume 8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 at /dev/vda
Nov 29 20:29:56 user nova-compute[75356]: DEBUG os_brick.utils [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:29:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:56 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba47f9b-c5d9-4de1-bcd9-9467f7962742]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:56 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d53617-444a-43cf-ba20-88cef954e7fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:29:56 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3079c87f-9138-42f3-8db4-572b178eb67a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:56 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb268ae-1285-4b26-a877-a575f5480f9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:29:56 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:29:56 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:29:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:29:57 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:29:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d6602f-1f5c-443a-8038-7d0b060b4b47]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:29:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:29:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:29:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:29:57 user nova-compute[75356]: DEBUG os_brick.utils [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] <== get_connector_properties: return (203ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:29:57 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Updating existing volume attachment record: dffaeaf1-4268-4c82-9206-a22f2f3e3ed8 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:29:57 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:29:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:57 user nova-compute[75356]: DEBUG nova.network.neutron [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Successfully created port: 2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:29:58 user nova-compute[75356]: DEBUG nova.network.neutron [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Successfully updated port: 2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:29:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Acquiring lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:29:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Acquired lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:29:58 user nova-compute[75356]: DEBUG nova.network.neutron [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:29:58 user nova-compute[75356]: DEBUG nova.compute.manager [req-69d6f822-18bf-44d2-b130-e2224f7c7dbc req-183539c3-1218-4d09-8dac-4e43c1421dc8 service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Received event network-changed-2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:29:58 user nova-compute[75356]: DEBUG nova.compute.manager [req-69d6f822-18bf-44d2-b130-e2224f7c7dbc req-183539c3-1218-4d09-8dac-4e43c1421dc8 service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Refreshing instance network info cache due to event network-changed-2d549e00-e710-4b20-b6b2-69deafe8ff8d. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:29:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-69d6f822-18bf-44d2-b130-e2224f7c7dbc req-183539c3-1218-4d09-8dac-4e43c1421dc8 service nova] Acquiring lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:29:58 user nova-compute[75356]: DEBUG nova.network.neutron [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:29:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:29:59 user nova-compute[75356]: DEBUG nova.network.neutron [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Updating instance_info_cache with network_info: [{"id": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "address": "fa:16:3e:c3:30:66", "network": {"id": "48d05176-aee3-4bf7-a929-a2b3714e9c6e", "bridge": "br-int", "label": "tempest-TestShelveInstance-447192641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022c8a86cda4a7c90d96d60a8261cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d549e00-e7", "ovs_interfaceid": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:29:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Releasing lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:29:59 user nova-compute[75356]: DEBUG nova.compute.manager [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Instance network_info: |[{"id": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "address": "fa:16:3e:c3:30:66", "network": {"id": "48d05176-aee3-4bf7-a929-a2b3714e9c6e", "bridge": "br-int", "label": "tempest-TestShelveInstance-447192641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022c8a86cda4a7c90d96d60a8261cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d549e00-e7", "ovs_interfaceid": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:29:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-69d6f822-18bf-44d2-b130-e2224f7c7dbc req-183539c3-1218-4d09-8dac-4e43c1421dc8 service nova] Acquired lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:29:59 user nova-compute[75356]: DEBUG nova.network.neutron [req-69d6f822-18bf-44d2-b130-e2224f7c7dbc req-183539c3-1218-4d09-8dac-4e43c1421dc8 service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Refreshing network info cache for port 2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:29:59 user nova-compute[75356]: DEBUG nova.network.neutron [req-69d6f822-18bf-44d2-b130-e2224f7c7dbc req-183539c3-1218-4d09-8dac-4e43c1421dc8 service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Updated VIF entry in instance network info cache for port 2d549e00-e710-4b20-b6b2-69deafe8ff8d. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:29:59 user nova-compute[75356]: DEBUG nova.network.neutron [req-69d6f822-18bf-44d2-b130-e2224f7c7dbc req-183539c3-1218-4d09-8dac-4e43c1421dc8 service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Updating instance_info_cache with network_info: [{"id": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "address": "fa:16:3e:c3:30:66", "network": {"id": "48d05176-aee3-4bf7-a929-a2b3714e9c6e", "bridge": "br-int", "label": "tempest-TestShelveInstance-447192641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022c8a86cda4a7c90d96d60a8261cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d549e00-e7", "ovs_interfaceid": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:29:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-69d6f822-18bf-44d2-b130-e2224f7c7dbc req-183539c3-1218-4d09-8dac-4e43c1421dc8 service nova] Releasing lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:29:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:29:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.140s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:30:00 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:30:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:30:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-93183110-d2e2-4da7-ab7d-73378f5e0d42" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:30:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-93183110-d2e2-4da7-ab7d-73378f5e0d42" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:30:00 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:30:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:00 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:30:00 user nova-compute[75356]: INFO nova.compute.claims [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Claim successful on node user
Nov 29 20:30:00 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Updating instance_info_cache with network_info: [{"id": "a9883307-4927-4472-932e-b7a9354d5fe8", "address": "fa:16:3e:80:43:0b", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9883307-49", "ovs_interfaceid": "a9883307-4927-4472-932e-b7a9354d5fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:30:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-93183110-d2e2-4da7-ab7d-73378f5e0d42" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:30:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:30:00 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:30:00 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:30:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:30:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:30:00 user nova-compute[75356]: DEBUG nova.network.neutron [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:30:00 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:30:01 user nova-compute[75356]: DEBUG nova.compute.manager [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:30:01 user nova-compute[75356]: DEBUG nova.policy [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94cd8cc032d5411994573f5b0c3f6d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7627fb78ee514bd0b0d7b5f2a1a807b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:30:01 user nova-compute[75356]: DEBUG nova.compute.manager [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:30:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:30:01 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Creating image(s)
Nov 29 20:30:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "/opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "/opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "/opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:01 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:30:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.211s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.182s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk 1073741824" returned: 0 in 0.120s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.218s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:01 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:30:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:02 user nova-compute[75356]: DEBUG nova.network.neutron [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Successfully created port: b010c396-b323-4964-90bc-ea781b8ee123 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:30:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:02 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Cannot resize image /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:30:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:30:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Ensure instance console log exists: /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:30:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:02 user nova-compute[75356]: DEBUG nova.network.neutron [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Successfully updated port: b010c396-b323-4964-90bc-ea781b8ee123 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:30:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-0eae230f-cc34-46a5-ac89-865d26dd635f req-4cfdc7b6-7ec5-4541-ad07-b4f8faf471c4 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Received event network-changed-b010c396-b323-4964-90bc-ea781b8ee123 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:30:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-0eae230f-cc34-46a5-ac89-865d26dd635f req-4cfdc7b6-7ec5-4541-ad07-b4f8faf471c4 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Refreshing instance network info cache due to event network-changed-b010c396-b323-4964-90bc-ea781b8ee123. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:30:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0eae230f-cc34-46a5-ac89-865d26dd635f req-4cfdc7b6-7ec5-4541-ad07-b4f8faf471c4 service nova] Acquiring lock "refresh_cache-4713c9eb-4052-4d65-a4eb-23e62352185a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:30:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0eae230f-cc34-46a5-ac89-865d26dd635f req-4cfdc7b6-7ec5-4541-ad07-b4f8faf471c4 service nova] Acquired lock "refresh_cache-4713c9eb-4052-4d65-a4eb-23e62352185a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:30:02 user nova-compute[75356]: DEBUG nova.network.neutron [req-0eae230f-cc34-46a5-ac89-865d26dd635f req-4cfdc7b6-7ec5-4541-ad07-b4f8faf471c4 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Refreshing network info cache for port b010c396-b323-4964-90bc-ea781b8ee123 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:30:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "refresh_cache-4713c9eb-4052-4d65-a4eb-23e62352185a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.network.neutron [req-0eae230f-cc34-46a5-ac89-865d26dd635f req-4cfdc7b6-7ec5-4541-ad07-b4f8faf471c4 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.network.neutron [req-0eae230f-cc34-46a5-ac89-865d26dd635f req-4cfdc7b6-7ec5-4541-ad07-b4f8faf471c4 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0eae230f-cc34-46a5-ac89-865d26dd635f req-4cfdc7b6-7ec5-4541-ad07-b4f8faf471c4 service nova] Releasing lock "refresh_cache-4713c9eb-4052-4d65-a4eb-23e62352185a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquired lock "refresh_cache-4713c9eb-4052-4d65-a4eb-23e62352185a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.network.neutron [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.network.neutron [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.network.neutron [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Updating instance_info_cache with network_info: [{"id": "b010c396-b323-4964-90bc-ea781b8ee123", "address": "fa:16:3e:6d:3e:e2", "network": {"id": "17ebb4e8-43d7-4475-90cf-f8883b3ffe1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-50669801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7627fb78ee514bd0b0d7b5f2a1a807b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb010c396-b3", "ovs_interfaceid": "b010c396-b323-4964-90bc-ea781b8ee123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Releasing lock "refresh_cache-4713c9eb-4052-4d65-a4eb-23e62352185a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.compute.manager [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Instance network_info: |[{"id": "b010c396-b323-4964-90bc-ea781b8ee123", "address": "fa:16:3e:6d:3e:e2", "network": {"id": "17ebb4e8-43d7-4475-90cf-f8883b3ffe1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-50669801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7627fb78ee514bd0b0d7b5f2a1a807b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb010c396-b3", "ovs_interfaceid": "b010c396-b323-4964-90bc-ea781b8ee123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Start _get_guest_xml network_info=[{"id": "b010c396-b323-4964-90bc-ea781b8ee123", "address": "fa:16:3e:6d:3e:e2", "network": {"id": "17ebb4e8-43d7-4475-90cf-f8883b3ffe1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-50669801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7627fb78ee514bd0b0d7b5f2a1a807b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb010c396-b3", "ovs_interfaceid": "b010c396-b323-4964-90bc-ea781b8ee123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:30:03 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:30:03 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-275547216',display_name='tempest-SnapshotDataIntegrityTests-server-275547216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-275547216',id=36,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZmSXNdaSBdbWl7teE6orY7DlBV5NyCG6WZs/s0mDK8k7nBbm1klkHu9ThbRF7CT4cqCK91DHv7gRq572ICk0tC48XTLf1RZ0Nt215hxt6da/zAq++fw4qpDNntBUl11g==',key_name='tempest-keypair-787639657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7627fb78ee514bd0b0d7b5f2a1a807b4',ramdisk_id='',reservation_id='r-7a1fmk9f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2005195566',owner_user_name='tempest-SnapshotDataIntegrityTests-2005195566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94cd8cc032d5411994573f5b0c3f6d10',uuid=4713c9eb-4052-4d65-a4eb-23e62352185a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b010c396-b323-4964-90bc-ea781b8ee123", "address": "fa:16:3e:6d:3e:e2", "network": {"id": "17ebb4e8-43d7-4475-90cf-f8883b3ffe1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-50669801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7627fb78ee514bd0b0d7b5f2a1a807b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb010c396-b3", "ovs_interfaceid": "b010c396-b323-4964-90bc-ea781b8ee123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Converting VIF {"id": "b010c396-b323-4964-90bc-ea781b8ee123", "address": "fa:16:3e:6d:3e:e2", "network": {"id": "17ebb4e8-43d7-4475-90cf-f8883b3ffe1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-50669801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7627fb78ee514bd0b0d7b5f2a1a807b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb010c396-b3", "ovs_interfaceid": "b010c396-b323-4964-90bc-ea781b8ee123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:3e:e2,bridge_name='br-int',has_traffic_filtering=True,id=b010c396-b323-4964-90bc-ea781b8ee123,network=Network(17ebb4e8-43d7-4475-90cf-f8883b3ffe1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb010c396-b3') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.objects.instance [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lazy-loading 'pci_devices' on Instance uuid 4713c9eb-4052-4d65-a4eb-23e62352185a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:30:03 user nova-compute[75356]:   <uuid>4713c9eb-4052-4d65-a4eb-23e62352185a</uuid>
Nov 29 20:30:03 user nova-compute[75356]:   <name>instance-00000024</name>
Nov 29 20:30:03 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:30:03 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:30:03 user nova-compute[75356]:   <metadata>
Nov 29 20:30:03 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:30:03 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:30:03 user nova-compute[75356]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-275547216</nova:name>
Nov 29 20:30:03 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:30:03</nova:creationTime>
Nov 29 20:30:03 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:30:03 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:30:03 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:30:03 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:30:03 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:30:03 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:30:03 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:30:03 user nova-compute[75356]:       <nova:owner>
Nov 29 20:30:03 user nova-compute[75356]:         <nova:user uuid="94cd8cc032d5411994573f5b0c3f6d10">tempest-SnapshotDataIntegrityTests-2005195566-project-member</nova:user>
Nov 29 20:30:03 user nova-compute[75356]:         <nova:project uuid="7627fb78ee514bd0b0d7b5f2a1a807b4">tempest-SnapshotDataIntegrityTests-2005195566</nova:project>
Nov 29 20:30:03 user nova-compute[75356]:       </nova:owner>
Nov 29 20:30:03 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:30:03 user nova-compute[75356]:       <nova:ports>
Nov 29 20:30:03 user nova-compute[75356]:         <nova:port uuid="b010c396-b323-4964-90bc-ea781b8ee123">
Nov 29 20:30:03 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 20:30:03 user nova-compute[75356]:         </nova:port>
Nov 29 20:30:03 user nova-compute[75356]:       </nova:ports>
Nov 29 20:30:03 user nova-compute[75356]:     </nova:instance>
Nov 29 20:30:03 user nova-compute[75356]:   </metadata>
Nov 29 20:30:03 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:30:03 user nova-compute[75356]:     <system>
Nov 29 20:30:03 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:30:03 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:30:03 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:30:03 user nova-compute[75356]:       <entry name="serial">4713c9eb-4052-4d65-a4eb-23e62352185a</entry>
Nov 29 20:30:03 user nova-compute[75356]:       <entry name="uuid">4713c9eb-4052-4d65-a4eb-23e62352185a</entry>
Nov 29 20:30:03 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:30:03 user nova-compute[75356]:     </system>
Nov 29 20:30:03 user nova-compute[75356]:   </sysinfo>
Nov 29 20:30:03 user nova-compute[75356]:   <os>
Nov 29 20:30:03 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:30:03 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:30:03 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:30:03 user nova-compute[75356]:   </os>
Nov 29 20:30:03 user nova-compute[75356]:   <features>
Nov 29 20:30:03 user nova-compute[75356]:     <acpi/>
Nov 29 20:30:03 user nova-compute[75356]:     <apic/>
Nov 29 20:30:03 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:30:03 user nova-compute[75356]:   </features>
Nov 29 20:30:03 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:30:03 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:30:03 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:30:03 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:30:03 user nova-compute[75356]:   </clock>
Nov 29 20:30:03 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:30:03 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:30:03 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:30:03 user nova-compute[75356]:   </cpu>
Nov 29 20:30:03 user nova-compute[75356]:   <devices>
Nov 29 20:30:03 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:30:03 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:30:03 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk"/>
Nov 29 20:30:03 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:30:03 user nova-compute[75356]:     </disk>
Nov 29 20:30:03 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:30:03 user nova-compute[75356]:       <mac address="fa:16:3e:6d:3e:e2"/>
Nov 29 20:30:03 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:30:03 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:30:03 user nova-compute[75356]:       <target dev="tapb010c396-b3"/>
Nov 29 20:30:03 user nova-compute[75356]:     </interface>
Nov 29 20:30:03 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:30:03 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/console.log" append="off"/>
Nov 29 20:30:03 user nova-compute[75356]:     </serial>
Nov 29 20:30:03 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:30:03 user nova-compute[75356]:     <video>
Nov 29 20:30:03 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:30:03 user nova-compute[75356]:     </video>
Nov 29 20:30:03 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:30:03 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:30:03 user nova-compute[75356]:     </rng>
Nov 29 20:30:03 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:30:03 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:30:03 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:30:03 user nova-compute[75356]:     </memballoon>
Nov 29 20:30:03 user nova-compute[75356]:   </devices>
Nov 29 20:30:03 user nova-compute[75356]: </domain>
Nov 29 20:30:03 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-275547216',display_name='tempest-SnapshotDataIntegrityTests-server-275547216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-275547216',id=36,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZmSXNdaSBdbWl7teE6orY7DlBV5NyCG6WZs/s0mDK8k7nBbm1klkHu9ThbRF7CT4cqCK91DHv7gRq572ICk0tC48XTLf1RZ0Nt215hxt6da/zAq++fw4qpDNntBUl11g==',key_name='tempest-keypair-787639657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7627fb78ee514bd0b0d7b5f2a1a807b4',ramdisk_id='',reservation_id='r-7a1fmk9f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2005195566',owner_user_name='tempest-SnapshotDataIntegrityTests-2005195566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:30:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94cd8cc032d5411994573f5b0c3f6d10',uuid=4713c9eb-4052-4d65-a4eb-23e62352185a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b010c396-b323-4964-90bc-ea781b8ee123", "address": "fa:16:3e:6d:3e:e2", "network": {"id": "17ebb4e8-43d7-4475-90cf-f8883b3ffe1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-50669801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7627fb78ee514bd0b0d7b5f2a1a807b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb010c396-b3", "ovs_interfaceid": "b010c396-b323-4964-90bc-ea781b8ee123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Converting VIF {"id": "b010c396-b323-4964-90bc-ea781b8ee123", "address": "fa:16:3e:6d:3e:e2", "network": {"id": "17ebb4e8-43d7-4475-90cf-f8883b3ffe1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-50669801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7627fb78ee514bd0b0d7b5f2a1a807b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb010c396-b3", "ovs_interfaceid": "b010c396-b323-4964-90bc-ea781b8ee123", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:3e:e2,bridge_name='br-int',has_traffic_filtering=True,id=b010c396-b323-4964-90bc-ea781b8ee123,network=Network(17ebb4e8-43d7-4475-90cf-f8883b3ffe1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb010c396-b3') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG os_vif [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:3e:e2,bridge_name='br-int',has_traffic_filtering=True,id=b010c396-b323-4964-90bc-ea781b8ee123,network=Network(17ebb4e8-43d7-4475-90cf-f8883b3ffe1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb010c396-b3') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60552fd7-b0d6-5bba-a538-be47488b06df', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb010c396-b3, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb010c396-b3, col_values=(('qos', UUID('ad3d96c0-32e9-4cfc-8214-26d9400cee49')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb010c396-b3, col_values=(('external_ids', {'iface-id': 'b010c396-b323-4964-90bc-ea781b8ee123', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:3e:e2', 'vm-uuid': '4713c9eb-4052-4d65-a4eb-23e62352185a'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:03 user nova-compute[75356]: INFO os_vif [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:3e:e2,bridge_name='br-int',has_traffic_filtering=True,id=b010c396-b323-4964-90bc-ea781b8ee123,network=Network(17ebb4e8-43d7-4475-90cf-f8883b3ffe1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb010c396-b3')
Nov 29 20:30:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] No VIF found with MAC fa:16:3e:6d:3e:e2, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:30:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:30:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4df05b-79b4-401b-8fb2-4d3de35c5509/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4df05b-79b4-401b-8fb2-4d3de35c5509/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4df05b-79b4-401b-8fb2-4d3de35c5509/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4df05b-79b4-401b-8fb2-4d3de35c5509/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:05 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:30:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:05 user nova-compute[75356]: DEBUG nova.compute.manager [req-61a87b7a-4c05-4605-be2f-c2ff43e51f01 req-d8761770-e987-42bf-afec-71596d8ceaba service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Received event network-vif-plugged-b010c396-b323-4964-90bc-ea781b8ee123 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:30:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-61a87b7a-4c05-4605-be2f-c2ff43e51f01 req-d8761770-e987-42bf-afec-71596d8ceaba service nova] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-61a87b7a-4c05-4605-be2f-c2ff43e51f01 req-d8761770-e987-42bf-afec-71596d8ceaba service nova] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-61a87b7a-4c05-4605-be2f-c2ff43e51f01 req-d8761770-e987-42bf-afec-71596d8ceaba service nova] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:05 user nova-compute[75356]: DEBUG nova.compute.manager [req-61a87b7a-4c05-4605-be2f-c2ff43e51f01 req-d8761770-e987-42bf-afec-71596d8ceaba service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] No waiting events found dispatching network-vif-plugged-b010c396-b323-4964-90bc-ea781b8ee123 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:30:05 user nova-compute[75356]: WARNING nova.compute.manager [req-61a87b7a-4c05-4605-be2f-c2ff43e51f01 req-d8761770-e987-42bf-afec-71596d8ceaba service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Received unexpected event network-vif-plugged-b010c396-b323-4964-90bc-ea781b8ee123 for instance with vm_state building and task_state spawning.
Nov 29 20:30:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:05 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:30:05 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG nova.compute.manager [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:30:06 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Creating image(s)
Nov 29 20:30:06 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Did not create local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Ensure instance console log exists: /opt/stack/data/nova/instances/9033b98b-fb6a-4702-8308-68363c60c6dc/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Start _get_guest_xml network_info=[{"id": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "address": "fa:16:3e:c3:30:66", "network": {"id": "48d05176-aee3-4bf7-a929-a2b3714e9c6e", "bridge": "br-int", "label": "tempest-TestShelveInstance-447192641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022c8a86cda4a7c90d96d60a8261cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d549e00-e7", "ovs_interfaceid": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFVWetKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9033b98b-fb6a-4702-8308-68363c60c6dc', 'attached_at': '', 'detached_at': '', 'volume_id': '8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7', 'serial': '8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7'}, 'attachment_id': 'dffaeaf1-4268-4c82-9206-a22f2f3e3ed8', 'volume_type': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:30:06 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:30:06 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:30:06 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFVWetKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:30:06 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:30:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:30:06 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:30:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:30:06 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3188f986-1bd0-454f-be83-69d92368aea7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:30:06 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bac5bd6-35c0-411f-bbf5-b6e8038f1bbd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7] added
Nov 29 20:30:06 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2005ad4-d3d5-4eb9-8088-4a7e8d4fb058]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f782536-f891-4576-83f6-a4d851a97a55]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pFVWetKY {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pFVWetKY" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6074130d-1e43-4e2f-9d31-a0aaee913614]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pFVWetKY'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2301a951-120e-4a2c-98d8-a57b418121a8]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[de910928-2e28-4976-b6c3-4364d8b4e4e1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:30:06 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:30:06 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:30:06 user nova-compute[75356]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:30:06 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:30:06 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:30:06 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:30:06 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:30:06 user nova-compute[75356]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:30:06 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:30:06 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[456f5ef5-97ab-45bf-bcd5-ea27e6ea366a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7, portal: 172.16.0.220,3260]
Nov 29 20:30:06 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7, portal: 172.16.0.220,3260] successful.
Nov 29 20:30:06 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6a8af0-29e3-4ba3-b2eb-ff3032dad8a5]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f556d5fb-87c3-46b3-affb-4c3f3534381d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:30:06 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:30:06 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:30:06 user nova-compute[75356]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:30:06 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:30:06 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:30:06 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:30:06 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:30:06 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:30:06 user nova-compute[75356]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:30:06 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:30:06 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:30:06 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] HCTL ('38', '-', '-', 0) found on session 32 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[980f6465-22e0-4b28-b057-c32f83bce863]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Searching for a device in session 32 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFVWetKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG nova.compute.manager [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:30:07 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Instance spawned successfully.
Nov 29 20:30:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:07 user nova-compute[75356]: INFO nova.compute.manager [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Took 6.21 seconds to spawn the instance on the hypervisor.
Nov 29 20:30:07 user nova-compute[75356]: DEBUG nova.compute.manager [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23331333836383439', 'path': '/dev/sdg'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331333836383439', 'path': '/dev/sdg'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:30:07 user nova-compute[75356]: INFO nova.compute.manager [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Took 7.16 seconds to build instance.
Nov 29 20:30:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6e37e275-60fc-4a37-ab1b-540414975140 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.520s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:29:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-944208577',display_name='tempest-TestShelveInstance-server-944208577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-944208577',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7rG4LPitcy3wY+Vt34PAYOYla8jNk64fkntCEF0ecMI0BzP3qHqoNeWWWjhTJA09mZl93bIwMIVOXKCBZz2ukSQkF4PU+LPW80GhWotpvwsJBnJMXD7Ngy6h16xpSt0A==',key_name='tempest-TestShelveInstance-1797487326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b022c8a86cda4a7c90d96d60a8261cfb',ramdisk_id='',reservation_id='r-nnfyeth2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-930711373',owner_user_name='tempest-TestShelveInstance-930711373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:29:57Z,user_data=None,user_id='3f5c736b58ab4ccc913b8efbd8d4365f',uuid=9033b98b-fb6a-4702-8308-68363c60c6dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "address": "fa:16:3e:c3:30:66", "network": {"id": "48d05176-aee3-4bf7-a929-a2b3714e9c6e", "bridge": "br-int", "label": "tempest-TestShelveInstance-447192641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022c8a86cda4a7c90d96d60a8261cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d549e00-e7", "ovs_interfaceid": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Converting VIF {"id": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "address": "fa:16:3e:c3:30:66", "network": {"id": "48d05176-aee3-4bf7-a929-a2b3714e9c6e", "bridge": "br-int", "label": "tempest-TestShelveInstance-447192641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022c8a86cda4a7c90d96d60a8261cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d549e00-e7", "ovs_interfaceid": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:30:66,bridge_name='br-int',has_traffic_filtering=True,id=2d549e00-e710-4b20-b6b2-69deafe8ff8d,network=Network(48d05176-aee3-4bf7-a929-a2b3714e9c6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d549e00-e7') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG nova.objects.instance [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lazy-loading 'pci_devices' on Instance uuid 9033b98b-fb6a-4702-8308-68363c60c6dc {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:30:07 user nova-compute[75356]:   <uuid>9033b98b-fb6a-4702-8308-68363c60c6dc</uuid>
Nov 29 20:30:07 user nova-compute[75356]:   <name>instance-00000023</name>
Nov 29 20:30:07 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:30:07 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:30:07 user nova-compute[75356]:   <metadata>
Nov 29 20:30:07 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:30:07 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:30:07 user nova-compute[75356]:       <nova:name>tempest-TestShelveInstance-server-944208577</nova:name>
Nov 29 20:30:07 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:30:06</nova:creationTime>
Nov 29 20:30:07 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:30:07 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:30:07 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:30:07 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:30:07 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:30:07 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:30:07 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:30:07 user nova-compute[75356]:       <nova:owner>
Nov 29 20:30:07 user nova-compute[75356]:         <nova:user uuid="3f5c736b58ab4ccc913b8efbd8d4365f">tempest-TestShelveInstance-930711373-project-member</nova:user>
Nov 29 20:30:07 user nova-compute[75356]:         <nova:project uuid="b022c8a86cda4a7c90d96d60a8261cfb">tempest-TestShelveInstance-930711373</nova:project>
Nov 29 20:30:07 user nova-compute[75356]:       </nova:owner>
Nov 29 20:30:07 user nova-compute[75356]:       <nova:ports>
Nov 29 20:30:07 user nova-compute[75356]:         <nova:port uuid="2d549e00-e710-4b20-b6b2-69deafe8ff8d">
Nov 29 20:30:07 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 20:30:07 user nova-compute[75356]:         </nova:port>
Nov 29 20:30:07 user nova-compute[75356]:       </nova:ports>
Nov 29 20:30:07 user nova-compute[75356]:     </nova:instance>
Nov 29 20:30:07 user nova-compute[75356]:   </metadata>
Nov 29 20:30:07 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:30:07 user nova-compute[75356]:     <system>
Nov 29 20:30:07 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:30:07 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:30:07 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:30:07 user nova-compute[75356]:       <entry name="serial">9033b98b-fb6a-4702-8308-68363c60c6dc</entry>
Nov 29 20:30:07 user nova-compute[75356]:       <entry name="uuid">9033b98b-fb6a-4702-8308-68363c60c6dc</entry>
Nov 29 20:30:07 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:30:07 user nova-compute[75356]:     </system>
Nov 29 20:30:07 user nova-compute[75356]:   </sysinfo>
Nov 29 20:30:07 user nova-compute[75356]:   <os>
Nov 29 20:30:07 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:30:07 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:30:07 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:30:07 user nova-compute[75356]:   </os>
Nov 29 20:30:07 user nova-compute[75356]:   <features>
Nov 29 20:30:07 user nova-compute[75356]:     <acpi/>
Nov 29 20:30:07 user nova-compute[75356]:     <apic/>
Nov 29 20:30:07 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:30:07 user nova-compute[75356]:   </features>
Nov 29 20:30:07 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:30:07 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:30:07 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:30:07 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:30:07 user nova-compute[75356]:   </clock>
Nov 29 20:30:07 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:30:07 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:30:07 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:30:07 user nova-compute[75356]:   </cpu>
Nov 29 20:30:07 user nova-compute[75356]:   <devices>
Nov 29 20:30:07 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:30:07 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:30:07 user nova-compute[75356]:       <source dev="/dev/sdg"/>
Nov 29 20:30:07 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:30:07 user nova-compute[75356]:       <serial>8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7</serial>
Nov 29 20:30:07 user nova-compute[75356]:     </disk>
Nov 29 20:30:07 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:30:07 user nova-compute[75356]:       <mac address="fa:16:3e:c3:30:66"/>
Nov 29 20:30:07 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:30:07 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:30:07 user nova-compute[75356]:       <target dev="tap2d549e00-e7"/>
Nov 29 20:30:07 user nova-compute[75356]:     </interface>
Nov 29 20:30:07 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:30:07 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/9033b98b-fb6a-4702-8308-68363c60c6dc/console.log" append="off"/>
Nov 29 20:30:07 user nova-compute[75356]:     </serial>
Nov 29 20:30:07 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:30:07 user nova-compute[75356]:     <video>
Nov 29 20:30:07 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:30:07 user nova-compute[75356]:     </video>
Nov 29 20:30:07 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:30:07 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:30:07 user nova-compute[75356]:     </rng>
Nov 29 20:30:07 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:30:07 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:30:07 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:30:07 user nova-compute[75356]:     </memballoon>
Nov 29 20:30:07 user nova-compute[75356]:   </devices>
Nov 29 20:30:07 user nova-compute[75356]: </domain>
Nov 29 20:30:07 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:29:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-944208577',display_name='tempest-TestShelveInstance-server-944208577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-944208577',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7rG4LPitcy3wY+Vt34PAYOYla8jNk64fkntCEF0ecMI0BzP3qHqoNeWWWjhTJA09mZl93bIwMIVOXKCBZz2ukSQkF4PU+LPW80GhWotpvwsJBnJMXD7Ngy6h16xpSt0A==',key_name='tempest-TestShelveInstance-1797487326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b022c8a86cda4a7c90d96d60a8261cfb',ramdisk_id='',reservation_id='r-nnfyeth2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-930711373',owner_user_name='tempest-TestShelveInstance-930711373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:29:57Z,user_data=None,user_id='3f5c736b58ab4ccc913b8efbd8d4365f',uuid=9033b98b-fb6a-4702-8308-68363c60c6dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "address": "fa:16:3e:c3:30:66", "network": {"id": "48d05176-aee3-4bf7-a929-a2b3714e9c6e", "bridge": "br-int", "label": "tempest-TestShelveInstance-447192641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022c8a86cda4a7c90d96d60a8261cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d549e00-e7", "ovs_interfaceid": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Converting VIF {"id": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "address": "fa:16:3e:c3:30:66", "network": {"id": "48d05176-aee3-4bf7-a929-a2b3714e9c6e", "bridge": "br-int", "label": "tempest-TestShelveInstance-447192641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022c8a86cda4a7c90d96d60a8261cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d549e00-e7", "ovs_interfaceid": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:30:66,bridge_name='br-int',has_traffic_filtering=True,id=2d549e00-e710-4b20-b6b2-69deafe8ff8d,network=Network(48d05176-aee3-4bf7-a929-a2b3714e9c6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d549e00-e7') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG os_vif [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:30:66,bridge_name='br-int',has_traffic_filtering=True,id=2d549e00-e710-4b20-b6b2-69deafe8ff8d,network=Network(48d05176-aee3-4bf7-a929-a2b3714e9c6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d549e00-e7') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36b389be-cf77-53eb-8076-af96c4666ad4', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d549e00-e7, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d549e00-e7, col_values=(('qos', UUID('399d7339-930d-4592-811f-fc9ea7fc56fb')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d549e00-e7, col_values=(('external_ids', {'iface-id': '2d549e00-e710-4b20-b6b2-69deafe8ff8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:30:66', 'vm-uuid': '9033b98b-fb6a-4702-8308-68363c60c6dc'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:07 user nova-compute[75356]: INFO os_vif [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:30:66,bridge_name='br-int',has_traffic_filtering=True,id=2d549e00-e710-4b20-b6b2-69deafe8ff8d,network=Network(48d05176-aee3-4bf7-a929-a2b3714e9c6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d549e00-e7')
Nov 29 20:30:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] No VIF found with MAC fa:16:3e:c3:30:66, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-0c2471eb-300e-4767-b7cc-53ccfeccdba8 req-a93bc556-9a17-4ed6-a61b-ea648cb42b9d service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Received event network-vif-plugged-b010c396-b323-4964-90bc-ea781b8ee123 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0c2471eb-300e-4767-b7cc-53ccfeccdba8 req-a93bc556-9a17-4ed6-a61b-ea648cb42b9d service nova] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0c2471eb-300e-4767-b7cc-53ccfeccdba8 req-a93bc556-9a17-4ed6-a61b-ea648cb42b9d service nova] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0c2471eb-300e-4767-b7cc-53ccfeccdba8 req-a93bc556-9a17-4ed6-a61b-ea648cb42b9d service nova] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-0c2471eb-300e-4767-b7cc-53ccfeccdba8 req-a93bc556-9a17-4ed6-a61b-ea648cb42b9d service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] No waiting events found dispatching network-vif-plugged-b010c396-b323-4964-90bc-ea781b8ee123 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:30:07 user nova-compute[75356]: WARNING nova.compute.manager [req-0c2471eb-300e-4767-b7cc-53ccfeccdba8 req-a93bc556-9a17-4ed6-a61b-ea648cb42b9d service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Received unexpected event network-vif-plugged-b010c396-b323-4964-90bc-ea781b8ee123 for instance with vm_state active and task_state None.
Nov 29 20:30:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:08 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:30:08 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:30:08 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=6988MB free_disk=24.909767150878906GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:30:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0b59517a-c467-432a-a73a-d1460c1574e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance db0826f0-5fdc-47a8-ae36-5059844980c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 93183110-d2e2-4da7-ab7d-73378f5e0d42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ee5bef74-04c5-4de1-8f8e-4baba05e2a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance c3bb4cde-968f-4474-abcd-8dbd73300865 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance c477f425-e9ce-4b3a-b21a-8bf04401ad0b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 1e818d19-e8e8-4e41-83b4-53888ea21c93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4b4df05b-79b4-401b-8fb2-4d3de35c5509 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 9033b98b-fb6a-4702-8308-68363c60c6dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4713c9eb-4052-4d65-a4eb-23e62352185a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG nova.compute.manager [req-0039057b-9196-491b-b526-0985a7ed2c2c req-e92ec6f8-0bc9-4f45-b95b-70e14cc2a7f2 service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Received event network-vif-plugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0039057b-9196-491b-b526-0985a7ed2c2c req-e92ec6f8-0bc9-4f45-b95b-70e14cc2a7f2 service nova] Acquiring lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0039057b-9196-491b-b526-0985a7ed2c2c req-e92ec6f8-0bc9-4f45-b95b-70e14cc2a7f2 service nova] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0039057b-9196-491b-b526-0985a7ed2c2c req-e92ec6f8-0bc9-4f45-b95b-70e14cc2a7f2 service nova] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG nova.compute.manager [req-0039057b-9196-491b-b526-0985a7ed2c2c req-e92ec6f8-0bc9-4f45-b95b-70e14cc2a7f2 service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] No waiting events found dispatching network-vif-plugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:30:09 user nova-compute[75356]: WARNING nova.compute.manager [req-0039057b-9196-491b-b526-0985a7ed2c2c req-e92ec6f8-0bc9-4f45-b95b-70e14cc2a7f2 service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Received unexpected event network-vif-plugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d for instance with vm_state building and task_state spawning.
Nov 29 20:30:09 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.829s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:10 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:30:10 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:30:10 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:30:10 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:30:10 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:30:11 user nova-compute[75356]: DEBUG nova.compute.manager [req-3a3da191-91ea-4307-8ddc-6591c68b741d req-bf76270f-df50-4782-a7ba-96001a3a5d0a service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Received event network-vif-plugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:30:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3a3da191-91ea-4307-8ddc-6591c68b741d req-bf76270f-df50-4782-a7ba-96001a3a5d0a service nova] Acquiring lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3a3da191-91ea-4307-8ddc-6591c68b741d req-bf76270f-df50-4782-a7ba-96001a3a5d0a service nova] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3a3da191-91ea-4307-8ddc-6591c68b741d req-bf76270f-df50-4782-a7ba-96001a3a5d0a service nova] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:11 user nova-compute[75356]: DEBUG nova.compute.manager [req-3a3da191-91ea-4307-8ddc-6591c68b741d req-bf76270f-df50-4782-a7ba-96001a3a5d0a service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] No waiting events found dispatching network-vif-plugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:30:11 user nova-compute[75356]: WARNING nova.compute.manager [req-3a3da191-91ea-4307-8ddc-6591c68b741d req-bf76270f-df50-4782-a7ba-96001a3a5d0a service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Received unexpected event network-vif-plugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d for instance with vm_state building and task_state spawning.
Nov 29 20:30:11 user nova-compute[75356]: DEBUG nova.compute.manager [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:30:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:30:11 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Instance spawned successfully.
Nov 29 20:30:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:30:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:30:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:30:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:30:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:30:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:30:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:30:11 user nova-compute[75356]: INFO nova.compute.manager [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 29 20:30:11 user nova-compute[75356]: DEBUG nova.compute.manager [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:30:11 user nova-compute[75356]: INFO nova.compute.manager [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Took 15.77 seconds to build instance.
Nov 29 20:30:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2eedfece-8ae4-486e-aedb-9a986d52d03f tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.869s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:17 user nova-compute[75356]: DEBUG nova.compute.manager [req-d1aa20c3-eeab-4d71-be46-687939ad69fd req-d6f82cdd-91fb-459b-8334-5cc26fbc16df service nova] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Received event network-changed-1527f7c2-52c0-4bf7-bc50-6a4de4629933 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:30:17 user nova-compute[75356]: DEBUG nova.compute.manager [req-d1aa20c3-eeab-4d71-be46-687939ad69fd req-d6f82cdd-91fb-459b-8334-5cc26fbc16df service nova] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Refreshing instance network info cache due to event network-changed-1527f7c2-52c0-4bf7-bc50-6a4de4629933. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:30:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d1aa20c3-eeab-4d71-be46-687939ad69fd req-d6f82cdd-91fb-459b-8334-5cc26fbc16df service nova] Acquiring lock "refresh_cache-c3bb4cde-968f-4474-abcd-8dbd73300865" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:30:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d1aa20c3-eeab-4d71-be46-687939ad69fd req-d6f82cdd-91fb-459b-8334-5cc26fbc16df service nova] Acquired lock "refresh_cache-c3bb4cde-968f-4474-abcd-8dbd73300865" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:30:17 user nova-compute[75356]: DEBUG nova.network.neutron [req-d1aa20c3-eeab-4d71-be46-687939ad69fd req-d6f82cdd-91fb-459b-8334-5cc26fbc16df service nova] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Refreshing network info cache for port 1527f7c2-52c0-4bf7-bc50-6a4de4629933 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:30:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:17 user nova-compute[75356]: DEBUG nova.network.neutron [req-d1aa20c3-eeab-4d71-be46-687939ad69fd req-d6f82cdd-91fb-459b-8334-5cc26fbc16df service nova] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Updated VIF entry in instance network info cache for port 1527f7c2-52c0-4bf7-bc50-6a4de4629933. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:30:17 user nova-compute[75356]: DEBUG nova.network.neutron [req-d1aa20c3-eeab-4d71-be46-687939ad69fd req-d6f82cdd-91fb-459b-8334-5cc26fbc16df service nova] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Updating instance_info_cache with network_info: [{"id": "1527f7c2-52c0-4bf7-bc50-6a4de4629933", "address": "fa:16:3e:f4:a3:a6", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1527f7c2-52", "ovs_interfaceid": "1527f7c2-52c0-4bf7-bc50-6a4de4629933", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:30:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d1aa20c3-eeab-4d71-be46-687939ad69fd req-d6f82cdd-91fb-459b-8334-5cc26fbc16df service nova] Releasing lock "refresh_cache-c3bb4cde-968f-4474-abcd-8dbd73300865" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:30:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "2f1865c9-3202-4162-8949-0ab0f6bc55ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "2f1865c9-3202-4162-8949-0ab0f6bc55ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:25 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:30:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:30:25 user nova-compute[75356]: INFO nova.compute.claims [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Claim successful on node user
Nov 29 20:30:25 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:30:25 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:30:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:25 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:30:25 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:30:25 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:30:25 user nova-compute[75356]: DEBUG nova.network.neutron [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:30:26 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:30:26 user nova-compute[75356]: INFO nova.virt.block_device [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Booting with volume snapshot ea8d2311-525f-4054-9e53-e7f8ca1f5545 at /dev/vda
Nov 29 20:30:26 user nova-compute[75356]: DEBUG nova.policy [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '081b00360a204be3bd6435807283f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6791b0c999846e2a22d5735f91ea1aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:30:27 user nova-compute[75356]: DEBUG nova.network.neutron [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Successfully created port: a3f47fc4-3002-416f-bd0f-323855e3c282 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:30:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:27 user nova-compute[75356]: DEBUG nova.network.neutron [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Successfully updated port: a3f47fc4-3002-416f-bd0f-323855e3c282 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:30:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-13685d22-042f-4834-9c92-10d7f791ff03 req-12f632d2-fd8c-4dc1-963b-23076968bf3d service nova] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Received event network-changed-a3f47fc4-3002-416f-bd0f-323855e3c282 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:30:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-13685d22-042f-4834-9c92-10d7f791ff03 req-12f632d2-fd8c-4dc1-963b-23076968bf3d service nova] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Refreshing instance network info cache due to event network-changed-a3f47fc4-3002-416f-bd0f-323855e3c282. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:30:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-13685d22-042f-4834-9c92-10d7f791ff03 req-12f632d2-fd8c-4dc1-963b-23076968bf3d service nova] Acquiring lock "refresh_cache-2f1865c9-3202-4162-8949-0ab0f6bc55ec" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:30:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-13685d22-042f-4834-9c92-10d7f791ff03 req-12f632d2-fd8c-4dc1-963b-23076968bf3d service nova] Acquired lock "refresh_cache-2f1865c9-3202-4162-8949-0ab0f6bc55ec" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:30:27 user nova-compute[75356]: DEBUG nova.network.neutron [req-13685d22-042f-4834-9c92-10d7f791ff03 req-12f632d2-fd8c-4dc1-963b-23076968bf3d service nova] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Refreshing network info cache for port a3f47fc4-3002-416f-bd0f-323855e3c282 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:30:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "refresh_cache-2f1865c9-3202-4162-8949-0ab0f6bc55ec" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:30:27 user nova-compute[75356]: DEBUG nova.network.neutron [req-13685d22-042f-4834-9c92-10d7f791ff03 req-12f632d2-fd8c-4dc1-963b-23076968bf3d service nova] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:30:28 user nova-compute[75356]: DEBUG nova.network.neutron [req-13685d22-042f-4834-9c92-10d7f791ff03 req-12f632d2-fd8c-4dc1-963b-23076968bf3d service nova] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:30:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-13685d22-042f-4834-9c92-10d7f791ff03 req-12f632d2-fd8c-4dc1-963b-23076968bf3d service nova] Releasing lock "refresh_cache-2f1865c9-3202-4162-8949-0ab0f6bc55ec" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:30:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquired lock "refresh_cache-2f1865c9-3202-4162-8949-0ab0f6bc55ec" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:30:28 user nova-compute[75356]: DEBUG nova.network.neutron [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:30:28 user nova-compute[75356]: DEBUG nova.network.neutron [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:30:28 user nova-compute[75356]: DEBUG nova.network.neutron [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Updating instance_info_cache with network_info: [{"id": "a3f47fc4-3002-416f-bd0f-323855e3c282", "address": "fa:16:3e:63:20:9b", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f47fc4-30", "ovs_interfaceid": "a3f47fc4-3002-416f-bd0f-323855e3c282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:30:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Releasing lock "refresh_cache-2f1865c9-3202-4162-8949-0ab0f6bc55ec" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:30:28 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Instance network_info: |[{"id": "a3f47fc4-3002-416f-bd0f-323855e3c282", "address": "fa:16:3e:63:20:9b", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f47fc4-30", "ovs_interfaceid": "a3f47fc4-3002-416f-bd0f-323855e3c282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:30:30 user nova-compute[75356]: DEBUG nova.compute.manager [req-e01b973c-cdbf-4eba-bc41-2493af504b37 req-0ee1c9c4-0541-4226-b03d-747afdfb8f98 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Received event network-changed-56a80963-a1f2-429e-8474-1795928fd05c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:30:30 user nova-compute[75356]: DEBUG nova.compute.manager [req-e01b973c-cdbf-4eba-bc41-2493af504b37 req-0ee1c9c4-0541-4226-b03d-747afdfb8f98 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Refreshing instance network info cache due to event network-changed-56a80963-a1f2-429e-8474-1795928fd05c. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:30:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e01b973c-cdbf-4eba-bc41-2493af504b37 req-0ee1c9c4-0541-4226-b03d-747afdfb8f98 service nova] Acquiring lock "refresh_cache-0b59517a-c467-432a-a73a-d1460c1574e7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:30:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e01b973c-cdbf-4eba-bc41-2493af504b37 req-0ee1c9c4-0541-4226-b03d-747afdfb8f98 service nova] Acquired lock "refresh_cache-0b59517a-c467-432a-a73a-d1460c1574e7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:30:30 user nova-compute[75356]: DEBUG nova.network.neutron [req-e01b973c-cdbf-4eba-bc41-2493af504b37 req-0ee1c9c4-0541-4226-b03d-747afdfb8f98 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Refreshing network info cache for port 56a80963-a1f2-429e-8474-1795928fd05c {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG nova.network.neutron [req-e01b973c-cdbf-4eba-bc41-2493af504b37 req-0ee1c9c4-0541-4226-b03d-747afdfb8f98 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Updated VIF entry in instance network info cache for port 56a80963-a1f2-429e-8474-1795928fd05c. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG nova.network.neutron [req-e01b973c-cdbf-4eba-bc41-2493af504b37 req-0ee1c9c4-0541-4226-b03d-747afdfb8f98 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Updating instance_info_cache with network_info: [{"id": "56a80963-a1f2-429e-8474-1795928fd05c", "address": "fa:16:3e:74:bd:99", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a80963-a1", "ovs_interfaceid": "56a80963-a1f2-429e-8474-1795928fd05c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e01b973c-cdbf-4eba-bc41-2493af504b37 req-0ee1c9c4-0541-4226-b03d-747afdfb8f98 service nova] Releasing lock "refresh_cache-0b59517a-c467-432a-a73a-d1460c1574e7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG os_brick.utils [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a87d00-cf50-4481-9ac2-cb719fed3324]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b30699f-2717-45b1-bd25-61b6510d0345]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[60128d3e-d31b-40d2-a424-db06c9adc900]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5b11dc-6ae7-4648-bf7b-4a940faf80e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:30:31 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:30:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d45c27-3731-4e6a-959e-3c525a2c941d]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG os_brick.utils [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:30:31 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Updating existing volume attachment record: eb2b6fb5-22af-47c8-b349-0325581b4e6d {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:30:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:32 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Stashing vm_state: active {{(pid=75356) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 29 20:30:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:32 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:30:32 user nova-compute[75356]: INFO nova.compute.claims [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Claim successful on node user
Nov 29 20:30:32 user nova-compute[75356]: INFO nova.compute.resource_tracker [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Updating resource usage from migration 357f69a1-1c25-4514-b15c-a27acae10358
Nov 29 20:30:33 user nova-compute[75356]: DEBUG nova.compute.manager [req-ddd6b533-7ff8-4034-89ef-d44eabf71fda req-2818a5b9-8168-4aae-9d8b-276da265c69c service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Received event network-changed-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:30:33 user nova-compute[75356]: DEBUG nova.compute.manager [req-ddd6b533-7ff8-4034-89ef-d44eabf71fda req-2818a5b9-8168-4aae-9d8b-276da265c69c service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Refreshing instance network info cache due to event network-changed-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:30:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ddd6b533-7ff8-4034-89ef-d44eabf71fda req-2818a5b9-8168-4aae-9d8b-276da265c69c service nova] Acquiring lock "refresh_cache-873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:30:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ddd6b533-7ff8-4034-89ef-d44eabf71fda req-2818a5b9-8168-4aae-9d8b-276da265c69c service nova] Acquired lock "refresh_cache-873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:30:33 user nova-compute[75356]: DEBUG nova.network.neutron [req-ddd6b533-7ff8-4034-89ef-d44eabf71fda req-2818a5b9-8168-4aae-9d8b-276da265c69c service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Refreshing network info cache for port 803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:30:33 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:30:33 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:30:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.578s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:33 user nova-compute[75356]: INFO nova.compute.manager [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Migrating
Nov 29 20:30:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "refresh_cache-873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:30:33 user nova-compute[75356]: DEBUG nova.network.neutron [req-ddd6b533-7ff8-4034-89ef-d44eabf71fda req-2818a5b9-8168-4aae-9d8b-276da265c69c service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Updated VIF entry in instance network info cache for port 803c2f7e-7d7c-46aa-b1a8-63165a13b9a1. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:30:33 user nova-compute[75356]: DEBUG nova.network.neutron [req-ddd6b533-7ff8-4034-89ef-d44eabf71fda req-2818a5b9-8168-4aae-9d8b-276da265c69c service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Updating instance_info_cache with network_info: [{"id": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "address": "fa:16:3e:ed:a6:4a", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c2f7e-7d", "ovs_interfaceid": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:30:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ddd6b533-7ff8-4034-89ef-d44eabf71fda req-2818a5b9-8168-4aae-9d8b-276da265c69c service nova] Releasing lock "refresh_cache-873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:30:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquired lock "refresh_cache-873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:30:33 user nova-compute[75356]: DEBUG nova.network.neutron [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:30:33 user nova-compute[75356]: DEBUG nova.network.neutron [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Updating instance_info_cache with network_info: [{"id": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "address": "fa:16:3e:ed:a6:4a", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c2f7e-7d", "ovs_interfaceid": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:30:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Releasing lock "refresh_cache-873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Starting migrate_disk_and_power_off {{(pid=75356) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG nova.compute.manager [req-c6e11ecb-532a-48bd-8e00-62a8ff8426c9 req-e95cfe7c-029f-4428-a16b-3ca0daa392e0 service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Received event network-vif-unplugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c6e11ecb-532a-48bd-8e00-62a8ff8426c9 req-e95cfe7c-029f-4428-a16b-3ca0daa392e0 service nova] Acquiring lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c6e11ecb-532a-48bd-8e00-62a8ff8426c9 req-e95cfe7c-029f-4428-a16b-3ca0daa392e0 service nova] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c6e11ecb-532a-48bd-8e00-62a8ff8426c9 req-e95cfe7c-029f-4428-a16b-3ca0daa392e0 service nova] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG nova.compute.manager [req-c6e11ecb-532a-48bd-8e00-62a8ff8426c9 req-e95cfe7c-029f-4428-a16b-3ca0daa392e0 service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] No waiting events found dispatching network-vif-unplugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:30:34 user nova-compute[75356]: WARNING nova.compute.manager [req-c6e11ecb-532a-48bd-8e00-62a8ff8426c9 req-e95cfe7c-029f-4428-a16b-3ca0daa392e0 service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Received unexpected event network-vif-unplugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 for instance with vm_state active and task_state resize_migrating.
Nov 29 20:30:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:34 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Instance destroyed successfully.
Nov 29 20:30:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:28:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2053095889',display_name='tempest-ServerActionsTestOtherA-server-2053095889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2053095889',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBES/hmUhRPMEp7jxGNAJkTADe+ykaGX7onK5o5CXk4BGHWdyPerc54MOJxjy4wx3hHylMSlWH2Wjk+mHShNqdbk6ZSJg34jMi+lLZfOCW4j+M+c+q1Lzq5VJUbAeMltLBQ==',key_name='tempest-keypair-777625238',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:29:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8b14efb1a4d34a3db7a51bd79234b86b',ramdisk_id='',reservation_id='r-nplu3go6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1000495362',owner_user_name='tempest-ServerActionsTestOtherA-1000495362-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:30:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc7cfc71d0c448cbbe8d42f8b617d8b',uuid=873a45a7-a06f-4bcd-b517-d6f0ade7e5a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "address": "fa:16:3e:ed:a6:4a", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2079172215-network", "vif_mac": "fa:16:3e:ed:a6:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c2f7e-7d", "ovs_interfaceid": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converting VIF {"id": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "address": "fa:16:3e:ed:a6:4a", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2079172215-network", "vif_mac": "fa:16:3e:ed:a6:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c2f7e-7d", "ovs_interfaceid": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:a6:4a,bridge_name='br-int',has_traffic_filtering=True,id=803c2f7e-7d7c-46aa-b1a8-63165a13b9a1,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803c2f7e-7d') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG os_vif [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:a6:4a,bridge_name='br-int',has_traffic_filtering=True,id=803c2f7e-7d7c-46aa-b1a8-63165a13b9a1,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803c2f7e-7d') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap803c2f7e-7d, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e602859a-308d-4857-80fc-88baeace9ff0) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:34 user nova-compute[75356]: INFO os_vif [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:a6:4a,bridge_name='br-int',has_traffic_filtering=True,id=803c2f7e-7d7c-46aa-b1a8-63165a13b9a1,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803c2f7e-7d')
Nov 29 20:30:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixFVyosu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:30:34 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:30:34 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab64812a-5613-45e3-adc0-4dfc7007e720]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:30:34 user nova-compute[75356]: No targets found.
Nov 29 20:30:34 user nova-compute[75356]: iSNS:
Nov 29 20:30:34 user nova-compute[75356]: No targets found.
Nov 29 20:30:34 user nova-compute[75356]: STATIC:
Nov 29 20:30:34 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09
Nov 29 20:30:34 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:30:34 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:30:34 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460
Nov 29 20:30:34 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:30:34 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:30:34 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7
Nov 29 20:30:34 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:30:34 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:30:34 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b
Nov 29 20:30:34 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:30:34 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:30:34 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8
Nov 29 20:30:34 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:30:34 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:30:34 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:30:34 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:30:34 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:30:34 user nova-compute[75356]: FIRMWARE:
Nov 29 20:30:34 user nova-compute[75356]: No targets found.
Nov 29 20:30:34 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:30:34 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:30:34 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[63caab96-d397-4254-9c3a-a2086ce650d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea33e09-d694-4353-9a2e-83f961fbfa27]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:30:34 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:30:34 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:30:34 user nova-compute[75356]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:30:34 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:30:34 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:30:34 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:30:34 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:30:34 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:30:34 user nova-compute[75356]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:30:34 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:30:34 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:30:34 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f83084924d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09'): ({'sde'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Removing single pathed devices sde {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[618a14c7-e58a-4023-86ea-0fa544765c4b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a26ad1-c856-4c6e-93db-e9359ad572ed]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Flushing IO for device /dev/sde {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:30:34 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a3bad4-5d19-4978-93a2-8900b6b8d3e7]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a839a2-9647-46d0-af40-6ebc625fd00f]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] SCSI volumes sde have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[64455115-28fd-4bfb-a401-2e4cad371b29]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cc2c1d-81af-444f-a112-7b1f9d7b4aef]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09, portal: 172.16.0.220,3260]
Nov 29 20:30:35 user nova-compute[75356]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09, portal: 172.16.0.220,3260] successful.
Nov 29 20:30:35 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.166s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b23b615-b553-431c-a59a-f592a93d1f13]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.492s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] <== disconnect_volume: return (493ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:30:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:30:36 user nova-compute[75356]: DEBUG nova.compute.manager [req-484f7fd7-699d-4e8e-84f0-204eab1491c3 req-dd21e19f-5ce0-4b28-8cc7-661a455db44e service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Received event network-vif-plugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:30:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-484f7fd7-699d-4e8e-84f0-204eab1491c3 req-dd21e19f-5ce0-4b28-8cc7-661a455db44e service nova] Acquiring lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-484f7fd7-699d-4e8e-84f0-204eab1491c3 req-dd21e19f-5ce0-4b28-8cc7-661a455db44e service nova] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-484f7fd7-699d-4e8e-84f0-204eab1491c3 req-dd21e19f-5ce0-4b28-8cc7-661a455db44e service nova] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:36 user nova-compute[75356]: DEBUG nova.compute.manager [req-484f7fd7-699d-4e8e-84f0-204eab1491c3 req-dd21e19f-5ce0-4b28-8cc7-661a455db44e service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] No waiting events found dispatching network-vif-plugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:30:36 user nova-compute[75356]: WARNING nova.compute.manager [req-484f7fd7-699d-4e8e-84f0-204eab1491c3 req-dd21e19f-5ce0-4b28-8cc7-661a455db44e service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Received unexpected event network-vif-plugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 for instance with vm_state active and task_state resize_migrating.
Nov 29 20:30:36 user nova-compute[75356]: DEBUG nova.network.neutron [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Port 803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 binding to destination host user is already ACTIVE {{(pid=75356) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 20:30:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "refresh_cache-873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:30:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquired lock "refresh_cache-873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:30:36 user nova-compute[75356]: DEBUG nova.network.neutron [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:30:37 user nova-compute[75356]: DEBUG nova.network.neutron [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Updating instance_info_cache with network_info: [{"id": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "address": "fa:16:3e:ed:a6:4a", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c2f7e-7d", "ovs_interfaceid": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:30:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Releasing lock "refresh_cache-873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:30:37 user nova-compute[75356]: DEBUG os_brick.utils [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:30:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:37 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e7a4cb-8589-498d-87c3-cb97d7c3e61e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:37 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b1800c-645e-4926-bc7a-2547f655c4f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:37 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f6f5ce-4e80-4055-9ca7-8e06ffcf380d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:37 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b92ec5d-6fb1-4179-af73-30de8178bcc7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:30:37 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:30:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:30:37 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:30:37 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29682e5-a7eb-45ae-b80e-595876b1dea5]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:37 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:30:37 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:30:37 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:30:37 user nova-compute[75356]: DEBUG os_brick.utils [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:30:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:30:40 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Creating image(s)
Nov 29 20:30:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Did not create local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Ensure instance console log exists: /opt/stack/data/nova/instances/2f1865c9-3202-4162-8949-0ab0f6bc55ec/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Start _get_guest_xml network_info=[{"id": "a3f47fc4-3002-416f-bd0f-323855e3c282", "address": "fa:16:3e:63:20:9b", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f47fc4-30", "ovs_interfaceid": "a3f47fc4-3002-416f-bd0f-323855e3c282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-29T20:30:19Z,direct_url=<?>,disk_format='qcow2',id=5f88f134-243e-4b50-b79f-e4f55465e506,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1070338402',owner='f6791b0c999846e2a22d5735f91ea1aa',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-29T20:30:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcRYNqWi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2f1865c9-3202-4162-8949-0ab0f6bc55ec', 'attached_at': '', 'detached_at': '', 'volume_id': '9ff197dd-1740-48e3-87ff-29c2f748a054', 'serial': '9ff197dd-1740-48e3-87ff-29c2f748a054'}, 'attachment_id': 'eb2b6fb5-22af-47c8-b349-0325581b4e6d', 'volume_type': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:30:40 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:30:40 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:30:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-29T20:30:19Z,direct_url=<?>,disk_format='qcow2',id=5f88f134-243e-4b50-b79f-e4f55465e506,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1070338402',owner='f6791b0c999846e2a22d5735f91ea1aa',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-29T20:30:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcRYNqWi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:30:40 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:30:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:30:40 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:30:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:30:40 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a873a9f-7880-4515-a1be-ccbd2730c6d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:30:40 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a16b578-b6cd-4a29-ae67-d4143f4268da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054] added
Nov 29 20:30:40 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b081b02-ac2a-4a57-83a7-43a7fab1e840]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[849f7567-92c0-48c5-9b63-7621c9b838b4]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tcRYNqWi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tcRYNqWi" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7daaba-f826-4bad-a2e4-ed3d1b94385d]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tcRYNqWi'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7207210-c4ba-40df-9442-f7c6fe18881a]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9a3cdf-f694-42c3-92f3-5cd8fe390a72]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:30:40 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:30:40 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:30:40 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:30:40 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:30:40 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:30:40 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:30:40 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:30:40 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:30:40 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:30:40 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d567f6-e4c3-4875-b6a8-66d366a69293]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054, portal: 172.16.0.220,3260]
Nov 29 20:30:40 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054, portal: 172.16.0.220,3260] successful.
Nov 29 20:30:40 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d57428-5202-4814-ab63-11c567f7fde2]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d96e57-3ab6-4c21-b4e4-0982d47907e6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:30:40 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:30:40 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:30:40 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:30:40 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:30:40 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:30:40 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:30:40 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:30:40 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:30:40 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:30:40 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:30:40 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:30:40 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f527cc7c-ae8a-4334-8bb3-8bc1a6b5a879]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:30:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcRYNqWi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23730663664356266', 'path': '/dev/sde'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730663664356266', 'path': '/dev/sde'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:30:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1540359571',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1540359571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1540359571',id=37,image_ref='5f88f134-243e-4b50-b79f-e4f55465e506',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2215fROAiV0/De9CTyWzAdYd5xhnNpCXPLTNH7OpaK35XZI2YS6r/R0ypOYEte16Le66/v5GQdJTs0POUC9aj/cP/OSQC6duoQEmoOCmGaf11gRjpchp3L57Z1TYtZPg==',key_name='tempest-keypair-1313718759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6791b0c999846e2a22d5735f91ea1aa',ramdisk_id='',reservation_id='r-au0os35b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1627976633',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1627976633-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1627976633',owner_user_name='tempest-TestVolumeBootPattern-1627976633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:30:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='081b00360a204be3bd6435807283f230',uuid=2f1865c9-3202-4162-8949-0ab0f6bc55ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3f47fc4-3002-416f-bd0f-323855e3c282", "address": "fa:16:3e:63:20:9b", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f47fc4-30", "ovs_interfaceid": "a3f47fc4-3002-416f-bd0f-323855e3c282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converting VIF {"id": "a3f47fc4-3002-416f-bd0f-323855e3c282", "address": "fa:16:3e:63:20:9b", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f47fc4-30", "ovs_interfaceid": "a3f47fc4-3002-416f-bd0f-323855e3c282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:20:9b,bridge_name='br-int',has_traffic_filtering=True,id=a3f47fc4-3002-416f-bd0f-323855e3c282,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f47fc4-30') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG nova.objects.instance [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f1865c9-3202-4162-8949-0ab0f6bc55ec {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:30:41 user nova-compute[75356]:   <uuid>2f1865c9-3202-4162-8949-0ab0f6bc55ec</uuid>
Nov 29 20:30:41 user nova-compute[75356]:   <name>instance-00000025</name>
Nov 29 20:30:41 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:30:41 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:30:41 user nova-compute[75356]:   <metadata>
Nov 29 20:30:41 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:30:41 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:30:41 user nova-compute[75356]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1540359571</nova:name>
Nov 29 20:30:41 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:30:40</nova:creationTime>
Nov 29 20:30:41 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:30:41 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:30:41 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:30:41 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:30:41 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:30:41 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:30:41 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:30:41 user nova-compute[75356]:       <nova:owner>
Nov 29 20:30:41 user nova-compute[75356]:         <nova:user uuid="081b00360a204be3bd6435807283f230">tempest-TestVolumeBootPattern-1627976633-project-member</nova:user>
Nov 29 20:30:41 user nova-compute[75356]:         <nova:project uuid="f6791b0c999846e2a22d5735f91ea1aa">tempest-TestVolumeBootPattern-1627976633</nova:project>
Nov 29 20:30:41 user nova-compute[75356]:       </nova:owner>
Nov 29 20:30:41 user nova-compute[75356]:       <nova:root type="image" uuid="5f88f134-243e-4b50-b79f-e4f55465e506"/>
Nov 29 20:30:41 user nova-compute[75356]:       <nova:ports>
Nov 29 20:30:41 user nova-compute[75356]:         <nova:port uuid="a3f47fc4-3002-416f-bd0f-323855e3c282">
Nov 29 20:30:41 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 20:30:41 user nova-compute[75356]:         </nova:port>
Nov 29 20:30:41 user nova-compute[75356]:       </nova:ports>
Nov 29 20:30:41 user nova-compute[75356]:     </nova:instance>
Nov 29 20:30:41 user nova-compute[75356]:   </metadata>
Nov 29 20:30:41 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:30:41 user nova-compute[75356]:     <system>
Nov 29 20:30:41 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:30:41 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:30:41 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:30:41 user nova-compute[75356]:       <entry name="serial">2f1865c9-3202-4162-8949-0ab0f6bc55ec</entry>
Nov 29 20:30:41 user nova-compute[75356]:       <entry name="uuid">2f1865c9-3202-4162-8949-0ab0f6bc55ec</entry>
Nov 29 20:30:41 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:30:41 user nova-compute[75356]:     </system>
Nov 29 20:30:41 user nova-compute[75356]:   </sysinfo>
Nov 29 20:30:41 user nova-compute[75356]:   <os>
Nov 29 20:30:41 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:30:41 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:30:41 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:30:41 user nova-compute[75356]:   </os>
Nov 29 20:30:41 user nova-compute[75356]:   <features>
Nov 29 20:30:41 user nova-compute[75356]:     <acpi/>
Nov 29 20:30:41 user nova-compute[75356]:     <apic/>
Nov 29 20:30:41 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:30:41 user nova-compute[75356]:   </features>
Nov 29 20:30:41 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:30:41 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:30:41 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:30:41 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:30:41 user nova-compute[75356]:   </clock>
Nov 29 20:30:41 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:30:41 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:30:41 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:30:41 user nova-compute[75356]:   </cpu>
Nov 29 20:30:41 user nova-compute[75356]:   <devices>
Nov 29 20:30:41 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:30:41 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:30:41 user nova-compute[75356]:       <source dev="/dev/sde"/>
Nov 29 20:30:41 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:30:41 user nova-compute[75356]:       <serial>9ff197dd-1740-48e3-87ff-29c2f748a054</serial>
Nov 29 20:30:41 user nova-compute[75356]:     </disk>
Nov 29 20:30:41 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:30:41 user nova-compute[75356]:       <mac address="fa:16:3e:63:20:9b"/>
Nov 29 20:30:41 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:30:41 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:30:41 user nova-compute[75356]:       <target dev="tapa3f47fc4-30"/>
Nov 29 20:30:41 user nova-compute[75356]:     </interface>
Nov 29 20:30:41 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:30:41 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/2f1865c9-3202-4162-8949-0ab0f6bc55ec/console.log" append="off"/>
Nov 29 20:30:41 user nova-compute[75356]:     </serial>
Nov 29 20:30:41 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:30:41 user nova-compute[75356]:     <video>
Nov 29 20:30:41 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:30:41 user nova-compute[75356]:     </video>
Nov 29 20:30:41 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:30:41 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:30:41 user nova-compute[75356]:     </rng>
Nov 29 20:30:41 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:30:41 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:30:41 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:30:41 user nova-compute[75356]:     </memballoon>
Nov 29 20:30:41 user nova-compute[75356]:   </devices>
Nov 29 20:30:41 user nova-compute[75356]: </domain>
Nov 29 20:30:41 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:30:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1540359571',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1540359571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1540359571',id=37,image_ref='5f88f134-243e-4b50-b79f-e4f55465e506',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2215fROAiV0/De9CTyWzAdYd5xhnNpCXPLTNH7OpaK35XZI2YS6r/R0ypOYEte16Le66/v5GQdJTs0POUC9aj/cP/OSQC6duoQEmoOCmGaf11gRjpchp3L57Z1TYtZPg==',key_name='tempest-keypair-1313718759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6791b0c999846e2a22d5735f91ea1aa',ramdisk_id='',reservation_id='r-au0os35b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1627976633',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1627976633-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1627976633',owner_user_name='tempest-TestVolumeBootPattern-1627976633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:30:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='081b00360a204be3bd6435807283f230',uuid=2f1865c9-3202-4162-8949-0ab0f6bc55ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3f47fc4-3002-416f-bd0f-323855e3c282", "address": "fa:16:3e:63:20:9b", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f47fc4-30", "ovs_interfaceid": "a3f47fc4-3002-416f-bd0f-323855e3c282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converting VIF {"id": "a3f47fc4-3002-416f-bd0f-323855e3c282", "address": "fa:16:3e:63:20:9b", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f47fc4-30", "ovs_interfaceid": "a3f47fc4-3002-416f-bd0f-323855e3c282", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:20:9b,bridge_name='br-int',has_traffic_filtering=True,id=a3f47fc4-3002-416f-bd0f-323855e3c282,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f47fc4-30') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG os_vif [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:20:9b,bridge_name='br-int',has_traffic_filtering=True,id=a3f47fc4-3002-416f-bd0f-323855e3c282,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f47fc4-30') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04d3c4fe-90da-54c2-9f5e-c39c776b6509', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3f47fc4-30, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3f47fc4-30, col_values=(('qos', UUID('04c1b5a9-53d7-4d4d-a21c-c4873d4d185c')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3f47fc4-30, col_values=(('external_ids', {'iface-id': 'a3f47fc4-3002-416f-bd0f-323855e3c282', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:20:9b', 'vm-uuid': '2f1865c9-3202-4162-8949-0ab0f6bc55ec'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:30:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:41 user nova-compute[75356]: INFO os_vif [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:20:9b,bridge_name='br-int',has_traffic_filtering=True,id=a3f47fc4-3002-416f-bd0f-323855e3c282,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f47fc4-30')
Nov 29 20:30:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:30:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] No VIF found with MAC fa:16:3e:63:20:9b, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:30:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:43 user nova-compute[75356]: INFO nova.compute.manager [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Rescuing
Nov 29 20:30:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "refresh_cache-c477f425-e9ce-4b3a-b21a-8bf04401ad0b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:30:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquired lock "refresh_cache-c477f425-e9ce-4b3a-b21a-8bf04401ad0b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:30:43 user nova-compute[75356]: DEBUG nova.network.neutron [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:30:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-67a6d32a-302d-4121-811a-2cb16df29a6d req-23a7cdc0-9696-42ee-9b9b-0b5b41b8a1a6 service nova] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Received event network-vif-plugged-a3f47fc4-3002-416f-bd0f-323855e3c282 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:30:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-67a6d32a-302d-4121-811a-2cb16df29a6d req-23a7cdc0-9696-42ee-9b9b-0b5b41b8a1a6 service nova] Acquiring lock "2f1865c9-3202-4162-8949-0ab0f6bc55ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-67a6d32a-302d-4121-811a-2cb16df29a6d req-23a7cdc0-9696-42ee-9b9b-0b5b41b8a1a6 service nova] Lock "2f1865c9-3202-4162-8949-0ab0f6bc55ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-67a6d32a-302d-4121-811a-2cb16df29a6d req-23a7cdc0-9696-42ee-9b9b-0b5b41b8a1a6 service nova] Lock "2f1865c9-3202-4162-8949-0ab0f6bc55ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-67a6d32a-302d-4121-811a-2cb16df29a6d req-23a7cdc0-9696-42ee-9b9b-0b5b41b8a1a6 service nova] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] No waiting events found dispatching network-vif-plugged-a3f47fc4-3002-416f-bd0f-323855e3c282 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:30:43 user nova-compute[75356]: WARNING nova.compute.manager [req-67a6d32a-302d-4121-811a-2cb16df29a6d req-23a7cdc0-9696-42ee-9b9b-0b5b41b8a1a6 service nova] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Received unexpected event network-vif-plugged-a3f47fc4-3002-416f-bd0f-323855e3c282 for instance with vm_state building and task_state spawning.
Nov 29 20:30:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:43 user nova-compute[75356]: DEBUG nova.network.neutron [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Updating instance_info_cache with network_info: [{"id": "084eeeb2-bcff-437d-ac75-85936e641045", "address": "fa:16:3e:a1:86:c2", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084eeeb2-bc", "ovs_interfaceid": "084eeeb2-bcff-437d-ac75-85936e641045", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:30:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Releasing lock "refresh_cache-c477f425-e9ce-4b3a-b21a-8bf04401ad0b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:30:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:44 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Instance destroyed successfully.
Nov 29 20:30:44 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Attempting a stable device rescue
Nov 29 20:30:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75356) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 20:30:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Instance directory exists: not creating {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 20:30:44 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Creating image(s)
Nov 29 20:30:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "/opt/stack/data/nova/instances/c477f425-e9ce-4b3a-b21a-8bf04401ad0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "/opt/stack/data/nova/instances/c477f425-e9ce-4b3a-b21a-8bf04401ad0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "/opt/stack/data/nova/instances/c477f425-e9ce-4b3a-b21a-8bf04401ad0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:44 user nova-compute[75356]: DEBUG nova.objects.instance [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lazy-loading 'trusted_certs' on Instance uuid c477f425-e9ce-4b3a-b21a-8bf04401ad0b {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:30:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "b2d3c24e4b16198ce6fa6670c8c7c07cd2d4c9c5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "b2d3c24e4b16198ce6fa6670c8c7c07cd2d4c9c5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:45 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2d3c24e4b16198ce6fa6670c8c7c07cd2d4c9c5.part --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:45 user nova-compute[75356]: DEBUG nova.compute.manager [req-484d4cc2-e948-486a-96d2-c479239b5042 req-da2cf4a7-0858-4221-9313-4ef15e32de66 service nova] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Received event network-vif-plugged-a3f47fc4-3002-416f-bd0f-323855e3c282 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:30:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-484d4cc2-e948-486a-96d2-c479239b5042 req-da2cf4a7-0858-4221-9313-4ef15e32de66 service nova] Acquiring lock "2f1865c9-3202-4162-8949-0ab0f6bc55ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-484d4cc2-e948-486a-96d2-c479239b5042 req-da2cf4a7-0858-4221-9313-4ef15e32de66 service nova] Lock "2f1865c9-3202-4162-8949-0ab0f6bc55ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-484d4cc2-e948-486a-96d2-c479239b5042 req-da2cf4a7-0858-4221-9313-4ef15e32de66 service nova] Lock "2f1865c9-3202-4162-8949-0ab0f6bc55ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:45 user nova-compute[75356]: DEBUG nova.compute.manager [req-484d4cc2-e948-486a-96d2-c479239b5042 req-da2cf4a7-0858-4221-9313-4ef15e32de66 service nova] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] No waiting events found dispatching network-vif-plugged-a3f47fc4-3002-416f-bd0f-323855e3c282 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:30:45 user nova-compute[75356]: WARNING nova.compute.manager [req-484d4cc2-e948-486a-96d2-c479239b5042 req-da2cf4a7-0858-4221-9313-4ef15e32de66 service nova] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Received unexpected event network-vif-plugged-a3f47fc4-3002-416f-bd0f-323855e3c282 for instance with vm_state building and task_state spawning.
Nov 29 20:30:45 user nova-compute[75356]: DEBUG nova.compute.manager [req-484d4cc2-e948-486a-96d2-c479239b5042 req-da2cf4a7-0858-4221-9313-4ef15e32de66 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received event network-vif-unplugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:30:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-484d4cc2-e948-486a-96d2-c479239b5042 req-da2cf4a7-0858-4221-9313-4ef15e32de66 service nova] Acquiring lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-484d4cc2-e948-486a-96d2-c479239b5042 req-da2cf4a7-0858-4221-9313-4ef15e32de66 service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-484d4cc2-e948-486a-96d2-c479239b5042 req-da2cf4a7-0858-4221-9313-4ef15e32de66 service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:45 user nova-compute[75356]: DEBUG nova.compute.manager [req-484d4cc2-e948-486a-96d2-c479239b5042 req-da2cf4a7-0858-4221-9313-4ef15e32de66 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] No waiting events found dispatching network-vif-unplugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:30:45 user nova-compute[75356]: WARNING nova.compute.manager [req-484d4cc2-e948-486a-96d2-c479239b5042 req-da2cf4a7-0858-4221-9313-4ef15e32de66 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received unexpected event network-vif-unplugged-084eeeb2-bcff-437d-ac75-85936e641045 for instance with vm_state active and task_state rescuing.
Nov 29 20:30:45 user nova-compute[75356]: DEBUG nova.compute.manager [req-484d4cc2-e948-486a-96d2-c479239b5042 req-da2cf4a7-0858-4221-9313-4ef15e32de66 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:30:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-484d4cc2-e948-486a-96d2-c479239b5042 req-da2cf4a7-0858-4221-9313-4ef15e32de66 service nova] Acquiring lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-484d4cc2-e948-486a-96d2-c479239b5042 req-da2cf4a7-0858-4221-9313-4ef15e32de66 service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-484d4cc2-e948-486a-96d2-c479239b5042 req-da2cf4a7-0858-4221-9313-4ef15e32de66 service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:45 user nova-compute[75356]: DEBUG nova.compute.manager [req-484d4cc2-e948-486a-96d2-c479239b5042 req-da2cf4a7-0858-4221-9313-4ef15e32de66 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] No waiting events found dispatching network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:30:45 user nova-compute[75356]: WARNING nova.compute.manager [req-484d4cc2-e948-486a-96d2-c479239b5042 req-da2cf4a7-0858-4221-9313-4ef15e32de66 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received unexpected event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 for instance with vm_state active and task_state rescuing.
Nov 29 20:30:45 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:30:45 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:30:45 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Instance spawned successfully.
Nov 29 20:30:45 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:30:45 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:30:45 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:30:46 user nova-compute[75356]: INFO nova.compute.manager [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Took 5.62 seconds to spawn the instance on the hypervisor.
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2d3c24e4b16198ce6fa6670c8c7c07cd2d4c9c5.part --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.images [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] 46e589e8-76b9-4720-bc32-bc15fee6b1ea was qcow2, converting to raw {{(pid=75356) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.privsep.utils [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75356) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b2d3c24e4b16198ce6fa6670c8c7c07cd2d4c9c5.part /opt/stack/data/nova/instances/_base/b2d3c24e4b16198ce6fa6670c8c7c07cd2d4c9c5.converted {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:46 user nova-compute[75356]: INFO nova.compute.manager [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Took 20.83 seconds to build instance.
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5d02e2c4-9a56-4835-a014-11b5ac8a7d09 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "2f1865c9-3202-4162-8949-0ab0f6bc55ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.951s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Starting finish_migration {{(pid=75356) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Instance directory exists: not creating {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 20:30:46 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Creating image(s)
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Did not create local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Ensure instance console log exists: /opt/stack/data/nova/instances/873a45a7-a06f-4bcd-b517-d6f0ade7e5a3/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Start _get_guest_xml network_info=[{"id": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "address": "fa:16:3e:ed:a6:4a", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2079172215-network", "vif_mac": "fa:16:3e:ed:a6:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c2f7e-7d", "ovs_interfaceid": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixFVyosu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '873a45a7-a06f-4bcd-b517-d6f0ade7e5a3', 'attached_at': '2023-11-29T20:30:46.000000', 'detached_at': '', 'volume_id': '33217dc4-b5a2-4843-87d8-ca6acb430f09', 'serial': '33217dc4-b5a2-4843-87d8-ca6acb430f09'}, 'attachment_id': '51f56913-7554-42b6-8e17-eb4a464448e9', 'volume_type': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:30:46 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:30:46 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixFVyosu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:30:46 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:30:46 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:30:46 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ddf8dd-767a-475f-879a-a127efcbcb9d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:30:46 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd7426b-03a3-4cdc-a74f-05f3a7b53b57]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09] added
Nov 29 20:30:46 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b2d3c24e4b16198ce6fa6670c8c7c07cd2d4c9c5.part /opt/stack/data/nova/instances/_base/b2d3c24e4b16198ce6fa6670c8c7c07cd2d4c9c5.converted" returned: 0 in 0.285s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2d3c24e4b16198ce6fa6670c8c7c07cd2d4c9c5.converted --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8123b12-75ff-4ecf-b4bc-058eb2ab7639]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da03b77-fdaa-4c86-983e-ce209980ee87]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ixFVyosu {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ixFVyosu" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e588f5-cf65-49c7-9031-acddb2826df4]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ixFVyosu'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a194a7-14ee-496b-b2ac-87d64aab98f4]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b70035b-9377-410f-bcfa-2bca79256092]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:30:46 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:30:46 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:30:46 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:30:46 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:30:46 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:30:46 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:30:46 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:30:46 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:30:46 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:30:46 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:30:46 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:30:46 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2d3c24e4b16198ce6fa6670c8c7c07cd2d4c9c5.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "b2d3c24e4b16198ce6fa6670c8c7c07cd2d4c9c5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.936s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "b2d3c24e4b16198ce6fa6670c8c7c07cd2d4c9c5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "b2d3c24e4b16198ce6fa6670c8c7c07cd2d4c9c5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2d3c24e4b16198ce6fa6670c8c7c07cd2d4c9c5 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bb2fdb-0a77-4dc9-8acf-52c86b90cac2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09, portal: 172.16.0.220,3260]
Nov 29 20:30:46 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09, portal: 172.16.0.220,3260] successful.
Nov 29 20:30:46 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[104221be-871f-433e-b866-cd08dae2bb6d]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[127044a2-5bfb-4b58-aaa0-0fd4dcebf221]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:30:46 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:30:46 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:30:46 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:30:46 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:30:46 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:30:46 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:30:46 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:30:46 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:30:46 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:30:46 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:30:46 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:30:46 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:30:46 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:30:46 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] HCTL ('39', '-', '-', 0) found on session 34 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3fe9e8-559e-4dd0-997a-5076e01b6b80]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Searching for a device in session 34 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixFVyosu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2d3c24e4b16198ce6fa6670c8c7c07cd2d4c9c5 --force-share --output=json" returned: 0 in 0.182s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b2d3c24e4b16198ce6fa6670c8c7c07cd2d4c9c5,backing_fmt=raw /opt/stack/data/nova/instances/c477f425-e9ce-4b3a-b21a-8bf04401ad0b/disk.rescue {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b2d3c24e4b16198ce6fa6670c8c7c07cd2d4c9c5,backing_fmt=raw /opt/stack/data/nova/instances/c477f425-e9ce-4b3a-b21a-8bf04401ad0b/disk.rescue" returned: 0 in 0.056s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "b2d3c24e4b16198ce6fa6670c8c7c07cd2d4c9c5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.objects.instance [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lazy-loading 'migration_context' on Instance uuid c477f425-e9ce-4b3a-b21a-8bf04401ad0b {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.objects.base [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Object Instance<c477f425-e9ce-4b3a-b21a-8bf04401ad0b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Start _get_guest_xml network_info=[{"id": "084eeeb2-bcff-437d-ac75-85936e641045", "address": "fa:16:3e:a1:86:c2", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "vif_mac": "fa:16:3e:a1:86:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084eeeb2-bc", "ovs_interfaceid": "084eeeb2-bcff-437d-ac75-85936e641045", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '46e589e8-76b9-4720-bc32-bc15fee6b1ea', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGgkRYyn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'c477f425-e9ce-4b3a-b21a-8bf04401ad0b', 'attached_at': '', 'detached_at': '', 'volume_id': '18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8', 'serial': '18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8'}, 'attachment_id': '2b70ac89-f88b-4296-ae3a-d231cd258eb0', 'volume_type': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.objects.instance [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lazy-loading 'resources' on Instance uuid c477f425-e9ce-4b3a-b21a-8bf04401ad0b {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.objects.base [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Object Instance<c477f425-e9ce-4b3a-b21a-8bf04401ad0b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.objects.instance [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lazy-loading 'numa_topology' on Instance uuid c477f425-e9ce-4b3a-b21a-8bf04401ad0b {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.objects.base [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Object Instance<c477f425-e9ce-4b3a-b21a-8bf04401ad0b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:30:46 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:30:46 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.objects.instance [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lazy-loading 'vcpu_model' on Instance uuid c477f425-e9ce-4b3a-b21a-8bf04401ad0b {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.objects.base [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Object Instance<c477f425-e9ce-4b3a-b21a-8bf04401ad0b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGgkRYyn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:30:46 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:30:46 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.435s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] <== connect_volume: return (1437ms) {'type': 'block', 'scsi_wwn': '26264626138366233', 'path': '/dev/sdh'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264626138366233', 'path': '/dev/sdh'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.751s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:30:47 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:30:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:30:47 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:30:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b875117-3e0e-468c-8843-3eb4960e9efe]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = eGgkRYyn\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 20:30:47 user nova-compute[75356]: node.name = iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8
Nov 29 20:30:47 user nova-compute[75356]: node.tpgt = -1
Nov 29 20:30:47 user nova-compute[75356]: node.startup = automatic
Nov 29 20:30:47 user nova-compute[75356]: node.leading_login = No
Nov 29 20:30:47 user nova-compute[75356]: iface.iscsi_ifacename = default
Nov 29 20:30:47 user nova-compute[75356]: iface.net_ifacename = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.ipaddress = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.prefix_len = 0
Nov 29 20:30:47 user nova-compute[75356]: iface.hwaddress = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.transport_name = tcp
Nov 29 20:30:47 user nova-compute[75356]: iface.initiatorname = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.state = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.vlan_id = 0
Nov 29 20:30:47 user nova-compute[75356]: iface.vlan_priority = 0
Nov 29 20:30:47 user nova-compute[75356]: iface.vlan_state = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.iface_num = 0
Nov 29 20:30:47 user nova-compute[75356]: iface.mtu = 0
Nov 29 20:30:47 user nova-compute[75356]: iface.port = 0
Nov 29 20:30:47 user nova-compute[75356]: iface.bootproto = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.subnet_mask = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.gateway = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.dhcp_alt_client_id = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.dhcp_dns = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.dhcp_learn_iqn = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.dhcp_vendor_id_state = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.dhcp_vendor_id = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.dhcp_slp_da = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.fragmentation = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.gratuitous_arp = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.incoming_forwarding = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.tos_state = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.tos = 0
Nov 29 20:30:47 user nova-compute[75356]: iface.ttl = 0
Nov 29 20:30:47 user nova-compute[75356]: iface.delayed_ack = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.tcp_nagle = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.tcp_wsf_state = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.tcp_wsf = 0
Nov 29 20:30:47 user nova-compute[75356]: iface.tcp_timer_scale = 0
Nov 29 20:30:47 user nova-compute[75356]: iface.tcp_timestamp = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.redirect = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.def_task_mgmt_timeout = 0
Nov 29 20:30:47 user nova-compute[75356]: iface.header_digest = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.data_digest = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.immediate_data = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.initial_r2t = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.data_seq_inorder = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.data_pdu_inorder = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.erl = 0
Nov 29 20:30:47 user nova-compute[75356]: iface.max_receive_data_len = 0
Nov 29 20:30:47 user nova-compute[75356]: iface.first_burst_len = 0
Nov 29 20:30:47 user nova-compute[75356]: iface.max_outstanding_r2t = 0
Nov 29 20:30:47 user nova-compute[75356]: iface.max_burst_len = 0
Nov 29 20:30:47 user nova-compute[75356]: iface.chap_auth = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.bidi_chap = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.strict_login_compliance = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.discovery_auth = <empty>
Nov 29 20:30:47 user nova-compute[75356]: iface.discovery_logout = <empty>
Nov 29 20:30:47 user nova-compute[75356]: node.discovery_address = <empty>
Nov 29 20:30:47 user nova-compute[75356]: node.discovery_port = 0
Nov 29 20:30:47 user nova-compute[75356]: node.discovery_type = static
Nov 29 20:30:47 user nova-compute[75356]: node.session.initial_cmdsn = 0
Nov 29 20:30:47 user nova-compute[75356]: node.session.initial_login_retry_max = 8
Nov 29 20:30:47 user nova-compute[75356]: node.session.xmit_thread_priority = -20
Nov 29 20:30:47 user nova-compute[75356]: node.session.cmds_max = 128
Nov 29 20:30:47 user nova-compute[75356]: node.session.queue_depth = 32
Nov 29 20:30:47 user nova-compute[75356]: node.session.nr_sessions = 1
Nov 29 20:30:47 user nova-compute[75356]: node.session.auth.authmethod = CHAP
Nov 29 20:30:47 user nova-compute[75356]: node.session.auth.username = eGgkRYyn
Nov 29 20:30:47 user nova-compute[75356]: node.session.auth.password = ***
Nov 29 20:30:47 user nova-compute[75356]: node.session.auth.username_in = <empty>
Nov 29 20:30:47 user nova-compute[75356]: node.session.auth.password_in = <empty>
Nov 29 20:30:47 user nova-compute[75356]: node.session.auth.chap_algs = MD5
Nov 29 20:30:47 user nova-compute[75356]: node.session.timeo.replacement_timeout = 120
Nov 29 20:30:47 user nova-compute[75356]: node.session.err_timeo.abort_timeout = 15
Nov 29 20:30:47 user nova-compute[75356]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 20:30:47 user nova-compute[75356]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 20:30:47 user nova-compute[75356]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 20:30:47 user nova-compute[75356]: node.session.iscsi.FastAbort = Yes
Nov 29 20:30:47 user nova-compute[75356]: node.session.iscsi.InitialR2T = No
Nov 29 20:30:47 user nova-compute[75356]: node.session.iscsi.ImmediateData = Yes
Nov 29 20:30:47 user nova-compute[75356]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 20:30:47 user nova-compute[75356]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 20:30:47 user nova-compute[75356]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 20:30:47 user nova-compute[75356]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 20:30:47 user nova-compute[75356]: node.session.iscsi.MaxConnections = 1
Nov 29 20:30:47 user nova-compute[75356]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 20:30:47 user nova-compute[75356]: node.session.iscsi.ERL = 0
Nov 29 20:30:47 user nova-compute[75356]: node.session.scan = manual
Nov 29 20:30:47 user nova-compute[75356]: node.session.reopen_max = 0
Nov 29 20:30:47 user nova-compute[75356]: node.conn[0].address = 172.16.0.220
Nov 29 20:30:47 user nova-compute[75356]: node.conn[0].port = 3260
Nov 29 20:30:47 user nova-compute[75356]: node.conn[0].startup = manual
Nov 29 20:30:47 user nova-compute[75356]: node.conn[0].tcp.window_size = 524288
Nov 29 20:30:47 user nova-compute[75356]: node.conn[0].tcp.type_of_service = 0
Nov 29 20:30:47 user nova-compute[75356]: node.conn[0].timeo.logout_timeout = 15
Nov 29 20:30:47 user nova-compute[75356]: node.conn[0].timeo.login_timeout = 15
Nov 29 20:30:47 user nova-compute[75356]: node.conn[0].timeo.auth_timeout = 45
Nov 29 20:30:47 user nova-compute[75356]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 20:30:47 user nova-compute[75356]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 20:30:47 user nova-compute[75356]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 20:30:47 user nova-compute[75356]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 20:30:47 user nova-compute[75356]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 20:30:47 user nova-compute[75356]: node.conn[0].iscsi.DataDigest = None
Nov 29 20:30:47 user nova-compute[75356]: node.conn[0].iscsi.IFMarker = No
Nov 29 20:30:47 user nova-compute[75356]: node.conn[0].iscsi.OFMarker = No
Nov 29 20:30:47 user nova-compute[75356]: # END RECORD
Nov 29 20:30:47 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:28:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2053095889',display_name='tempest-ServerActionsTestOtherA-server-2053095889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2053095889',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBES/hmUhRPMEp7jxGNAJkTADe+ykaGX7onK5o5CXk4BGHWdyPerc54MOJxjy4wx3hHylMSlWH2Wjk+mHShNqdbk6ZSJg34jMi+lLZfOCW4j+M+c+q1Lzq5VJUbAeMltLBQ==',key_name='tempest-keypair-777625238',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:29:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8b14efb1a4d34a3db7a51bd79234b86b',ramdisk_id='',reservation_id='r-nplu3go6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1000495362',owner_user_name='tempest-ServerActionsTestOtherA-1000495362-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:30:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc7cfc71d0c448cbbe8d42f8b617d8b',uuid=873a45a7-a06f-4bcd-b517-d6f0ade7e5a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "address": "fa:16:3e:ed:a6:4a", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2079172215-network", "vif_mac": "fa:16:3e:ed:a6:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c2f7e-7d", "ovs_interfaceid": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converting VIF {"id": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "address": "fa:16:3e:ed:a6:4a", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2079172215-network", "vif_mac": "fa:16:3e:ed:a6:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c2f7e-7d", "ovs_interfaceid": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:4a,bridge_name='br-int',has_traffic_filtering=True,id=803c2f7e-7d7c-46aa-b1a8-63165a13b9a1,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803c2f7e-7d') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:30:47 user nova-compute[75356]:   <uuid>873a45a7-a06f-4bcd-b517-d6f0ade7e5a3</uuid>
Nov 29 20:30:47 user nova-compute[75356]:   <name>instance-0000001e</name>
Nov 29 20:30:47 user nova-compute[75356]:   <memory>2097152</memory>
Nov 29 20:30:47 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:30:47 user nova-compute[75356]:   <metadata>
Nov 29 20:30:47 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:30:47 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:30:47 user nova-compute[75356]:       <nova:name>tempest-ServerActionsTestOtherA-server-2053095889</nova:name>
Nov 29 20:30:47 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:30:46</nova:creationTime>
Nov 29 20:30:47 user nova-compute[75356]:       <nova:flavor name="m1.small">
Nov 29 20:30:47 user nova-compute[75356]:         <nova:memory>2048</nova:memory>
Nov 29 20:30:47 user nova-compute[75356]:         <nova:disk>20</nova:disk>
Nov 29 20:30:47 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:30:47 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:30:47 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:30:47 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:30:47 user nova-compute[75356]:       <nova:owner>
Nov 29 20:30:47 user nova-compute[75356]:         <nova:user uuid="abc7cfc71d0c448cbbe8d42f8b617d8b">tempest-ServerActionsTestOtherA-1000495362-project-member</nova:user>
Nov 29 20:30:47 user nova-compute[75356]:         <nova:project uuid="8b14efb1a4d34a3db7a51bd79234b86b">tempest-ServerActionsTestOtherA-1000495362</nova:project>
Nov 29 20:30:47 user nova-compute[75356]:       </nova:owner>
Nov 29 20:30:47 user nova-compute[75356]:       <nova:ports>
Nov 29 20:30:47 user nova-compute[75356]:         <nova:port uuid="803c2f7e-7d7c-46aa-b1a8-63165a13b9a1">
Nov 29 20:30:47 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 20:30:47 user nova-compute[75356]:         </nova:port>
Nov 29 20:30:47 user nova-compute[75356]:       </nova:ports>
Nov 29 20:30:47 user nova-compute[75356]:     </nova:instance>
Nov 29 20:30:47 user nova-compute[75356]:   </metadata>
Nov 29 20:30:47 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:30:47 user nova-compute[75356]:     <system>
Nov 29 20:30:47 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:30:47 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:30:47 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:30:47 user nova-compute[75356]:       <entry name="serial">873a45a7-a06f-4bcd-b517-d6f0ade7e5a3</entry>
Nov 29 20:30:47 user nova-compute[75356]:       <entry name="uuid">873a45a7-a06f-4bcd-b517-d6f0ade7e5a3</entry>
Nov 29 20:30:47 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:30:47 user nova-compute[75356]:     </system>
Nov 29 20:30:47 user nova-compute[75356]:   </sysinfo>
Nov 29 20:30:47 user nova-compute[75356]:   <os>
Nov 29 20:30:47 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:30:47 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:30:47 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:30:47 user nova-compute[75356]:   </os>
Nov 29 20:30:47 user nova-compute[75356]:   <features>
Nov 29 20:30:47 user nova-compute[75356]:     <acpi/>
Nov 29 20:30:47 user nova-compute[75356]:     <apic/>
Nov 29 20:30:47 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:30:47 user nova-compute[75356]:   </features>
Nov 29 20:30:47 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:30:47 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:30:47 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:30:47 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:30:47 user nova-compute[75356]:   </clock>
Nov 29 20:30:47 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:30:47 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:30:47 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:30:47 user nova-compute[75356]:   </cpu>
Nov 29 20:30:47 user nova-compute[75356]:   <devices>
Nov 29 20:30:47 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:30:47 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:30:47 user nova-compute[75356]:       <source dev="/dev/sdh"/>
Nov 29 20:30:47 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:30:47 user nova-compute[75356]:       <serial>33217dc4-b5a2-4843-87d8-ca6acb430f09</serial>
Nov 29 20:30:47 user nova-compute[75356]:     </disk>
Nov 29 20:30:47 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:30:47 user nova-compute[75356]:       <mac address="fa:16:3e:ed:a6:4a"/>
Nov 29 20:30:47 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:30:47 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:30:47 user nova-compute[75356]:       <target dev="tap803c2f7e-7d"/>
Nov 29 20:30:47 user nova-compute[75356]:     </interface>
Nov 29 20:30:47 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:30:47 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/873a45a7-a06f-4bcd-b517-d6f0ade7e5a3/console.log" append="off"/>
Nov 29 20:30:47 user nova-compute[75356]:     </serial>
Nov 29 20:30:47 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:30:47 user nova-compute[75356]:     <video>
Nov 29 20:30:47 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:30:47 user nova-compute[75356]:     </video>
Nov 29 20:30:47 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:30:47 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:30:47 user nova-compute[75356]:     </rng>
Nov 29 20:30:47 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:30:47 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:30:47 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:30:47 user nova-compute[75356]:     </memballoon>
Nov 29 20:30:47 user nova-compute[75356]:   </devices>
Nov 29 20:30:47 user nova-compute[75356]: </domain>
Nov 29 20:30:47 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:28:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2053095889',display_name='tempest-ServerActionsTestOtherA-server-2053095889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2053095889',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBES/hmUhRPMEp7jxGNAJkTADe+ykaGX7onK5o5CXk4BGHWdyPerc54MOJxjy4wx3hHylMSlWH2Wjk+mHShNqdbk6ZSJg34jMi+lLZfOCW4j+M+c+q1Lzq5VJUbAeMltLBQ==',key_name='tempest-keypair-777625238',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:29:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8b14efb1a4d34a3db7a51bd79234b86b',ramdisk_id='',reservation_id='r-nplu3go6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1000495362',owner_user_name='tempest-ServerActionsTestOtherA-1000495362-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:30:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc7cfc71d0c448cbbe8d42f8b617d8b',uuid=873a45a7-a06f-4bcd-b517-d6f0ade7e5a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "address": "fa:16:3e:ed:a6:4a", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2079172215-network", "vif_mac": "fa:16:3e:ed:a6:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c2f7e-7d", "ovs_interfaceid": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converting VIF {"id": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "address": "fa:16:3e:ed:a6:4a", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2079172215-network", "vif_mac": "fa:16:3e:ed:a6:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c2f7e-7d", "ovs_interfaceid": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:4a,bridge_name='br-int',has_traffic_filtering=True,id=803c2f7e-7d7c-46aa-b1a8-63165a13b9a1,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803c2f7e-7d') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG os_vif [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:4a,bridge_name='br-int',has_traffic_filtering=True,id=803c2f7e-7d7c-46aa-b1a8-63165a13b9a1,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803c2f7e-7d') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d1e08d-ff23-4944-8aeb-34cb5e8d5c3d]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7966181a-1e7f-5dbb-a2a4-82bbe38f1404', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap803c2f7e-7d, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap803c2f7e-7d, col_values=(('qos', UUID('1f6f5f08-1499-4ed6-9151-89a94019bcdc')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap803c2f7e-7d, col_values=(('external_ids', {'iface-id': '803c2f7e-7d7c-46aa-b1a8-63165a13b9a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:a6:4a', 'vm-uuid': '873a45a7-a06f-4bcd-b517-d6f0ade7e5a3'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2890cc81-1b2c-4d63-a3bf-05124ece44b7]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eGgkRYyn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:47 user nova-compute[75356]: INFO os_vif [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:a6:4a,bridge_name='br-int',has_traffic_filtering=True,id=803c2f7e-7d7c-46aa-b1a8-63165a13b9a1,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803c2f7e-7d')
Nov 29 20:30:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eGgkRYyn" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b597314-56ec-4508-b088-4be4f6a02727]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eGgkRYyn'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00c2139-6d19-4be8-8054-4868952611a6]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae52dac2-567d-46c9-9cf8-c84435e89520]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:30:47 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:30:47 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:30:47 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:30:47 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:30:47 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:30:47 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:30:47 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:30:47 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:30:47 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:30:47 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:30:47 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:30:47 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:30:47 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:30:47 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.173s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] HCTL ('37', '0', '0', 0) found on session 31 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] No VIF found with MAC fa:16:3e:ed:a6:4a, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b65562-8e82-46fd-a9ab-48a926dd8a2d]: (4, ('0 0 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Searching for a device in session 31 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGgkRYyn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.196s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] <== connect_volume: return (947ms) {'type': 'block', 'scsi_wwn': '26362343662386439', 'path': '/dev/sdf'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362343662386439', 'path': '/dev/sdf'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:28:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1570981937',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1570981937',id=31,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:29:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bed33acdfd5f48b9967d1dd68c261d78',ramdisk_id='',reservation_id='r-oglasv8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2041863686',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:29:22Z,user_data=None,user_id='e395b4248b794d65915edf2d23bbbeaf',uuid=c477f425-e9ce-4b3a-b21a-8bf04401ad0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "084eeeb2-bcff-437d-ac75-85936e641045", "address": "fa:16:3e:a1:86:c2", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "vif_mac": "fa:16:3e:a1:86:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084eeeb2-bc", "ovs_interfaceid": "084eeeb2-bcff-437d-ac75-85936e641045", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Converting VIF {"id": "084eeeb2-bcff-437d-ac75-85936e641045", "address": "fa:16:3e:a1:86:c2", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "vif_mac": "fa:16:3e:a1:86:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084eeeb2-bc", "ovs_interfaceid": "084eeeb2-bcff-437d-ac75-85936e641045", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:86:c2,bridge_name='br-int',has_traffic_filtering=True,id=084eeeb2-bcff-437d-ac75-85936e641045,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084eeeb2-bc') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG nova.objects.instance [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lazy-loading 'pci_devices' on Instance uuid c477f425-e9ce-4b3a-b21a-8bf04401ad0b {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG nova.objects.base [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Object Instance<c477f425-e9ce-4b3a-b21a-8bf04401ad0b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:30:47 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:30:47 user nova-compute[75356]:   <uuid>c477f425-e9ce-4b3a-b21a-8bf04401ad0b</uuid>
Nov 29 20:30:47 user nova-compute[75356]:   <name>instance-0000001f</name>
Nov 29 20:30:47 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:30:47 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:30:47 user nova-compute[75356]:   <metadata>
Nov 29 20:30:47 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:30:47 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:30:47 user nova-compute[75356]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1570981937</nova:name>
Nov 29 20:30:47 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:30:46</nova:creationTime>
Nov 29 20:30:47 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:30:47 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:30:47 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:30:47 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:30:47 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:30:47 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:30:47 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:30:47 user nova-compute[75356]:       <nova:owner>
Nov 29 20:30:47 user nova-compute[75356]:         <nova:user uuid="e395b4248b794d65915edf2d23bbbeaf">tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member</nova:user>
Nov 29 20:30:47 user nova-compute[75356]:         <nova:project uuid="bed33acdfd5f48b9967d1dd68c261d78">tempest-ServerBootFromVolumeStableRescueTest-2041863686</nova:project>
Nov 29 20:30:47 user nova-compute[75356]:       </nova:owner>
Nov 29 20:30:47 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:30:47 user nova-compute[75356]:       <nova:ports>
Nov 29 20:30:47 user nova-compute[75356]:         <nova:port uuid="084eeeb2-bcff-437d-ac75-85936e641045">
Nov 29 20:30:47 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 20:30:47 user nova-compute[75356]:         </nova:port>
Nov 29 20:30:47 user nova-compute[75356]:       </nova:ports>
Nov 29 20:30:47 user nova-compute[75356]:     </nova:instance>
Nov 29 20:30:47 user nova-compute[75356]:   </metadata>
Nov 29 20:30:47 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:30:47 user nova-compute[75356]:     <system>
Nov 29 20:30:47 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:30:47 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:30:47 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:30:47 user nova-compute[75356]:       <entry name="serial">c477f425-e9ce-4b3a-b21a-8bf04401ad0b</entry>
Nov 29 20:30:47 user nova-compute[75356]:       <entry name="uuid">c477f425-e9ce-4b3a-b21a-8bf04401ad0b</entry>
Nov 29 20:30:47 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:30:47 user nova-compute[75356]:     </system>
Nov 29 20:30:47 user nova-compute[75356]:   </sysinfo>
Nov 29 20:30:47 user nova-compute[75356]:   <os>
Nov 29 20:30:47 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:30:47 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:30:47 user nova-compute[75356]:   </os>
Nov 29 20:30:47 user nova-compute[75356]:   <features>
Nov 29 20:30:47 user nova-compute[75356]:     <acpi/>
Nov 29 20:30:47 user nova-compute[75356]:     <apic/>
Nov 29 20:30:47 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:30:47 user nova-compute[75356]:   </features>
Nov 29 20:30:47 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:30:47 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:30:47 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:30:47 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:30:47 user nova-compute[75356]:   </clock>
Nov 29 20:30:47 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:30:47 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:30:47 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:30:47 user nova-compute[75356]:   </cpu>
Nov 29 20:30:47 user nova-compute[75356]:   <devices>
Nov 29 20:30:47 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:30:47 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:30:47 user nova-compute[75356]:       <source dev="/dev/sdf"/>
Nov 29 20:30:47 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:30:47 user nova-compute[75356]:       <serial>18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8</serial>
Nov 29 20:30:47 user nova-compute[75356]:     </disk>
Nov 29 20:30:47 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:30:47 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:30:47 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/c477f425-e9ce-4b3a-b21a-8bf04401ad0b/disk.rescue"/>
Nov 29 20:30:47 user nova-compute[75356]:       <target dev="vdb" bus="virtio"/>
Nov 29 20:30:47 user nova-compute[75356]:       <boot order="1"/>
Nov 29 20:30:47 user nova-compute[75356]:     </disk>
Nov 29 20:30:47 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:30:47 user nova-compute[75356]:       <mac address="fa:16:3e:a1:86:c2"/>
Nov 29 20:30:47 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:30:47 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:30:47 user nova-compute[75356]:       <target dev="tap084eeeb2-bc"/>
Nov 29 20:30:47 user nova-compute[75356]:     </interface>
Nov 29 20:30:47 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:30:47 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/c477f425-e9ce-4b3a-b21a-8bf04401ad0b/console.log" append="off"/>
Nov 29 20:30:47 user nova-compute[75356]:     </serial>
Nov 29 20:30:47 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:30:47 user nova-compute[75356]:     <video>
Nov 29 20:30:47 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:30:47 user nova-compute[75356]:     </video>
Nov 29 20:30:47 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:30:47 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:30:47 user nova-compute[75356]:     </rng>
Nov 29 20:30:47 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:30:47 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:30:47 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:30:47 user nova-compute[75356]:     </memballoon>
Nov 29 20:30:47 user nova-compute[75356]:   </devices>
Nov 29 20:30:47 user nova-compute[75356]: </domain>
Nov 29 20:30:47 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:30:48 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Instance destroyed successfully.
Nov 29 20:30:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:30:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:30:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] No VIF found with MAC fa:16:3e:a1:86:c2, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:30:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:50 user nova-compute[75356]: DEBUG nova.compute.manager [req-77b7e9d0-51ad-415d-94c1-dcddc099eef4 req-5cdc24cf-c51d-4722-9985-f80dab0531ac service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Received event network-vif-plugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:30:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-77b7e9d0-51ad-415d-94c1-dcddc099eef4 req-5cdc24cf-c51d-4722-9985-f80dab0531ac service nova] Acquiring lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-77b7e9d0-51ad-415d-94c1-dcddc099eef4 req-5cdc24cf-c51d-4722-9985-f80dab0531ac service nova] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-77b7e9d0-51ad-415d-94c1-dcddc099eef4 req-5cdc24cf-c51d-4722-9985-f80dab0531ac service nova] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:50 user nova-compute[75356]: DEBUG nova.compute.manager [req-77b7e9d0-51ad-415d-94c1-dcddc099eef4 req-5cdc24cf-c51d-4722-9985-f80dab0531ac service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] No waiting events found dispatching network-vif-plugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:30:50 user nova-compute[75356]: WARNING nova.compute.manager [req-77b7e9d0-51ad-415d-94c1-dcddc099eef4 req-5cdc24cf-c51d-4722-9985-f80dab0531ac service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Received unexpected event network-vif-plugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 for instance with vm_state active and task_state resize_finish.
Nov 29 20:30:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "1e818d19-e8e8-4e41-83b4-53888ea21c93" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:51 user nova-compute[75356]: DEBUG nova.objects.instance [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lazy-loading 'flavor' on Instance uuid 1e818d19-e8e8-4e41-83b4-53888ea21c93 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:30:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "1e818d19-e8e8-4e41-83b4-53888ea21c93" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:51 user nova-compute[75356]: INFO nova.compute.manager [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Attaching volume f7ed84ba-8a90-4031-9616-71473dec6955 to /dev/vdb
Nov 29 20:30:51 user nova-compute[75356]: DEBUG os_brick.utils [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:30:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8ab487-b75b-41a3-8ec5-7db10e795854]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[786c71a3-8ff9-477e-97eb-8ca41a868bd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c25a456-371e-4a88-acd9-9f1c14f6c899]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fee57f-98f6-4623-9947-da2a4330ff6a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:30:52 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:30:52 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d5ef33-ce41-4a79-9f5b-89e3cfc6653c]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG os_brick.utils [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Updating existing volume attachment record: 4a91ce0a-f843-4a22-b0c3-761ed58b89d3 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG nova.compute.manager [req-ca8de38c-5adc-4a93-97d1-81b232fb1798 req-2ffb2c4c-2416-4439-94c3-8680a9363bce service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Received event network-vif-plugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ca8de38c-5adc-4a93-97d1-81b232fb1798 req-2ffb2c4c-2416-4439-94c3-8680a9363bce service nova] Acquiring lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ca8de38c-5adc-4a93-97d1-81b232fb1798 req-2ffb2c4c-2416-4439-94c3-8680a9363bce service nova] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ca8de38c-5adc-4a93-97d1-81b232fb1798 req-2ffb2c4c-2416-4439-94c3-8680a9363bce service nova] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG nova.compute.manager [req-ca8de38c-5adc-4a93-97d1-81b232fb1798 req-2ffb2c4c-2416-4439-94c3-8680a9363bce service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] No waiting events found dispatching network-vif-plugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:30:52 user nova-compute[75356]: WARNING nova.compute.manager [req-ca8de38c-5adc-4a93-97d1-81b232fb1798 req-2ffb2c4c-2416-4439-94c3-8680a9363bce service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Received unexpected event network-vif-plugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 for instance with vm_state active and task_state resize_finish.
Nov 29 20:30:52 user nova-compute[75356]: DEBUG nova.compute.manager [req-ca8de38c-5adc-4a93-97d1-81b232fb1798 req-2ffb2c4c-2416-4439-94c3-8680a9363bce service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ca8de38c-5adc-4a93-97d1-81b232fb1798 req-2ffb2c4c-2416-4439-94c3-8680a9363bce service nova] Acquiring lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ca8de38c-5adc-4a93-97d1-81b232fb1798 req-2ffb2c4c-2416-4439-94c3-8680a9363bce service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ca8de38c-5adc-4a93-97d1-81b232fb1798 req-2ffb2c4c-2416-4439-94c3-8680a9363bce service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG nova.compute.manager [req-ca8de38c-5adc-4a93-97d1-81b232fb1798 req-2ffb2c4c-2416-4439-94c3-8680a9363bce service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] No waiting events found dispatching network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:30:52 user nova-compute[75356]: WARNING nova.compute.manager [req-ca8de38c-5adc-4a93-97d1-81b232fb1798 req-2ffb2c4c-2416-4439-94c3-8680a9363bce service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received unexpected event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 for instance with vm_state active and task_state rescuing.
Nov 29 20:30:52 user nova-compute[75356]: DEBUG nova.compute.manager [req-ca8de38c-5adc-4a93-97d1-81b232fb1798 req-2ffb2c4c-2416-4439-94c3-8680a9363bce service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ca8de38c-5adc-4a93-97d1-81b232fb1798 req-2ffb2c4c-2416-4439-94c3-8680a9363bce service nova] Acquiring lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ca8de38c-5adc-4a93-97d1-81b232fb1798 req-2ffb2c4c-2416-4439-94c3-8680a9363bce service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ca8de38c-5adc-4a93-97d1-81b232fb1798 req-2ffb2c4c-2416-4439-94c3-8680a9363bce service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:30:52 user nova-compute[75356]: DEBUG nova.compute.manager [req-ca8de38c-5adc-4a93-97d1-81b232fb1798 req-2ffb2c4c-2416-4439-94c3-8680a9363bce service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] No waiting events found dispatching network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:30:52 user nova-compute[75356]: WARNING nova.compute.manager [req-ca8de38c-5adc-4a93-97d1-81b232fb1798 req-2ffb2c4c-2416-4439-94c3-8680a9363bce service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received unexpected event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 for instance with vm_state active and task_state rescuing.
Nov 29 20:30:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:30:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:30:53 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Instance running successfully.
Nov 29 20:30:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Failed to set time: agent not configured {{(pid=75356) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 29 20:30:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8f4c510c-5400-4d65-bf6d-6db77422e6a1 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] finish_migration finished successfully. {{(pid=75356) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 29 20:30:53 user nova-compute[75356]: DEBUG nova.compute.manager [None req-23f1c590-a4e4-49f9-90ed-5d11d83ab7ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:30:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:30:58 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:30:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-def30a09-9f07-49c5-b759-57f86b826863 req-0a99eaa9-f244-448b-9af1-02bab6a44652 service nova] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Received event network-changed-e1105bed-a3a6-49a8-87a7-775c72fa6bdf {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:30:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-def30a09-9f07-49c5-b759-57f86b826863 req-0a99eaa9-f244-448b-9af1-02bab6a44652 service nova] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Refreshing instance network info cache due to event network-changed-e1105bed-a3a6-49a8-87a7-775c72fa6bdf. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:30:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-def30a09-9f07-49c5-b759-57f86b826863 req-0a99eaa9-f244-448b-9af1-02bab6a44652 service nova] Acquiring lock "refresh_cache-4b4df05b-79b4-401b-8fb2-4d3de35c5509" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:30:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-def30a09-9f07-49c5-b759-57f86b826863 req-0a99eaa9-f244-448b-9af1-02bab6a44652 service nova] Acquired lock "refresh_cache-4b4df05b-79b4-401b-8fb2-4d3de35c5509" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:30:59 user nova-compute[75356]: DEBUG nova.network.neutron [req-def30a09-9f07-49c5-b759-57f86b826863 req-0a99eaa9-f244-448b-9af1-02bab6a44652 service nova] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Refreshing network info cache for port e1105bed-a3a6-49a8-87a7-775c72fa6bdf {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "4b4df05b-79b4-401b-8fb2-4d3de35c5509" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "4b4df05b-79b4-401b-8fb2-4d3de35c5509" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "4b4df05b-79b4-401b-8fb2-4d3de35c5509-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "4b4df05b-79b4-401b-8fb2-4d3de35c5509-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "4b4df05b-79b4-401b-8fb2-4d3de35c5509-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:00 user nova-compute[75356]: INFO nova.compute.manager [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Terminating instance
Nov 29 20:31:00 user nova-compute[75356]: DEBUG nova.network.neutron [req-def30a09-9f07-49c5-b759-57f86b826863 req-0a99eaa9-f244-448b-9af1-02bab6a44652 service nova] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Updated VIF entry in instance network info cache for port e1105bed-a3a6-49a8-87a7-775c72fa6bdf. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG nova.network.neutron [req-def30a09-9f07-49c5-b759-57f86b826863 req-0a99eaa9-f244-448b-9af1-02bab6a44652 service nova] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Updating instance_info_cache with network_info: [{"id": "e1105bed-a3a6-49a8-87a7-775c72fa6bdf", "address": "fa:16:3e:cd:25:e4", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1105bed-a3", "ovs_interfaceid": "e1105bed-a3a6-49a8-87a7-775c72fa6bdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-def30a09-9f07-49c5-b759-57f86b826863 req-0a99eaa9-f244-448b-9af1-02bab6a44652 service nova] Releasing lock "refresh_cache-4b4df05b-79b4-401b-8fb2-4d3de35c5509" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Didn't find any instances for network info cache update. {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG nova.compute.manager [req-0aa44525-c8d1-458b-b8b9-3389ff3cfd0d req-2732fee9-e3fa-4460-8a6d-7ea561ba4bbf service nova] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Received event network-vif-unplugged-e1105bed-a3a6-49a8-87a7-775c72fa6bdf {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0aa44525-c8d1-458b-b8b9-3389ff3cfd0d req-2732fee9-e3fa-4460-8a6d-7ea561ba4bbf service nova] Acquiring lock "4b4df05b-79b4-401b-8fb2-4d3de35c5509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0aa44525-c8d1-458b-b8b9-3389ff3cfd0d req-2732fee9-e3fa-4460-8a6d-7ea561ba4bbf service nova] Lock "4b4df05b-79b4-401b-8fb2-4d3de35c5509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0aa44525-c8d1-458b-b8b9-3389ff3cfd0d req-2732fee9-e3fa-4460-8a6d-7ea561ba4bbf service nova] Lock "4b4df05b-79b4-401b-8fb2-4d3de35c5509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG nova.compute.manager [req-0aa44525-c8d1-458b-b8b9-3389ff3cfd0d req-2732fee9-e3fa-4460-8a6d-7ea561ba4bbf service nova] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] No waiting events found dispatching network-vif-unplugged-e1105bed-a3a6-49a8-87a7-775c72fa6bdf {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG nova.compute.manager [req-0aa44525-c8d1-458b-b8b9-3389ff3cfd0d req-2732fee9-e3fa-4460-8a6d-7ea561ba4bbf service nova] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Received event network-vif-unplugged-e1105bed-a3a6-49a8-87a7-775c72fa6bdf for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:31:00 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Instance destroyed successfully.
Nov 29 20:31:00 user nova-compute[75356]: DEBUG nova.objects.instance [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lazy-loading 'resources' on Instance uuid 4b4df05b-79b4-401b-8fb2-4d3de35c5509 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:29:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2067025810',display_name='tempest-AttachVolumeNegativeTest-server-2067025810',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2067025810',id=33,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZzdinCw4nR6UNsZVEwq+vfmgRlRHYEnK37PktlqZD6P3AIPJvuVWwzGk96AIX+Uf1n83Hq6qKxgsbK08auUVsHzU9xndC2auhEdqvA9IryOM13zoIe2PcdycYB1nJDAw==',key_name='tempest-keypair-1026617711',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:29:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='076539532d4847719e7fcf4165872bbe',ramdisk_id='',reservation_id='r-ufza06j2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1182074567',owner_user_name='tempest-AttachVolumeNegativeTest-1182074567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:29:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbdba4f436df4dbb896258c4f4d6b180',uuid=4b4df05b-79b4-401b-8fb2-4d3de35c5509,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1105bed-a3a6-49a8-87a7-775c72fa6bdf", "address": "fa:16:3e:cd:25:e4", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1105bed-a3", "ovs_interfaceid": "e1105bed-a3a6-49a8-87a7-775c72fa6bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converting VIF {"id": "e1105bed-a3a6-49a8-87a7-775c72fa6bdf", "address": "fa:16:3e:cd:25:e4", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1105bed-a3", "ovs_interfaceid": "e1105bed-a3a6-49a8-87a7-775c72fa6bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:25:e4,bridge_name='br-int',has_traffic_filtering=True,id=e1105bed-a3a6-49a8-87a7-775c72fa6bdf,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1105bed-a3') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG os_vif [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:25:e4,bridge_name='br-int',has_traffic_filtering=True,id=e1105bed-a3a6-49a8-87a7-775c72fa6bdf,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1105bed-a3') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1105bed-a3, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b765ff42-3ca5-460b-80e9-08a40365347b) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:00 user nova-compute[75356]: INFO os_vif [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:25:e4,bridge_name='br-int',has_traffic_filtering=True,id=e1105bed-a3a6-49a8-87a7-775c72fa6bdf,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1105bed-a3')
Nov 29 20:31:00 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Deleting instance files /opt/stack/data/nova/instances/4b4df05b-79b4-401b-8fb2-4d3de35c5509_del
Nov 29 20:31:00 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Deletion of /opt/stack/data/nova/instances/4b4df05b-79b4-401b-8fb2-4d3de35c5509_del complete
Nov 29 20:31:00 user nova-compute[75356]: INFO nova.compute.manager [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 29 20:31:00 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:31:00 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMaoDjXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:31:01 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:31:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:31:01 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:31:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:31:01 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0403dfa5-ec2b-4241-82d5-99a5c9362023]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:31:01 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[433d9a4c-f163-4b84-9302-f2a4f476f105]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955] added
Nov 29 20:31:01 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc85644-b0de-4081-8774-149d6170d4fc]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1478a9b-635b-40cf-9862-ab693dc44dae]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GMaoDjXT {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GMaoDjXT" returned: 0 in 0.035s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff7a47e-fb85-4e17-81db-8a35f9b100f4]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GMaoDjXT'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c52ecb8-9709-4f7a-9f5d-bd9b2326c5a2]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61b5c97-aa9d-4476-949d-bb917603e8a6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[986d0c2a-abe3-4b60-926c-a0a23a258d55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955, portal: 172.16.0.220,3260]
Nov 29 20:31:01 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955, portal: 172.16.0.220,3260] successful.
Nov 29 20:31:01 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e19f44-2019-4c72-a507-c90ce7517fb4]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c386ef-a7ea-4859-beac-b1f73e35a717]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:31:01 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] HCTL ('40', '-', '-', 0) found on session 35 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0af0ac8-103c-43e0-a099-bf416b1c1876]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Searching for a device in session 35 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMaoDjXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:31:01 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Took 0.85 seconds to deallocate network for instance.
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:02 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:31:02 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:31:02 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:31:02 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:31:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.500s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:02 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Deleted allocations for instance 4b4df05b-79b4-401b-8fb2-4d3de35c5509
Nov 29 20:31:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c8e5019d-3afc-4070-8248-3a0824031ba0 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "4b4df05b-79b4-401b-8fb2-4d3de35c5509" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.324s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:02 user nova-compute[75356]: INFO nova.compute.manager [None req-961532bf-2783-49b9-82c8-dacb4fd0834c tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Unrescuing
Nov 29 20:31:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-961532bf-2783-49b9-82c8-dacb4fd0834c tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "refresh_cache-4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:31:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-961532bf-2783-49b9-82c8-dacb4fd0834c tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquired lock "refresh_cache-4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:31:02 user nova-compute[75356]: DEBUG nova.network.neutron [None req-961532bf-2783-49b9-82c8-dacb4fd0834c tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:31:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-c1d213d8-dc64-4c50-8482-f5295d35c633 req-6f60d34f-1aa3-4205-994b-a778e6e3efdd service nova] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Received event network-vif-plugged-e1105bed-a3a6-49a8-87a7-775c72fa6bdf {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:31:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c1d213d8-dc64-4c50-8482-f5295d35c633 req-6f60d34f-1aa3-4205-994b-a778e6e3efdd service nova] Acquiring lock "4b4df05b-79b4-401b-8fb2-4d3de35c5509-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c1d213d8-dc64-4c50-8482-f5295d35c633 req-6f60d34f-1aa3-4205-994b-a778e6e3efdd service nova] Lock "4b4df05b-79b4-401b-8fb2-4d3de35c5509-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c1d213d8-dc64-4c50-8482-f5295d35c633 req-6f60d34f-1aa3-4205-994b-a778e6e3efdd service nova] Lock "4b4df05b-79b4-401b-8fb2-4d3de35c5509-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-c1d213d8-dc64-4c50-8482-f5295d35c633 req-6f60d34f-1aa3-4205-994b-a778e6e3efdd service nova] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] No waiting events found dispatching network-vif-plugged-e1105bed-a3a6-49a8-87a7-775c72fa6bdf {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:31:02 user nova-compute[75356]: WARNING nova.compute.manager [req-c1d213d8-dc64-4c50-8482-f5295d35c633 req-6f60d34f-1aa3-4205-994b-a778e6e3efdd service nova] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Received unexpected event network-vif-plugged-e1105bed-a3a6-49a8-87a7-775c72fa6bdf for instance with vm_state deleted and task_state None.
Nov 29 20:31:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-c1d213d8-dc64-4c50-8482-f5295d35c633 req-6f60d34f-1aa3-4205-994b-a778e6e3efdd service nova] [instance: 4b4df05b-79b4-401b-8fb2-4d3de35c5509] Received event network-vif-deleted-e1105bed-a3a6-49a8-87a7-775c72fa6bdf {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:31:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:31:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '23833663831343866', 'path': '/dev/sdi'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:31:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833663831343866', 'path': '/dev/sdi'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:31:02 user nova-compute[75356]: DEBUG nova.objects.instance [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lazy-loading 'flavor' on Instance uuid 1e818d19-e8e8-4e41-83b4-53888ea21c93 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:31:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:31:02 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:31:02 user nova-compute[75356]:   <source dev="/dev/sdi"/>
Nov 29 20:31:02 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:31:02 user nova-compute[75356]:   <serial>f7ed84ba-8a90-4031-9616-71473dec6955</serial>
Nov 29 20:31:02 user nova-compute[75356]: </disk>
Nov 29 20:31:02 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:31:03 user nova-compute[75356]: DEBUG nova.network.neutron [None req-961532bf-2783-49b9-82c8-dacb4fd0834c tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Updating instance_info_cache with network_info: [{"id": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "address": "fa:16:3e:91:30:da", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a14e591-f6", "ovs_interfaceid": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:31:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-961532bf-2783-49b9-82c8-dacb4fd0834c tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Releasing lock "refresh_cache-4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:31:03 user nova-compute[75356]: DEBUG nova.objects.instance [None req-961532bf-2783-49b9-82c8-dacb4fd0834c tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'flavor' on Instance uuid 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:31:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:31:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:31:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] No VIF found with MAC fa:16:3e:74:01:d5, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:31:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-01d85b29-76b8-4118-9727-21ba5a739fdb tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.383s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:03 user nova-compute[75356]: DEBUG nova.compute.manager [req-7a7a5ae0-2810-471c-bb86-ce70f2f6a424 req-93bad54c-f477-4740-a4ac-e7abebde5296 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received event network-vif-unplugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:31:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7a7a5ae0-2810-471c-bb86-ce70f2f6a424 req-93bad54c-f477-4740-a4ac-e7abebde5296 service nova] Acquiring lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7a7a5ae0-2810-471c-bb86-ce70f2f6a424 req-93bad54c-f477-4740-a4ac-e7abebde5296 service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7a7a5ae0-2810-471c-bb86-ce70f2f6a424 req-93bad54c-f477-4740-a4ac-e7abebde5296 service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:03 user nova-compute[75356]: DEBUG nova.compute.manager [req-7a7a5ae0-2810-471c-bb86-ce70f2f6a424 req-93bad54c-f477-4740-a4ac-e7abebde5296 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] No waiting events found dispatching network-vif-unplugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:31:03 user nova-compute[75356]: WARNING nova.compute.manager [req-7a7a5ae0-2810-471c-bb86-ce70f2f6a424 req-93bad54c-f477-4740-a4ac-e7abebde5296 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received unexpected event network-vif-unplugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 for instance with vm_state rescued and task_state unrescuing.
Nov 29 20:31:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:03 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Instance destroyed successfully.
Nov 29 20:31:05 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:31:05 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:31:05 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:31:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:05 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:31:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:05 user nova-compute[75356]: DEBUG nova.compute.manager [req-19ec772c-4221-4955-9c9e-3bc144358fda req-f78ec942-289b-4c2f-bf92-98a2a31cedff service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received event network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:31:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-19ec772c-4221-4955-9c9e-3bc144358fda req-f78ec942-289b-4c2f-bf92-98a2a31cedff service nova] Acquiring lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-19ec772c-4221-4955-9c9e-3bc144358fda req-f78ec942-289b-4c2f-bf92-98a2a31cedff service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-19ec772c-4221-4955-9c9e-3bc144358fda req-f78ec942-289b-4c2f-bf92-98a2a31cedff service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:05 user nova-compute[75356]: DEBUG nova.compute.manager [req-19ec772c-4221-4955-9c9e-3bc144358fda req-f78ec942-289b-4c2f-bf92-98a2a31cedff service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] No waiting events found dispatching network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:31:05 user nova-compute[75356]: WARNING nova.compute.manager [req-19ec772c-4221-4955-9c9e-3bc144358fda req-f78ec942-289b-4c2f-bf92-98a2a31cedff service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received unexpected event network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 for instance with vm_state rescued and task_state unrescuing.
Nov 29 20:31:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:06 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:31:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:31:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-2845918c-1906-46eb-8ea2-61d4e5434091 req-e82b0046-e6ef-467e-a5f0-b9ea951ec3a1 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received event network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:31:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2845918c-1906-46eb-8ea2-61d4e5434091 req-e82b0046-e6ef-467e-a5f0-b9ea951ec3a1 service nova] Acquiring lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2845918c-1906-46eb-8ea2-61d4e5434091 req-e82b0046-e6ef-467e-a5f0-b9ea951ec3a1 service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2845918c-1906-46eb-8ea2-61d4e5434091 req-e82b0046-e6ef-467e-a5f0-b9ea951ec3a1 service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-2845918c-1906-46eb-8ea2-61d4e5434091 req-e82b0046-e6ef-467e-a5f0-b9ea951ec3a1 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] No waiting events found dispatching network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:31:07 user nova-compute[75356]: WARNING nova.compute.manager [req-2845918c-1906-46eb-8ea2-61d4e5434091 req-e82b0046-e6ef-467e-a5f0-b9ea951ec3a1 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received unexpected event network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 for instance with vm_state rescued and task_state unrescuing.
Nov 29 20:31:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-2845918c-1906-46eb-8ea2-61d4e5434091 req-e82b0046-e6ef-467e-a5f0-b9ea951ec3a1 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received event network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:31:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2845918c-1906-46eb-8ea2-61d4e5434091 req-e82b0046-e6ef-467e-a5f0-b9ea951ec3a1 service nova] Acquiring lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2845918c-1906-46eb-8ea2-61d4e5434091 req-e82b0046-e6ef-467e-a5f0-b9ea951ec3a1 service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2845918c-1906-46eb-8ea2-61d4e5434091 req-e82b0046-e6ef-467e-a5f0-b9ea951ec3a1 service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-2845918c-1906-46eb-8ea2-61d4e5434091 req-e82b0046-e6ef-467e-a5f0-b9ea951ec3a1 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] No waiting events found dispatching network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:31:07 user nova-compute[75356]: WARNING nova.compute.manager [req-2845918c-1906-46eb-8ea2-61d4e5434091 req-e82b0046-e6ef-467e-a5f0-b9ea951ec3a1 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received unexpected event network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 for instance with vm_state rescued and task_state unrescuing.
Nov 29 20:31:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:07 user nova-compute[75356]: DEBUG nova.compute.manager [None req-961532bf-2783-49b9-82c8-dacb4fd0834c tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:31:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:31:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:31:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c477f425-e9ce-4b3a-b21a-8bf04401ad0b/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c477f425-e9ce-4b3a-b21a-8bf04401ad0b/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c477f425-e9ce-4b3a-b21a-8bf04401ad0b/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c477f425-e9ce-4b3a-b21a-8bf04401ad0b/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:31:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:31:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:31:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:09 user nova-compute[75356]: DEBUG nova.compute.manager [req-834e85f2-911e-4dd9-acdb-4eda341e74e6 req-06ce9930-bc1d-43fd-97e6-02f340824381 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Received event network-changed-34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:31:09 user nova-compute[75356]: DEBUG nova.compute.manager [req-834e85f2-911e-4dd9-acdb-4eda341e74e6 req-06ce9930-bc1d-43fd-97e6-02f340824381 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Refreshing instance network info cache due to event network-changed-34d23443-7a73-4de5-972d-6c33ecf3e589. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:31:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-834e85f2-911e-4dd9-acdb-4eda341e74e6 req-06ce9930-bc1d-43fd-97e6-02f340824381 service nova] Acquiring lock "refresh_cache-1e818d19-e8e8-4e41-83b4-53888ea21c93" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:31:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-834e85f2-911e-4dd9-acdb-4eda341e74e6 req-06ce9930-bc1d-43fd-97e6-02f340824381 service nova] Acquired lock "refresh_cache-1e818d19-e8e8-4e41-83b4-53888ea21c93" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:31:09 user nova-compute[75356]: DEBUG nova.network.neutron [req-834e85f2-911e-4dd9-acdb-4eda341e74e6 req-06ce9930-bc1d-43fd-97e6-02f340824381 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Refreshing network info cache for port 34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:31:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:10 user nova-compute[75356]: DEBUG nova.network.neutron [req-834e85f2-911e-4dd9-acdb-4eda341e74e6 req-06ce9930-bc1d-43fd-97e6-02f340824381 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Updated VIF entry in instance network info cache for port 34d23443-7a73-4de5-972d-6c33ecf3e589. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:31:10 user nova-compute[75356]: DEBUG nova.network.neutron [req-834e85f2-911e-4dd9-acdb-4eda341e74e6 req-06ce9930-bc1d-43fd-97e6-02f340824381 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Updating instance_info_cache with network_info: [{"id": "34d23443-7a73-4de5-972d-6c33ecf3e589", "address": "fa:16:3e:74:01:d5", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d23443-7a", "ovs_interfaceid": "34d23443-7a73-4de5-972d-6c33ecf3e589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:31:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:31:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-834e85f2-911e-4dd9-acdb-4eda341e74e6 req-06ce9930-bc1d-43fd-97e6-02f340824381 service nova] Releasing lock "refresh_cache-1e818d19-e8e8-4e41-83b4-53888ea21c93" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:31:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:11 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:31:11 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:31:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=6818MB free_disk=24.799694061279297GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:31:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Applying migration context for instance 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3 as it has an incoming, in-progress migration 357f69a1-1c25-4514-b15c-a27acae10358. Migration status is finished {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 20:31:11 user nova-compute[75356]: INFO nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Updating resource usage from migration 357f69a1-1c25-4514-b15c-a27acae10358
Nov 29 20:31:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0b59517a-c467-432a-a73a-d1460c1574e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:31:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:31:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance db0826f0-5fdc-47a8-ae36-5059844980c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:31:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:31:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 93183110-d2e2-4da7-ab7d-73378f5e0d42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:31:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:31:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ee5bef74-04c5-4de1-8f8e-4baba05e2a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:31:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance c3bb4cde-968f-4474-abcd-8dbd73300865 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:31:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance c477f425-e9ce-4b3a-b21a-8bf04401ad0b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:31:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 1e818d19-e8e8-4e41-83b4-53888ea21c93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:31:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:31:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 9033b98b-fb6a-4702-8308-68363c60c6dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:31:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4713c9eb-4052-4d65-a4eb-23e62352185a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:31:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 2f1865c9-3202-4162-8949-0ab0f6bc55ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:31:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Migration 357f69a1-1c25-4514-b15c-a27acae10358 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 20:31:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:31:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:31:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=10240MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:31:11 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:31:11 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:31:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:31:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.735s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:12 user nova-compute[75356]: DEBUG nova.compute.manager [req-b2363428-76a2-4aae-a3c3-e862f2bdf6b3 req-f0b5328b-9535-4da1-b49c-1fef42b3dab2 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Received event network-changed-34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:31:12 user nova-compute[75356]: DEBUG nova.compute.manager [req-b2363428-76a2-4aae-a3c3-e862f2bdf6b3 req-f0b5328b-9535-4da1-b49c-1fef42b3dab2 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Refreshing instance network info cache due to event network-changed-34d23443-7a73-4de5-972d-6c33ecf3e589. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:31:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b2363428-76a2-4aae-a3c3-e862f2bdf6b3 req-f0b5328b-9535-4da1-b49c-1fef42b3dab2 service nova] Acquiring lock "refresh_cache-1e818d19-e8e8-4e41-83b4-53888ea21c93" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:31:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b2363428-76a2-4aae-a3c3-e862f2bdf6b3 req-f0b5328b-9535-4da1-b49c-1fef42b3dab2 service nova] Acquired lock "refresh_cache-1e818d19-e8e8-4e41-83b4-53888ea21c93" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:31:12 user nova-compute[75356]: DEBUG nova.network.neutron [req-b2363428-76a2-4aae-a3c3-e862f2bdf6b3 req-f0b5328b-9535-4da1-b49c-1fef42b3dab2 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Refreshing network info cache for port 34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:31:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:12 user nova-compute[75356]: DEBUG nova.network.neutron [req-b2363428-76a2-4aae-a3c3-e862f2bdf6b3 req-f0b5328b-9535-4da1-b49c-1fef42b3dab2 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Updated VIF entry in instance network info cache for port 34d23443-7a73-4de5-972d-6c33ecf3e589. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:31:12 user nova-compute[75356]: DEBUG nova.network.neutron [req-b2363428-76a2-4aae-a3c3-e862f2bdf6b3 req-f0b5328b-9535-4da1-b49c-1fef42b3dab2 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Updating instance_info_cache with network_info: [{"id": "34d23443-7a73-4de5-972d-6c33ecf3e589", "address": "fa:16:3e:74:01:d5", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d23443-7a", "ovs_interfaceid": "34d23443-7a73-4de5-972d-6c33ecf3e589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:31:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b2363428-76a2-4aae-a3c3-e862f2bdf6b3 req-f0b5328b-9535-4da1-b49c-1fef42b3dab2 service nova] Releasing lock "refresh_cache-1e818d19-e8e8-4e41-83b4-53888ea21c93" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:31:13 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:31:13 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:31:13 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:31:13 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:31:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "1e818d19-e8e8-4e41-83b4-53888ea21c93" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:17 user nova-compute[75356]: INFO nova.compute.manager [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Rebooting instance
Nov 29 20:31:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "refresh_cache-1e818d19-e8e8-4e41-83b4-53888ea21c93" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:31:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquired lock "refresh_cache-1e818d19-e8e8-4e41-83b4-53888ea21c93" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:31:17 user nova-compute[75356]: DEBUG nova.network.neutron [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:31:18 user nova-compute[75356]: DEBUG nova.network.neutron [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Updating instance_info_cache with network_info: [{"id": "34d23443-7a73-4de5-972d-6c33ecf3e589", "address": "fa:16:3e:74:01:d5", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d23443-7a", "ovs_interfaceid": "34d23443-7a73-4de5-972d-6c33ecf3e589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:31:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Releasing lock "refresh_cache-1e818d19-e8e8-4e41-83b4-53888ea21c93" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:31:18 user nova-compute[75356]: DEBUG nova.compute.manager [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:31:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-d98c3b40-0be0-4139-b6f5-3f62162e8471 req-276a6442-6c6c-4952-b262-a428ff46e6d8 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Received event network-vif-unplugged-34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:31:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d98c3b40-0be0-4139-b6f5-3f62162e8471 req-276a6442-6c6c-4952-b262-a428ff46e6d8 service nova] Acquiring lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d98c3b40-0be0-4139-b6f5-3f62162e8471 req-276a6442-6c6c-4952-b262-a428ff46e6d8 service nova] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d98c3b40-0be0-4139-b6f5-3f62162e8471 req-276a6442-6c6c-4952-b262-a428ff46e6d8 service nova] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-d98c3b40-0be0-4139-b6f5-3f62162e8471 req-276a6442-6c6c-4952-b262-a428ff46e6d8 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] No waiting events found dispatching network-vif-unplugged-34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:31:18 user nova-compute[75356]: WARNING nova.compute.manager [req-d98c3b40-0be0-4139-b6f5-3f62162e8471 req-276a6442-6c6c-4952-b262-a428ff46e6d8 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Received unexpected event network-vif-unplugged-34d23443-7a73-4de5-972d-6c33ecf3e589 for instance with vm_state active and task_state reboot_started_hard.
Nov 29 20:31:19 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Instance destroyed successfully.
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.objects.instance [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lazy-loading 'resources' on Instance uuid 1e818d19-e8e8-4e41-83b4-53888ea21c93 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:28:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-432095143',display_name='tempest-TestMinimumBasicScenario-server-432095143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-432095143',id=32,image_ref='107e2895-8c31-433b-b0ad-c9cadf20f693',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP20ADnO7ShB+++7hmlI1hDB+A3N0a6D8B4tazU/BSZ85WXgZZgkMXZKn//STQQevmVFinZMFXAAXQnCpTqyk3d8kwk47aFVBtiCC7Ft6IAn9HES9kUWYi4ZuFJyH0hDuA==',key_name='tempest-TestMinimumBasicScenario-1504152284',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:29:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11b97f9fbbb34b22ab013e1892dc91c1',ramdisk_id='',reservation_id='r-65b73uo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='107e2895-8c31-433b-b0ad-c9cadf20f693',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1742449158',owner_user_name='tempest-TestMinimumBasicScenario-1742449158-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:31:18Z,user_data=None,user_id='4a111049bab1401cbe074a03692b43af',uuid=1e818d19-e8e8-4e41-83b4-53888ea21c93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34d23443-7a73-4de5-972d-6c33ecf3e589", "address": "fa:16:3e:74:01:d5", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d23443-7a", "ovs_interfaceid": "34d23443-7a73-4de5-972d-6c33ecf3e589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Converting VIF {"id": "34d23443-7a73-4de5-972d-6c33ecf3e589", "address": "fa:16:3e:74:01:d5", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d23443-7a", "ovs_interfaceid": "34d23443-7a73-4de5-972d-6c33ecf3e589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:01:d5,bridge_name='br-int',has_traffic_filtering=True,id=34d23443-7a73-4de5-972d-6c33ecf3e589,network=Network(7408e82d-2d0b-45c2-8f7d-1b4c69cc6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d23443-7a') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_vif [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:01:d5,bridge_name='br-int',has_traffic_filtering=True,id=34d23443-7a73-4de5-972d-6c33ecf3e589,network=Network(7408e82d-2d0b-45c2-8f7d-1b4c69cc6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d23443-7a') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34d23443-7a, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b338131-2b82-4f07-a751-88efab52fc5b) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:19 user nova-compute[75356]: INFO os_vif [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:01:d5,bridge_name='br-int',has_traffic_filtering=True,id=34d23443-7a73-4de5-972d-6c33ecf3e589,network=Network(7408e82d-2d0b-45c2-8f7d-1b4c69cc6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d23443-7a')
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMaoDjXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:31:19 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[50901036-e5c3-4ccd-844e-7881fedc801f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:31:19 user nova-compute[75356]: No targets found.
Nov 29 20:31:19 user nova-compute[75356]: iSNS:
Nov 29 20:31:19 user nova-compute[75356]: No targets found.
Nov 29 20:31:19 user nova-compute[75356]: STATIC:
Nov 29 20:31:19 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09
Nov 29 20:31:19 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:31:19 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:31:19 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460
Nov 29 20:31:19 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:31:19 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:31:19 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7
Nov 29 20:31:19 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:31:19 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:31:19 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054
Nov 29 20:31:19 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:31:19 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:31:19 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b
Nov 29 20:31:19 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:31:19 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:31:19 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8
Nov 29 20:31:19 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:31:19 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:31:19 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955
Nov 29 20:31:19 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:31:19 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:31:19 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:31:19 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:31:19 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:31:19 user nova-compute[75356]: FIRMWARE:
Nov 29 20:31:19 user nova-compute[75356]: No targets found.
Nov 29 20:31:19 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:31:19 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:31:19 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[539d78bb-09bc-48eb-b176-84564bf315a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aafbfbb-3b20-4be4-b31c-7d78921b04a7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8308490ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955'): ({'sdi'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Removing single pathed devices sdi {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf987dc8-bcd1-4efc-b238-0834ffb902ba]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e858d8-ef54-4179-8c99-940fdbb9848e]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Flushing IO for device /dev/sdi {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[449ab916-9695-49f3-b33a-75bd8aba6b2c]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.056s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7a274e-f899-43ce-97fa-abe097d2b52f]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] SCSI volumes sdi have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba17b62-3f35-4253-9841-529c99d8cd40]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[589a8f61-e498-4bed-9349-58faf812a0a4]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955, portal: 172.16.0.220,3260]
Nov 29 20:31:19 user nova-compute[75356]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955, portal: 172.16.0.220,3260] successful.
Nov 29 20:31:19 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2b896f-85d6-4104-8cdc-556eeb547318]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] <== disconnect_volume: return (357ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Start _get_guest_xml network_info=[{"id": "34d23443-7a73-4de5-972d-6c33ecf3e589", "address": "fa:16:3e:74:01:d5", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d23443-7a", "ovs_interfaceid": "34d23443-7a73-4de5-972d-6c33ecf3e589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=107e2895-8c31-433b-b0ad-c9cadf20f693,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '107e2895-8c31-433b-b0ad-c9cadf20f693'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMaoDjXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '1e818d19-e8e8-4e41-83b4-53888ea21c93', 'attached_at': '', 'detached_at': '', 'volume_id': 'f7ed84ba-8a90-4031-9616-71473dec6955', 'serial': 'f7ed84ba-8a90-4031-9616-71473dec6955'}, 'attachment_id': '4a91ce0a-f843-4a22-b0c3-761ed58b89d3', 'volume_type': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:31:19 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:31:19 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=107e2895-8c31-433b-b0ad-c9cadf20f693,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.objects.instance [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1e818d19-e8e8-4e41-83b4-53888ea21c93 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.objects.base [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Object Instance<1e818d19-e8e8-4e41-83b4-53888ea21c93> lazy-loaded attributes: resources,vcpu_model {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMaoDjXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:31:19 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:31:19 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:31:19 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c31b8e-0936-4a21-9986-73d6ec80990e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:31:19 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bba207-1aaa-45c1-8e64-762ddfd655e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955] added
Nov 29 20:31:19 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4629829-e12e-4731-b714-556bb46b2d6c]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[98093f01-0db2-4301-83bb-08e4bf341558]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GMaoDjXT {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GMaoDjXT" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddb140e-df5f-4f42-b410-408bccaec685]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GMaoDjXT'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea6fb13-0bae-4a49-8c03-4d22f93ba7c4]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[649bc9ce-f24d-4100-aab6-e1a85415175a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46fa0ba-6cd4-4a54-8e5d-4ff4df1c09d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955, portal: 172.16.0.220,3260]
Nov 29 20:31:19 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955, portal: 172.16.0.220,3260] successful.
Nov 29 20:31:19 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcc9c85-9311-45f4-8b60-0a5c4d4d3c27]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcff0d5e-8e29-4ccd-b13c-25ca87c79725]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:31:19 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] HCTL ('40', '-', '-', 0) found on session 36 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b3c046-2162-4bea-949c-1b1b4e254d03]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Searching for a device in session 36 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:31:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMaoDjXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:31:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-d011caf7-ce5a-429a-a18c-b5d41cef21a8 req-fd20ebe0-c0b8-4d41-8f4d-622b6a832297 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Received event network-vif-plugged-34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:31:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d011caf7-ce5a-429a-a18c-b5d41cef21a8 req-fd20ebe0-c0b8-4d41-8f4d-622b6a832297 service nova] Acquiring lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d011caf7-ce5a-429a-a18c-b5d41cef21a8 req-fd20ebe0-c0b8-4d41-8f4d-622b6a832297 service nova] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d011caf7-ce5a-429a-a18c-b5d41cef21a8 req-fd20ebe0-c0b8-4d41-8f4d-622b6a832297 service nova] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-d011caf7-ce5a-429a-a18c-b5d41cef21a8 req-fd20ebe0-c0b8-4d41-8f4d-622b6a832297 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] No waiting events found dispatching network-vif-plugged-34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:31:20 user nova-compute[75356]: WARNING nova.compute.manager [req-d011caf7-ce5a-429a-a18c-b5d41cef21a8 req-fd20ebe0-c0b8-4d41-8f4d-622b6a832297 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Received unexpected event network-vif-plugged-34d23443-7a73-4de5-972d-6c33ecf3e589 for instance with vm_state active and task_state reboot_started_hard.
Nov 29 20:31:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:31:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23833663831343866', 'path': '/dev/sdi'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:31:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833663831343866', 'path': '/dev/sdi'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:31:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:28:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-432095143',display_name='tempest-TestMinimumBasicScenario-server-432095143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-432095143',id=32,image_ref='107e2895-8c31-433b-b0ad-c9cadf20f693',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP20ADnO7ShB+++7hmlI1hDB+A3N0a6D8B4tazU/BSZ85WXgZZgkMXZKn//STQQevmVFinZMFXAAXQnCpTqyk3d8kwk47aFVBtiCC7Ft6IAn9HES9kUWYi4ZuFJyH0hDuA==',key_name='tempest-TestMinimumBasicScenario-1504152284',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:29:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11b97f9fbbb34b22ab013e1892dc91c1',ramdisk_id='',reservation_id='r-65b73uo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='107e2895-8c31-433b-b0ad-c9cadf20f693',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1742449158',owner_user_name='tempest-TestMinimumBasicScenario-1742449158-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:31:18Z,user_data=None,user_id='4a111049bab1401cbe074a03692b43af',uuid=1e818d19-e8e8-4e41-83b4-53888ea21c93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34d23443-7a73-4de5-972d-6c33ecf3e589", "address": "fa:16:3e:74:01:d5", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d23443-7a", "ovs_interfaceid": "34d23443-7a73-4de5-972d-6c33ecf3e589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:31:20 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Converting VIF {"id": "34d23443-7a73-4de5-972d-6c33ecf3e589", "address": "fa:16:3e:74:01:d5", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d23443-7a", "ovs_interfaceid": "34d23443-7a73-4de5-972d-6c33ecf3e589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:31:20 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:01:d5,bridge_name='br-int',has_traffic_filtering=True,id=34d23443-7a73-4de5-972d-6c33ecf3e589,network=Network(7408e82d-2d0b-45c2-8f7d-1b4c69cc6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d23443-7a') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:31:20 user nova-compute[75356]: DEBUG nova.objects.instance [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e818d19-e8e8-4e41-83b4-53888ea21c93 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:31:20 user nova-compute[75356]: DEBUG nova.objects.base [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Object Instance<1e818d19-e8e8-4e41-83b4-53888ea21c93> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:31:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:31:20 user nova-compute[75356]:   <uuid>1e818d19-e8e8-4e41-83b4-53888ea21c93</uuid>
Nov 29 20:31:20 user nova-compute[75356]:   <name>instance-00000020</name>
Nov 29 20:31:20 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:31:20 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:31:20 user nova-compute[75356]:   <metadata>
Nov 29 20:31:20 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:31:20 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:31:20 user nova-compute[75356]:       <nova:name>tempest-TestMinimumBasicScenario-server-432095143</nova:name>
Nov 29 20:31:20 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:31:19</nova:creationTime>
Nov 29 20:31:20 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:31:20 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:31:20 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:31:20 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:31:20 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:31:20 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:31:20 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:31:20 user nova-compute[75356]:       <nova:owner>
Nov 29 20:31:20 user nova-compute[75356]:         <nova:user uuid="4a111049bab1401cbe074a03692b43af">tempest-TestMinimumBasicScenario-1742449158-project-member</nova:user>
Nov 29 20:31:20 user nova-compute[75356]:         <nova:project uuid="11b97f9fbbb34b22ab013e1892dc91c1">tempest-TestMinimumBasicScenario-1742449158</nova:project>
Nov 29 20:31:20 user nova-compute[75356]:       </nova:owner>
Nov 29 20:31:20 user nova-compute[75356]:       <nova:root type="image" uuid="107e2895-8c31-433b-b0ad-c9cadf20f693"/>
Nov 29 20:31:20 user nova-compute[75356]:       <nova:ports>
Nov 29 20:31:20 user nova-compute[75356]:         <nova:port uuid="34d23443-7a73-4de5-972d-6c33ecf3e589">
Nov 29 20:31:20 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 20:31:20 user nova-compute[75356]:         </nova:port>
Nov 29 20:31:20 user nova-compute[75356]:       </nova:ports>
Nov 29 20:31:20 user nova-compute[75356]:     </nova:instance>
Nov 29 20:31:20 user nova-compute[75356]:   </metadata>
Nov 29 20:31:20 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:31:20 user nova-compute[75356]:     <system>
Nov 29 20:31:20 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:31:20 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:31:20 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:31:20 user nova-compute[75356]:       <entry name="serial">1e818d19-e8e8-4e41-83b4-53888ea21c93</entry>
Nov 29 20:31:20 user nova-compute[75356]:       <entry name="uuid">1e818d19-e8e8-4e41-83b4-53888ea21c93</entry>
Nov 29 20:31:20 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:31:20 user nova-compute[75356]:     </system>
Nov 29 20:31:20 user nova-compute[75356]:   </sysinfo>
Nov 29 20:31:20 user nova-compute[75356]:   <os>
Nov 29 20:31:20 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:31:20 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:31:20 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:31:20 user nova-compute[75356]:   </os>
Nov 29 20:31:20 user nova-compute[75356]:   <features>
Nov 29 20:31:20 user nova-compute[75356]:     <acpi/>
Nov 29 20:31:20 user nova-compute[75356]:     <apic/>
Nov 29 20:31:20 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:31:20 user nova-compute[75356]:   </features>
Nov 29 20:31:20 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:31:20 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:31:20 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:31:20 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:31:20 user nova-compute[75356]:   </clock>
Nov 29 20:31:20 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:31:20 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:31:20 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:31:20 user nova-compute[75356]:   </cpu>
Nov 29 20:31:20 user nova-compute[75356]:   <devices>
Nov 29 20:31:20 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:31:20 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:31:20 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk"/>
Nov 29 20:31:20 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:31:20 user nova-compute[75356]:     </disk>
Nov 29 20:31:20 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:31:20 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:31:20 user nova-compute[75356]:       <source dev="/dev/sdi"/>
Nov 29 20:31:20 user nova-compute[75356]:       <target dev="vdb" bus="virtio"/>
Nov 29 20:31:20 user nova-compute[75356]:       <serial>f7ed84ba-8a90-4031-9616-71473dec6955</serial>
Nov 29 20:31:20 user nova-compute[75356]:     </disk>
Nov 29 20:31:20 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:31:20 user nova-compute[75356]:       <mac address="fa:16:3e:74:01:d5"/>
Nov 29 20:31:20 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:31:20 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:31:20 user nova-compute[75356]:       <target dev="tap34d23443-7a"/>
Nov 29 20:31:20 user nova-compute[75356]:     </interface>
Nov 29 20:31:20 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:31:20 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/console.log" append="off"/>
Nov 29 20:31:20 user nova-compute[75356]:     </serial>
Nov 29 20:31:20 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:31:20 user nova-compute[75356]:     <video>
Nov 29 20:31:20 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:31:20 user nova-compute[75356]:     </video>
Nov 29 20:31:20 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:31:20 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:31:20 user nova-compute[75356]:     </rng>
Nov 29 20:31:20 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:31:20 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:31:20 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:31:20 user nova-compute[75356]:     </memballoon>
Nov 29 20:31:20 user nova-compute[75356]:   </devices>
Nov 29 20:31:20 user nova-compute[75356]: </domain>
Nov 29 20:31:20 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:31:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG nova.objects.instance [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1e818d19-e8e8-4e41-83b4-53888ea21c93 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG nova.objects.base [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Object Instance<1e818d19-e8e8-4e41-83b4-53888ea21c93> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a2834f55fdcae3559c708e72fc6a4141faf8438 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a2834f55fdcae3559c708e72fc6a4141faf8438 --force-share --output=json" returned: 0 in 0.173s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Cannot resize image /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG nova.objects.instance [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lazy-loading 'migration_context' on Instance uuid 1e818d19-e8e8-4e41-83b4-53888ea21c93 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG nova.objects.base [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Object Instance<1e818d19-e8e8-4e41-83b4-53888ea21c93> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:28:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-432095143',display_name='tempest-TestMinimumBasicScenario-server-432095143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-432095143',id=32,image_ref='107e2895-8c31-433b-b0ad-c9cadf20f693',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP20ADnO7ShB+++7hmlI1hDB+A3N0a6D8B4tazU/BSZ85WXgZZgkMXZKn//STQQevmVFinZMFXAAXQnCpTqyk3d8kwk47aFVBtiCC7Ft6IAn9HES9kUWYi4ZuFJyH0hDuA==',key_name='tempest-TestMinimumBasicScenario-1504152284',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:29:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='11b97f9fbbb34b22ab013e1892dc91c1',ramdisk_id='',reservation_id='r-65b73uo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='107e2895-8c31-433b-b0ad-c9cadf20f693',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1742449158',owner_user_name='tempest-TestMinimumBasicScenario-1742449158-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:31:18Z,user_data=None,user_id='4a111049bab1401cbe074a03692b43af',uuid=1e818d19-e8e8-4e41-83b4-53888ea21c93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34d23443-7a73-4de5-972d-6c33ecf3e589", "address": "fa:16:3e:74:01:d5", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d23443-7a", "ovs_interfaceid": "34d23443-7a73-4de5-972d-6c33ecf3e589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Converting VIF {"id": "34d23443-7a73-4de5-972d-6c33ecf3e589", "address": "fa:16:3e:74:01:d5", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d23443-7a", "ovs_interfaceid": "34d23443-7a73-4de5-972d-6c33ecf3e589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:01:d5,bridge_name='br-int',has_traffic_filtering=True,id=34d23443-7a73-4de5-972d-6c33ecf3e589,network=Network(7408e82d-2d0b-45c2-8f7d-1b4c69cc6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d23443-7a') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG os_vif [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:01:d5,bridge_name='br-int',has_traffic_filtering=True,id=34d23443-7a73-4de5-972d-6c33ecf3e589,network=Network(7408e82d-2d0b-45c2-8f7d-1b4c69cc6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d23443-7a') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '164fd096-7965-5b77-99f4-272f881d6676', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34d23443-7a, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap34d23443-7a, col_values=(('qos', UUID('635180b5-ac1a-4598-8503-3407b3f50dfb')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap34d23443-7a, col_values=(('external_ids', {'iface-id': '34d23443-7a73-4de5-972d-6c33ecf3e589', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:01:d5', 'vm-uuid': '1e818d19-e8e8-4e41-83b4-53888ea21c93'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:31:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:21 user nova-compute[75356]: INFO os_vif [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:01:d5,bridge_name='br-int',has_traffic_filtering=True,id=34d23443-7a73-4de5-972d-6c33ecf3e589,network=Network(7408e82d-2d0b-45c2-8f7d-1b4c69cc6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d23443-7a')
Nov 29 20:31:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:23 user nova-compute[75356]: DEBUG nova.compute.manager [req-79f26c4a-5833-4e77-9fe7-7896840ad1ab req-e5dc95a1-747f-429a-8bf2-38c86f1babef service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Received event network-vif-plugged-34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:31:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-79f26c4a-5833-4e77-9fe7-7896840ad1ab req-e5dc95a1-747f-429a-8bf2-38c86f1babef service nova] Acquiring lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-79f26c4a-5833-4e77-9fe7-7896840ad1ab req-e5dc95a1-747f-429a-8bf2-38c86f1babef service nova] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-79f26c4a-5833-4e77-9fe7-7896840ad1ab req-e5dc95a1-747f-429a-8bf2-38c86f1babef service nova] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:23 user nova-compute[75356]: DEBUG nova.compute.manager [req-79f26c4a-5833-4e77-9fe7-7896840ad1ab req-e5dc95a1-747f-429a-8bf2-38c86f1babef service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] No waiting events found dispatching network-vif-plugged-34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:31:23 user nova-compute[75356]: WARNING nova.compute.manager [req-79f26c4a-5833-4e77-9fe7-7896840ad1ab req-e5dc95a1-747f-429a-8bf2-38c86f1babef service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Received unexpected event network-vif-plugged-34d23443-7a73-4de5-972d-6c33ecf3e589 for instance with vm_state active and task_state reboot_started_hard.
Nov 29 20:31:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:25 user nova-compute[75356]: DEBUG nova.compute.manager [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:31:25 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Instance rebooted successfully.
Nov 29 20:31:25 user nova-compute[75356]: DEBUG nova.compute.manager [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:31:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-633877c3-ba92-4bd7-8910-a67a597b34da req-71053075-880e-4278-b04c-5b4d55453142 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Received event network-vif-plugged-34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:31:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-633877c3-ba92-4bd7-8910-a67a597b34da req-71053075-880e-4278-b04c-5b4d55453142 service nova] Acquiring lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-633877c3-ba92-4bd7-8910-a67a597b34da req-71053075-880e-4278-b04c-5b4d55453142 service nova] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-633877c3-ba92-4bd7-8910-a67a597b34da req-71053075-880e-4278-b04c-5b4d55453142 service nova] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-633877c3-ba92-4bd7-8910-a67a597b34da req-71053075-880e-4278-b04c-5b4d55453142 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] No waiting events found dispatching network-vif-plugged-34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:31:25 user nova-compute[75356]: WARNING nova.compute.manager [req-633877c3-ba92-4bd7-8910-a67a597b34da req-71053075-880e-4278-b04c-5b4d55453142 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Received unexpected event network-vif-plugged-34d23443-7a73-4de5-972d-6c33ecf3e589 for instance with vm_state active and task_state reboot_started_hard.
Nov 29 20:31:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-aac3cb56-c8aa-4d81-9dd8-3b4e04ba9411 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.151s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:30 user nova-compute[75356]: DEBUG nova.compute.manager [req-f8f8d790-1ce7-4bf2-9533-0450fd301cb9 req-db0c3703-32cb-4ac8-9066-8c407ee27e6f service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Received event network-changed-617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:31:30 user nova-compute[75356]: DEBUG nova.compute.manager [req-f8f8d790-1ce7-4bf2-9533-0450fd301cb9 req-db0c3703-32cb-4ac8-9066-8c407ee27e6f service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Refreshing instance network info cache due to event network-changed-617944a3-eb1e-431e-8b2f-f3090e4947e4. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:31:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f8f8d790-1ce7-4bf2-9533-0450fd301cb9 req-db0c3703-32cb-4ac8-9066-8c407ee27e6f service nova] Acquiring lock "refresh_cache-ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:31:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f8f8d790-1ce7-4bf2-9533-0450fd301cb9 req-db0c3703-32cb-4ac8-9066-8c407ee27e6f service nova] Acquired lock "refresh_cache-ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:31:30 user nova-compute[75356]: DEBUG nova.network.neutron [req-f8f8d790-1ce7-4bf2-9533-0450fd301cb9 req-db0c3703-32cb-4ac8-9066-8c407ee27e6f service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Refreshing network info cache for port 617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:31:30 user nova-compute[75356]: DEBUG nova.network.neutron [req-f8f8d790-1ce7-4bf2-9533-0450fd301cb9 req-db0c3703-32cb-4ac8-9066-8c407ee27e6f service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Updated VIF entry in instance network info cache for port 617944a3-eb1e-431e-8b2f-f3090e4947e4. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:31:30 user nova-compute[75356]: DEBUG nova.network.neutron [req-f8f8d790-1ce7-4bf2-9533-0450fd301cb9 req-db0c3703-32cb-4ac8-9066-8c407ee27e6f service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Updating instance_info_cache with network_info: [{"id": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "address": "fa:16:3e:03:0f:9e", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617944a3-eb", "ovs_interfaceid": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:31:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f8f8d790-1ce7-4bf2-9533-0450fd301cb9 req-db0c3703-32cb-4ac8-9066-8c407ee27e6f service nova] Releasing lock "refresh_cache-ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:31:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:33 user nova-compute[75356]: INFO nova.compute.manager [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Shelving
Nov 29 20:31:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:34 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Instance destroyed successfully.
Nov 29 20:31:34 user nova-compute[75356]: DEBUG nova.compute.manager [req-cd272f10-88dd-4e9a-8692-ca2074d34cab req-ae45a4fb-6e09-4d3f-b985-74c3d2207cd0 service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Received event network-vif-unplugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:31:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cd272f10-88dd-4e9a-8692-ca2074d34cab req-ae45a4fb-6e09-4d3f-b985-74c3d2207cd0 service nova] Acquiring lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cd272f10-88dd-4e9a-8692-ca2074d34cab req-ae45a4fb-6e09-4d3f-b985-74c3d2207cd0 service nova] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cd272f10-88dd-4e9a-8692-ca2074d34cab req-ae45a4fb-6e09-4d3f-b985-74c3d2207cd0 service nova] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:34 user nova-compute[75356]: DEBUG nova.compute.manager [req-cd272f10-88dd-4e9a-8692-ca2074d34cab req-ae45a4fb-6e09-4d3f-b985-74c3d2207cd0 service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] No waiting events found dispatching network-vif-unplugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:31:34 user nova-compute[75356]: WARNING nova.compute.manager [req-cd272f10-88dd-4e9a-8692-ca2074d34cab req-ae45a4fb-6e09-4d3f-b985-74c3d2207cd0 service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Received unexpected event network-vif-unplugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 for instance with vm_state active and task_state shelving.
Nov 29 20:31:34 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Beginning cold snapshot process
Nov 29 20:31:34 user nova-compute[75356]: DEBUG nova.privsep.utils [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75356) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 20:31:34 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk /opt/stack/data/nova/instances/snapshots/tmpltho26_g/543a4cd46f9341b39769e531298dd5b0 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk /opt/stack/data/nova/instances/snapshots/tmpltho26_g/543a4cd46f9341b39769e531298dd5b0" returned: 0 in 0.852s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:35 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Snapshot extracted, beginning image upload
Nov 29 20:31:36 user nova-compute[75356]: DEBUG nova.compute.manager [req-47c02339-e791-47f7-bc26-6eada4b3b2e4 req-e4e4d4c0-514e-4fa8-a7c0-3679d53e780f service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Received event network-vif-plugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:31:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-47c02339-e791-47f7-bc26-6eada4b3b2e4 req-e4e4d4c0-514e-4fa8-a7c0-3679d53e780f service nova] Acquiring lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-47c02339-e791-47f7-bc26-6eada4b3b2e4 req-e4e4d4c0-514e-4fa8-a7c0-3679d53e780f service nova] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-47c02339-e791-47f7-bc26-6eada4b3b2e4 req-e4e4d4c0-514e-4fa8-a7c0-3679d53e780f service nova] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:36 user nova-compute[75356]: DEBUG nova.compute.manager [req-47c02339-e791-47f7-bc26-6eada4b3b2e4 req-e4e4d4c0-514e-4fa8-a7c0-3679d53e780f service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] No waiting events found dispatching network-vif-plugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:31:36 user nova-compute[75356]: WARNING nova.compute.manager [req-47c02339-e791-47f7-bc26-6eada4b3b2e4 req-e4e4d4c0-514e-4fa8-a7c0-3679d53e780f service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Received unexpected event network-vif-plugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 20:31:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:38 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Snapshot image upload complete
Nov 29 20:31:38 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:31:38 user nova-compute[75356]: INFO nova.compute.manager [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Shelve offloading
Nov 29 20:31:38 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Instance destroyed successfully.
Nov 29 20:31:38 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:31:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "refresh_cache-ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:31:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquired lock "refresh_cache-ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:31:38 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:31:39 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Updating instance_info_cache with network_info: [{"id": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "address": "fa:16:3e:03:0f:9e", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617944a3-eb", "ovs_interfaceid": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:31:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Releasing lock "refresh_cache-ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:31:39 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Instance destroyed successfully.
Nov 29 20:31:39 user nova-compute[75356]: DEBUG nova.objects.instance [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lazy-loading 'resources' on Instance uuid ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:31:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746543629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746543629',id=34,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoBYhUZTHHk0CREN0lXpO01HfOR1JC0gy8IkTdtaqmqYZSwBX5tvSh0xRk0q4YRJyhgG6K0SdzHAwxFF/zK8Mb+8/lRRNokeiBDcNpDtwZ4Op8oi1jdXBF3LvLyPmY1Tg==',key_name='tempest-keypair-1798007487',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:29:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='71e99301081a4158bc9d188e2f796350',ramdisk_id='',reservation_id='r-np63f8g4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1538416601',owner_user_name='tempest-AttachVolumeShelveTestJSON-1538416601-project-member',shelved_at='2023-11-29T20:31:38.483187',shelved_host='user',shelved_image_id='901efec7-a805-499d-aacf-891b5d8acd78'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:31:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecc96706ae3140ce8816c0e78e116d7d',uuid=ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "address": "fa:16:3e:03:0f:9e", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617944a3-eb", "ovs_interfaceid": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:31:39 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converting VIF {"id": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "address": "fa:16:3e:03:0f:9e", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617944a3-eb", "ovs_interfaceid": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:31:39 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:0f:9e,bridge_name='br-int',has_traffic_filtering=True,id=617944a3-eb1e-431e-8b2f-f3090e4947e4,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617944a3-eb') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:31:39 user nova-compute[75356]: DEBUG os_vif [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:0f:9e,bridge_name='br-int',has_traffic_filtering=True,id=617944a3-eb1e-431e-8b2f-f3090e4947e4,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617944a3-eb') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:31:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap617944a3-eb, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:31:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:31:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c6e932d-35f3-40b7-92c3-97e7bfc00fd9) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:31:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:39 user nova-compute[75356]: DEBUG nova.compute.manager [req-d1558558-85f8-41bd-b6b7-f055280144af req-4704c7ed-d824-45ca-bf2e-f1fc3c0cf0da service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Received event network-changed-617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:31:39 user nova-compute[75356]: DEBUG nova.compute.manager [req-d1558558-85f8-41bd-b6b7-f055280144af req-4704c7ed-d824-45ca-bf2e-f1fc3c0cf0da service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Refreshing instance network info cache due to event network-changed-617944a3-eb1e-431e-8b2f-f3090e4947e4. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:31:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d1558558-85f8-41bd-b6b7-f055280144af req-4704c7ed-d824-45ca-bf2e-f1fc3c0cf0da service nova] Acquiring lock "refresh_cache-ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:31:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d1558558-85f8-41bd-b6b7-f055280144af req-4704c7ed-d824-45ca-bf2e-f1fc3c0cf0da service nova] Acquired lock "refresh_cache-ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:31:39 user nova-compute[75356]: DEBUG nova.network.neutron [req-d1558558-85f8-41bd-b6b7-f055280144af req-4704c7ed-d824-45ca-bf2e-f1fc3c0cf0da service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Refreshing network info cache for port 617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:31:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:39 user nova-compute[75356]: INFO os_vif [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:0f:9e,bridge_name='br-int',has_traffic_filtering=True,id=617944a3-eb1e-431e-8b2f-f3090e4947e4,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617944a3-eb')
Nov 29 20:31:39 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Deleting instance files /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb_del
Nov 29 20:31:39 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Deletion of /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb_del complete
Nov 29 20:31:40 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Deleted allocations for instance ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb
Nov 29 20:31:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:40 user nova-compute[75356]: DEBUG nova.objects.instance [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lazy-loading 'numa_topology' on Instance uuid ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:31:40 user nova-compute[75356]: DEBUG nova.objects.base [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Object Instance<ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb> lazy-loaded attributes: resources,numa_topology {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:31:40 user nova-compute[75356]: DEBUG nova.network.neutron [req-d1558558-85f8-41bd-b6b7-f055280144af req-4704c7ed-d824-45ca-bf2e-f1fc3c0cf0da service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Updated VIF entry in instance network info cache for port 617944a3-eb1e-431e-8b2f-f3090e4947e4. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:31:40 user nova-compute[75356]: DEBUG nova.network.neutron [req-d1558558-85f8-41bd-b6b7-f055280144af req-4704c7ed-d824-45ca-bf2e-f1fc3c0cf0da service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Updating instance_info_cache with network_info: [{"id": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "address": "fa:16:3e:03:0f:9e", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap617944a3-eb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:31:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d1558558-85f8-41bd-b6b7-f055280144af req-4704c7ed-d824-45ca-bf2e-f1fc3c0cf0da service nova] Releasing lock "refresh_cache-ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:31:40 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:31:40 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:31:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.509s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c6bc5f8d-e5cf-42d8-b476-2cdd4e69571d tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.701s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:47 user nova-compute[75356]: DEBUG nova.compute.manager [req-6eb33914-0adb-41f6-ae94-9219ff3eb2c7 req-9ed1a4e0-9999-40a9-bf9b-e897511f287f service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Received event network-changed-2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:31:47 user nova-compute[75356]: DEBUG nova.compute.manager [req-6eb33914-0adb-41f6-ae94-9219ff3eb2c7 req-9ed1a4e0-9999-40a9-bf9b-e897511f287f service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Refreshing instance network info cache due to event network-changed-2d549e00-e710-4b20-b6b2-69deafe8ff8d. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:31:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6eb33914-0adb-41f6-ae94-9219ff3eb2c7 req-9ed1a4e0-9999-40a9-bf9b-e897511f287f service nova] Acquiring lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:31:47 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6eb33914-0adb-41f6-ae94-9219ff3eb2c7 req-9ed1a4e0-9999-40a9-bf9b-e897511f287f service nova] Acquired lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:31:47 user nova-compute[75356]: DEBUG nova.network.neutron [req-6eb33914-0adb-41f6-ae94-9219ff3eb2c7 req-9ed1a4e0-9999-40a9-bf9b-e897511f287f service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Refreshing network info cache for port 2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:31:48 user nova-compute[75356]: DEBUG nova.network.neutron [req-6eb33914-0adb-41f6-ae94-9219ff3eb2c7 req-9ed1a4e0-9999-40a9-bf9b-e897511f287f service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Updated VIF entry in instance network info cache for port 2d549e00-e710-4b20-b6b2-69deafe8ff8d. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:31:48 user nova-compute[75356]: DEBUG nova.network.neutron [req-6eb33914-0adb-41f6-ae94-9219ff3eb2c7 req-9ed1a4e0-9999-40a9-bf9b-e897511f287f service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Updating instance_info_cache with network_info: [{"id": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "address": "fa:16:3e:c3:30:66", "network": {"id": "48d05176-aee3-4bf7-a929-a2b3714e9c6e", "bridge": "br-int", "label": "tempest-TestShelveInstance-447192641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022c8a86cda4a7c90d96d60a8261cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d549e00-e7", "ovs_interfaceid": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:31:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6eb33914-0adb-41f6-ae94-9219ff3eb2c7 req-9ed1a4e0-9999-40a9-bf9b-e897511f287f service nova] Releasing lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:31:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Acquiring lock "9033b98b-fb6a-4702-8308-68363c60c6dc" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:48 user nova-compute[75356]: INFO nova.compute.manager [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Shelve offloading
Nov 29 20:31:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:48 user nova-compute[75356]: DEBUG nova.compute.manager [req-61b96abe-b533-4932-ad9f-9e1ecf312b14 req-f8119545-0ac3-4ef1-abe0-040803e993f5 service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Received event network-vif-unplugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:31:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-61b96abe-b533-4932-ad9f-9e1ecf312b14 req-f8119545-0ac3-4ef1-abe0-040803e993f5 service nova] Acquiring lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-61b96abe-b533-4932-ad9f-9e1ecf312b14 req-f8119545-0ac3-4ef1-abe0-040803e993f5 service nova] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:48 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-61b96abe-b533-4932-ad9f-9e1ecf312b14 req-f8119545-0ac3-4ef1-abe0-040803e993f5 service nova] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:48 user nova-compute[75356]: DEBUG nova.compute.manager [req-61b96abe-b533-4932-ad9f-9e1ecf312b14 req-f8119545-0ac3-4ef1-abe0-040803e993f5 service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] No waiting events found dispatching network-vif-unplugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:31:48 user nova-compute[75356]: WARNING nova.compute.manager [req-61b96abe-b533-4932-ad9f-9e1ecf312b14 req-f8119545-0ac3-4ef1-abe0-040803e993f5 service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Received unexpected event network-vif-unplugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d for instance with vm_state active and task_state shelving.
Nov 29 20:31:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:49 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Instance destroyed successfully.
Nov 29 20:31:49 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Acquiring lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Acquired lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG nova.network.neutron [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG nova.network.neutron [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Updating instance_info_cache with network_info: [{"id": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "address": "fa:16:3e:c3:30:66", "network": {"id": "48d05176-aee3-4bf7-a929-a2b3714e9c6e", "bridge": "br-int", "label": "tempest-TestShelveInstance-447192641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022c8a86cda4a7c90d96d60a8261cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d549e00-e7", "ovs_interfaceid": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Releasing lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:49 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Instance destroyed successfully.
Nov 29 20:31:49 user nova-compute[75356]: DEBUG nova.objects.instance [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lazy-loading 'resources' on Instance uuid 9033b98b-fb6a-4702-8308-68363c60c6dc {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:29:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-944208577',display_name='tempest-TestShelveInstance-server-944208577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-944208577',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7rG4LPitcy3wY+Vt34PAYOYla8jNk64fkntCEF0ecMI0BzP3qHqoNeWWWjhTJA09mZl93bIwMIVOXKCBZz2ukSQkF4PU+LPW80GhWotpvwsJBnJMXD7Ngy6h16xpSt0A==',key_name='tempest-TestShelveInstance-1797487326',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:30:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b022c8a86cda4a7c90d96d60a8261cfb',ramdisk_id='',reservation_id='r-nnfyeth2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-930711373',owner_user_name='tempest-TestShelveInstance-930711373-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:30:12Z,user_data=None,user_id='3f5c736b58ab4ccc913b8efbd8d4365f',uuid=9033b98b-fb6a-4702-8308-68363c60c6dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "address": "fa:16:3e:c3:30:66", "network": {"id": "48d05176-aee3-4bf7-a929-a2b3714e9c6e", "bridge": "br-int", "label": "tempest-TestShelveInstance-447192641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022c8a86cda4a7c90d96d60a8261cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d549e00-e7", "ovs_interfaceid": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Converting VIF {"id": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "address": "fa:16:3e:c3:30:66", "network": {"id": "48d05176-aee3-4bf7-a929-a2b3714e9c6e", "bridge": "br-int", "label": "tempest-TestShelveInstance-447192641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022c8a86cda4a7c90d96d60a8261cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d549e00-e7", "ovs_interfaceid": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:30:66,bridge_name='br-int',has_traffic_filtering=True,id=2d549e00-e710-4b20-b6b2-69deafe8ff8d,network=Network(48d05176-aee3-4bf7-a929-a2b3714e9c6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d549e00-e7') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG os_vif [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:30:66,bridge_name='br-int',has_traffic_filtering=True,id=2d549e00-e710-4b20-b6b2-69deafe8ff8d,network=Network(48d05176-aee3-4bf7-a929-a2b3714e9c6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d549e00-e7') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d549e00-e7, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG nova.compute.manager [req-598d6036-5683-4f21-b89a-3f8131da2087 req-5bb2ff06-a07f-4bb5-bf6d-94b4c18d3f5d service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Received event network-changed-2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG nova.compute.manager [req-598d6036-5683-4f21-b89a-3f8131da2087 req-5bb2ff06-a07f-4bb5-bf6d-94b4c18d3f5d service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Refreshing instance network info cache due to event network-changed-2d549e00-e710-4b20-b6b2-69deafe8ff8d. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-598d6036-5683-4f21-b89a-3f8131da2087 req-5bb2ff06-a07f-4bb5-bf6d-94b4c18d3f5d service nova] Acquiring lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-598d6036-5683-4f21-b89a-3f8131da2087 req-5bb2ff06-a07f-4bb5-bf6d-94b4c18d3f5d service nova] Acquired lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG nova.network.neutron [req-598d6036-5683-4f21-b89a-3f8131da2087 req-5bb2ff06-a07f-4bb5-bf6d-94b4c18d3f5d service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Refreshing network info cache for port 2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=399d7339-930d-4592-811f-fc9ea7fc56fb) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:31:49 user nova-compute[75356]: INFO os_vif [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:30:66,bridge_name='br-int',has_traffic_filtering=True,id=2d549e00-e710-4b20-b6b2-69deafe8ff8d,network=Network(48d05176-aee3-4bf7-a929-a2b3714e9c6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d549e00-e7')
Nov 29 20:31:49 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFVWetKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:31:49 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:31:49 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cafdbfe-707f-4611-9215-56973cb939ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:31:49 user nova-compute[75356]: No targets found.
Nov 29 20:31:49 user nova-compute[75356]: iSNS:
Nov 29 20:31:49 user nova-compute[75356]: No targets found.
Nov 29 20:31:49 user nova-compute[75356]: STATIC:
Nov 29 20:31:49 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09
Nov 29 20:31:49 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:31:49 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:31:49 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460
Nov 29 20:31:49 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:31:49 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:31:49 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7
Nov 29 20:31:49 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:31:49 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:31:49 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054
Nov 29 20:31:49 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:31:49 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:31:49 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b
Nov 29 20:31:49 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:31:49 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:31:49 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8
Nov 29 20:31:49 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:31:49 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:31:49 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955
Nov 29 20:31:49 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:31:49 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:31:49 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:31:49 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:31:49 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:31:49 user nova-compute[75356]: FIRMWARE:
Nov 29 20:31:49 user nova-compute[75356]: No targets found.
Nov 29 20:31:49 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:31:49 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:31:49 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:31:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cda9e94-aa5d-48fb-bd94-f02a62819117]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c641fc-c279-47ca-987a-c3be8d81c9b6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:31:50 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:31:50 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:31:50 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:31:50 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:31:50 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:31:50 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:31:50 user nova-compute[75356]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:31:50 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:31:50 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:31:50 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:31:50 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:31:50 user nova-compute[75356]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:31:50 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:31:50 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:31:50 user nova-compute[75356]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:31:50 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830818f010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7'): ({'sdg'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Removing single pathed devices sdg {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b5b2f5-b6f7-4dcc-8b55-3c8a05660450]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4883561c-c3a1-4ee2-9fce-0a6ac822c3f6]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Flushing IO for device /dev/sdg {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff13512-6d04-4533-bf9d-60f199ab51d8]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e701d66d-527c-4643-911e-c325ff9d28c1]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] SCSI volumes sdg have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d5af7d-017c-4b52-87ba-06434a1f25a1]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bb6dab-2e51-48ac-a1ac-472e3a3a44e7]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7, portal: 172.16.0.220,3260]
Nov 29 20:31:50 user nova-compute[75356]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7, portal: 172.16.0.220,3260] successful.
Nov 29 20:31:50 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbd1a94-d424-421c-93ae-61cf5b1967d5]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] <== disconnect_volume: return (356ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:31:50 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Deleting instance files /opt/stack/data/nova/instances/9033b98b-fb6a-4702-8308-68363c60c6dc_del
Nov 29 20:31:50 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Deletion of /opt/stack/data/nova/instances/9033b98b-fb6a-4702-8308-68363c60c6dc_del complete
Nov 29 20:31:50 user nova-compute[75356]: DEBUG nova.compute.manager [req-66db7ac9-2abc-46d8-b3cf-8befba6fc0dd req-6954eeb5-6b68-4da5-b5d8-601474c6c873 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Received event network-changed-b010c396-b323-4964-90bc-ea781b8ee123 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG nova.compute.manager [req-66db7ac9-2abc-46d8-b3cf-8befba6fc0dd req-6954eeb5-6b68-4da5-b5d8-601474c6c873 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Refreshing instance network info cache due to event network-changed-b010c396-b323-4964-90bc-ea781b8ee123. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-66db7ac9-2abc-46d8-b3cf-8befba6fc0dd req-6954eeb5-6b68-4da5-b5d8-601474c6c873 service nova] Acquiring lock "refresh_cache-4713c9eb-4052-4d65-a4eb-23e62352185a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-66db7ac9-2abc-46d8-b3cf-8befba6fc0dd req-6954eeb5-6b68-4da5-b5d8-601474c6c873 service nova] Acquired lock "refresh_cache-4713c9eb-4052-4d65-a4eb-23e62352185a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG nova.network.neutron [req-66db7ac9-2abc-46d8-b3cf-8befba6fc0dd req-6954eeb5-6b68-4da5-b5d8-601474c6c873 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Refreshing network info cache for port b010c396-b323-4964-90bc-ea781b8ee123 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG nova.network.neutron [req-598d6036-5683-4f21-b89a-3f8131da2087 req-5bb2ff06-a07f-4bb5-bf6d-94b4c18d3f5d service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Updated VIF entry in instance network info cache for port 2d549e00-e710-4b20-b6b2-69deafe8ff8d. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG nova.network.neutron [req-598d6036-5683-4f21-b89a-3f8131da2087 req-5bb2ff06-a07f-4bb5-bf6d-94b4c18d3f5d service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Updating instance_info_cache with network_info: [{"id": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "address": "fa:16:3e:c3:30:66", "network": {"id": "48d05176-aee3-4bf7-a929-a2b3714e9c6e", "bridge": null, "label": "tempest-TestShelveInstance-447192641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022c8a86cda4a7c90d96d60a8261cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2d549e00-e7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-598d6036-5683-4f21-b89a-3f8131da2087 req-5bb2ff06-a07f-4bb5-bf6d-94b4c18d3f5d service nova] Releasing lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG nova.compute.manager [req-20eda2e4-6098-4065-9bd0-b92fd2b19545 req-67ec0416-b415-4acd-926f-487a5baede6b service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Received event network-vif-plugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-20eda2e4-6098-4065-9bd0-b92fd2b19545 req-67ec0416-b415-4acd-926f-487a5baede6b service nova] Acquiring lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-20eda2e4-6098-4065-9bd0-b92fd2b19545 req-67ec0416-b415-4acd-926f-487a5baede6b service nova] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-20eda2e4-6098-4065-9bd0-b92fd2b19545 req-67ec0416-b415-4acd-926f-487a5baede6b service nova] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:50 user nova-compute[75356]: DEBUG nova.compute.manager [req-20eda2e4-6098-4065-9bd0-b92fd2b19545 req-67ec0416-b415-4acd-926f-487a5baede6b service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] No waiting events found dispatching network-vif-plugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:31:50 user nova-compute[75356]: WARNING nova.compute.manager [req-20eda2e4-6098-4065-9bd0-b92fd2b19545 req-67ec0416-b415-4acd-926f-487a5baede6b service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Received unexpected event network-vif-plugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d for instance with vm_state active and task_state shelving.
Nov 29 20:31:51 user nova-compute[75356]: DEBUG nova.network.neutron [req-66db7ac9-2abc-46d8-b3cf-8befba6fc0dd req-6954eeb5-6b68-4da5-b5d8-601474c6c873 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Updated VIF entry in instance network info cache for port b010c396-b323-4964-90bc-ea781b8ee123. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:31:51 user nova-compute[75356]: DEBUG nova.network.neutron [req-66db7ac9-2abc-46d8-b3cf-8befba6fc0dd req-6954eeb5-6b68-4da5-b5d8-601474c6c873 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Updating instance_info_cache with network_info: [{"id": "b010c396-b323-4964-90bc-ea781b8ee123", "address": "fa:16:3e:6d:3e:e2", "network": {"id": "17ebb4e8-43d7-4475-90cf-f8883b3ffe1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-50669801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7627fb78ee514bd0b0d7b5f2a1a807b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb010c396-b3", "ovs_interfaceid": "b010c396-b323-4964-90bc-ea781b8ee123", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:31:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-66db7ac9-2abc-46d8-b3cf-8befba6fc0dd req-6954eeb5-6b68-4da5-b5d8-601474c6c873 service nova] Releasing lock "refresh_cache-4713c9eb-4052-4d65-a4eb-23e62352185a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:31:51 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Deleted allocations for instance 9033b98b-fb6a-4702-8308-68363c60c6dc
Nov 29 20:31:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:51 user nova-compute[75356]: DEBUG nova.objects.instance [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lazy-loading 'numa_topology' on Instance uuid 9033b98b-fb6a-4702-8308-68363c60c6dc {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:31:51 user nova-compute[75356]: DEBUG nova.objects.base [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Object Instance<9033b98b-fb6a-4702-8308-68363c60c6dc> lazy-loaded attributes: resources,numa_topology {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:31:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:51 user nova-compute[75356]: INFO nova.compute.manager [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Detaching volume 5fcdf78a-5709-4998-bb2e-cd3b21393f4b
Nov 29 20:31:51 user nova-compute[75356]: INFO nova.virt.block_device [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Attempting to driver detach volume 5fcdf78a-5709-4998-bb2e-cd3b21393f4b from mountpoint /dev/vdb
Nov 29 20:31:51 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Attempting to detach device vdb from instance ee5bef74-04c5-4de1-8f8e-4baba05e2a6d from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:31:51 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:31:51 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:31:51 user nova-compute[75356]:   <source dev="/dev/sdd"/>
Nov 29 20:31:51 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:31:51 user nova-compute[75356]:   <serial>5fcdf78a-5709-4998-bb2e-cd3b21393f4b</serial>
Nov 29 20:31:51 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:31:51 user nova-compute[75356]: </disk>
Nov 29 20:31:51 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:31:52 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Successfully detached device vdb from instance ee5bef74-04c5-4de1-8f8e-4baba05e2a6d from the persistent domain config.
Nov 29 20:31:52 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ee5bef74-04c5-4de1-8f8e-4baba05e2a6d from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:31:52 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:31:52 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:31:52 user nova-compute[75356]:   <source dev="/dev/sdd"/>
Nov 29 20:31:52 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:31:52 user nova-compute[75356]:   <serial>5fcdf78a-5709-4998-bb2e-cd3b21393f4b</serial>
Nov 29 20:31:52 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:31:52 user nova-compute[75356]: </disk>
Nov 29 20:31:52 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:31:52 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:31:52 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:31:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.523s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d5a0938a-ae40-477d-91b2-6572b44b3270 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.980s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:52 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ee5bef74-04c5-4de1-8f8e-4baba05e2a6d {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG nova.objects.instance [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lazy-loading 'flavor' on Instance uuid 4713c9eb-4052-4d65-a4eb-23e62352185a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:31:54 user nova-compute[75356]: INFO nova.compute.manager [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Attaching volume e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 to /dev/vdb
Nov 29 20:31:54 user nova-compute[75356]: DEBUG os_brick.utils [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b911f9e0-30dd-4a38-a2f2-e57b8f61cbb0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0b440c-dd3f-449f-8ce2-df18015eccda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[885bacab-d67b-4832-9ac1-5380f9f3c3cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8755eec-a4d6-45b3-a832-677f73eb1770]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:31:54 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:31:54 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3241c0b-1289-4250-982e-1e556f35cf92]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG os_brick.utils [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Updating existing volume attachment record: e2de8df6-7e05-4335-9495-94d89b3ff80d {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:31:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:31:58 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:31:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:01 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:32:01 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:32:01 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 20:32:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-0b59517a-c467-432a-a73a-d1460c1574e7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:32:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-0b59517a-c467-432a-a73a-d1460c1574e7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:32:01 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:32:01 user nova-compute[75356]: DEBUG nova.objects.instance [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lazy-loading 'info_cache' on Instance uuid 0b59517a-c467-432a-a73a-d1460c1574e7 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:32:01 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Updating instance_info_cache with network_info: [{"id": "56a80963-a1f2-429e-8474-1795928fd05c", "address": "fa:16:3e:74:bd:99", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a80963-a1", "ovs_interfaceid": "56a80963-a1f2-429e-8474-1795928fd05c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:32:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-0b59517a-c467-432a-a73a-d1460c1574e7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:32:01 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KTpAgXbq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:32:02 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:32:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:32:02 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:32:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:32:02 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:32:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[21624af6-bdcd-4a8f-942a-0c47a3d41277]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:32:02 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e5cf3d-95eb-4e92-88cb-ad7d3b78b0a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18] added
Nov 29 20:32:02 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc0c64d-bebd-42e9-a636-181a664e360b]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6daab56-19fc-49de-ace5-6df354c64937]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KTpAgXbq {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KTpAgXbq" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85aaa63-0946-4467-bd95-e825ed0ca514]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KTpAgXbq'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[027c91d5-7ea5-4ff3-b9ac-82c7f4d35383]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2327005-a87e-4143-bc33-debf359500ed]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:32:02 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:32:02 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:32:02 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:32:02 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:32:02 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:32:02 user nova-compute[75356]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:32:02 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:32:02 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:32:02 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:32:02 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:32:02 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:32:02 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:32:02 user nova-compute[75356]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:32:02 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:32:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff384de-1b70-4bd7-857b-fa67ec383951]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18, portal: 172.16.0.220,3260]
Nov 29 20:32:03 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18, portal: 172.16.0.220,3260] successful.
Nov 29 20:32:03 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:32:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d593a2a-ca29-44b4-862b-05e729dc88f8]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:32:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[217d4b5d-af9a-464b-a883-e10a97c79551]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:32:03 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:32:03 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:32:03 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:32:03 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:32:03 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:32:03 user nova-compute[75356]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:32:03 user nova-compute[75356]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 (non-flash)
Nov 29 20:32:03 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:32:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:32:03 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:32:03 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:32:03 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:32:03 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:32:03 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:32:03 user nova-compute[75356]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:32:03 user nova-compute[75356]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 (non-flash)
Nov 29 20:32:03 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:32:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:32:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:32:03 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] HCTL ('38', '-', '-', 0) found on session 37 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:32:03 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:32:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ef0b5c-1d1d-439c-b957-0fcaf0e77590]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:03 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:32:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KTpAgXbq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:32:03 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:32:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:32:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26637333536326663', 'path': '/dev/sdg'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:32:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637333536326663', 'path': '/dev/sdg'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:32:04 user nova-compute[75356]: DEBUG nova.objects.instance [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lazy-loading 'flavor' on Instance uuid 4713c9eb-4052-4d65-a4eb-23e62352185a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:32:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:32:04 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:32:04 user nova-compute[75356]:   <source dev="/dev/sdg"/>
Nov 29 20:32:04 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:32:04 user nova-compute[75356]:   <serial>e4777f60-6a05-4d0c-96bf-1ddee3fa1f18</serial>
Nov 29 20:32:04 user nova-compute[75356]: </disk>
Nov 29 20:32:04 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:32:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:32:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:32:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] No VIF found with MAC fa:16:3e:6d:3e:e2, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:32:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-35030f9a-d17d-44ff-b764-d2a79ce2653d tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.263s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:06 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:32:06 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:32:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:32:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:32:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:06 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:32:06 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:32:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:06 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:32:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:06 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:32:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:32:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c477f425-e9ce-4b3a-b21a-8bf04401ad0b/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c477f425-e9ce-4b3a-b21a-8bf04401ad0b/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c477f425-e9ce-4b3a-b21a-8bf04401ad0b/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c477f425-e9ce-4b3a-b21a-8bf04401ad0b/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:32:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:32:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:32:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:11 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:32:11 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:32:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=6992MB free_disk=24.773590087890625GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:32:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:32:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:32:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Applying migration context for instance 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3 as it has an incoming, in-progress migration 357f69a1-1c25-4514-b15c-a27acae10358. Migration status is finished {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 20:32:11 user nova-compute[75356]: INFO nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Updating resource usage from migration 357f69a1-1c25-4514-b15c-a27acae10358
Nov 29 20:32:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0b59517a-c467-432a-a73a-d1460c1574e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:32:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:32:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance db0826f0-5fdc-47a8-ae36-5059844980c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:32:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:32:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 93183110-d2e2-4da7-ab7d-73378f5e0d42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:32:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:32:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ee5bef74-04c5-4de1-8f8e-4baba05e2a6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:32:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance c3bb4cde-968f-4474-abcd-8dbd73300865 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:32:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance c477f425-e9ce-4b3a-b21a-8bf04401ad0b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:32:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 1e818d19-e8e8-4e41-83b4-53888ea21c93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:32:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4713c9eb-4052-4d65-a4eb-23e62352185a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:32:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 2f1865c9-3202-4162-8949-0ab0f6bc55ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:32:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Migration 357f69a1-1c25-4514-b15c-a27acae10358 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 20:32:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:32:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:32:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:32:11 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:32:11 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:32:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:32:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.585s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:12 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ee5bef74-04c5-4de1-8f8e-4baba05e2a6d is timed out.
Nov 29 20:32:12 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Successfully detached device vdb from instance ee5bef74-04c5-4de1-8f8e-4baba05e2a6d from the live domain config.
Nov 29 20:32:12 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpDYLhsZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:32:12 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:32:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6f6185-4acc-4e88-b28c-02e7f98a0bee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:32:12 user nova-compute[75356]: No targets found.
Nov 29 20:32:12 user nova-compute[75356]: iSNS:
Nov 29 20:32:12 user nova-compute[75356]: No targets found.
Nov 29 20:32:12 user nova-compute[75356]: STATIC:
Nov 29 20:32:12 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09
Nov 29 20:32:12 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:32:12 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:32:12 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18
Nov 29 20:32:12 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:32:12 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:32:12 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460
Nov 29 20:32:12 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:32:12 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:32:12 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054
Nov 29 20:32:12 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:32:12 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:32:12 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b
Nov 29 20:32:12 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:32:12 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:32:12 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8
Nov 29 20:32:12 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:32:12 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:32:12 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955
Nov 29 20:32:12 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:32:12 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:32:12 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:32:12 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:32:12 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:32:12 user nova-compute[75356]: FIRMWARE:
Nov 29 20:32:12 user nova-compute[75356]: No targets found.
Nov 29 20:32:12 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:32:12 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:32:12 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5dc908-ca0d-4b7f-a13b-1716625ffc2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaadbfb7-1e70-4d3d-b168-8dfec19c973a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:32:12 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:32:12 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:32:12 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:32:12 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:32:12 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:32:12 user nova-compute[75356]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:32:12 user nova-compute[75356]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 (non-flash)
Nov 29 20:32:12 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:32:12 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:32:12 user nova-compute[75356]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b (non-flash)
Nov 29 20:32:12 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:32:12 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:32:12 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:32:12 user nova-compute[75356]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:32:12 user nova-compute[75356]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 (non-flash)
Nov 29 20:32:12 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e44a4160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b'): ({'sdd'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Removing single pathed devices sdd {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a4a5d8-2c8f-4e21-b4ee-e4ef068aab28]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36d670d-8082-45d6-926f-19292c7aa1f5]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Flushing IO for device /dev/sdd {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f897dd18-91d4-4e26-ab33-9e3e703bb6e5]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ef3646-782d-4a2f-ac24-38192938edd4]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] SCSI volumes sdd have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57f0155-a24b-42ed-a09b-2d9deb14d382]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b -p 172.16.0.220:3260 --logout" returned: 0 in 0.100s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c7fbfa-b418-46af-b2fb-f8e4ff9728c2]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b, portal: 172.16.0.220,3260]
Nov 29 20:32:12 user nova-compute[75356]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b, portal: 172.16.0.220,3260] successful.
Nov 29 20:32:12 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fcdf78a-5709-4998-bb2e-cd3b21393f4b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe6e97b-4870-430d-8d31-57c1f7d226e2]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] <== disconnect_volume: return (368ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:32:12 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:32:13 user nova-compute[75356]: DEBUG nova.objects.instance [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lazy-loading 'flavor' on Instance uuid ee5bef74-04c5-4de1-8f8e-4baba05e2a6d {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:32:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f64103e1-8277-45c4-87dd-0eae62cbc9e9 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.835s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-6821cfd2-0d2b-4317-9d8c-de6dd62f1bf4 req-6c6df644-f831-46d1-9c6d-b53b24183bb3 service nova] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Received event network-changed-a3f47fc4-3002-416f-bd0f-323855e3c282 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:32:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-6821cfd2-0d2b-4317-9d8c-de6dd62f1bf4 req-6c6df644-f831-46d1-9c6d-b53b24183bb3 service nova] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Refreshing instance network info cache due to event network-changed-a3f47fc4-3002-416f-bd0f-323855e3c282. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:32:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6821cfd2-0d2b-4317-9d8c-de6dd62f1bf4 req-6c6df644-f831-46d1-9c6d-b53b24183bb3 service nova] Acquiring lock "refresh_cache-2f1865c9-3202-4162-8949-0ab0f6bc55ec" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:32:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6821cfd2-0d2b-4317-9d8c-de6dd62f1bf4 req-6c6df644-f831-46d1-9c6d-b53b24183bb3 service nova] Acquired lock "refresh_cache-2f1865c9-3202-4162-8949-0ab0f6bc55ec" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:32:16 user nova-compute[75356]: DEBUG nova.network.neutron [req-6821cfd2-0d2b-4317-9d8c-de6dd62f1bf4 req-6c6df644-f831-46d1-9c6d-b53b24183bb3 service nova] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Refreshing network info cache for port a3f47fc4-3002-416f-bd0f-323855e3c282 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:32:16 user nova-compute[75356]: DEBUG nova.network.neutron [req-6821cfd2-0d2b-4317-9d8c-de6dd62f1bf4 req-6c6df644-f831-46d1-9c6d-b53b24183bb3 service nova] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Updated VIF entry in instance network info cache for port a3f47fc4-3002-416f-bd0f-323855e3c282. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:32:16 user nova-compute[75356]: DEBUG nova.network.neutron [req-6821cfd2-0d2b-4317-9d8c-de6dd62f1bf4 req-6c6df644-f831-46d1-9c6d-b53b24183bb3 service nova] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Updating instance_info_cache with network_info: [{"id": "a3f47fc4-3002-416f-bd0f-323855e3c282", "address": "fa:16:3e:63:20:9b", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f47fc4-30", "ovs_interfaceid": "a3f47fc4-3002-416f-bd0f-323855e3c282", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:32:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6821cfd2-0d2b-4317-9d8c-de6dd62f1bf4 req-6c6df644-f831-46d1-9c6d-b53b24183bb3 service nova] Releasing lock "refresh_cache-2f1865c9-3202-4162-8949-0ab0f6bc55ec" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:32:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "2f1865c9-3202-4162-8949-0ab0f6bc55ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "2f1865c9-3202-4162-8949-0ab0f6bc55ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "2f1865c9-3202-4162-8949-0ab0f6bc55ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "2f1865c9-3202-4162-8949-0ab0f6bc55ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "2f1865c9-3202-4162-8949-0ab0f6bc55ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:18 user nova-compute[75356]: INFO nova.compute.manager [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Terminating instance
Nov 29 20:32:18 user nova-compute[75356]: DEBUG nova.compute.manager [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-23e2cc76-d428-40c8-b01d-eff17a03486c req-7229aa60-f61e-4a54-9538-556d3fd336f4 service nova] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Received event network-vif-unplugged-a3f47fc4-3002-416f-bd0f-323855e3c282 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-23e2cc76-d428-40c8-b01d-eff17a03486c req-7229aa60-f61e-4a54-9538-556d3fd336f4 service nova] Acquiring lock "2f1865c9-3202-4162-8949-0ab0f6bc55ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-23e2cc76-d428-40c8-b01d-eff17a03486c req-7229aa60-f61e-4a54-9538-556d3fd336f4 service nova] Lock "2f1865c9-3202-4162-8949-0ab0f6bc55ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-23e2cc76-d428-40c8-b01d-eff17a03486c req-7229aa60-f61e-4a54-9538-556d3fd336f4 service nova] Lock "2f1865c9-3202-4162-8949-0ab0f6bc55ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-23e2cc76-d428-40c8-b01d-eff17a03486c req-7229aa60-f61e-4a54-9538-556d3fd336f4 service nova] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] No waiting events found dispatching network-vif-unplugged-a3f47fc4-3002-416f-bd0f-323855e3c282 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-23e2cc76-d428-40c8-b01d-eff17a03486c req-7229aa60-f61e-4a54-9538-556d3fd336f4 service nova] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Received event network-vif-unplugged-a3f47fc4-3002-416f-bd0f-323855e3c282 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:32:18 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Instance destroyed successfully.
Nov 29 20:32:18 user nova-compute[75356]: DEBUG nova.objects.instance [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lazy-loading 'resources' on Instance uuid 2f1865c9-3202-4162-8949-0ab0f6bc55ec {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:30:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1540359571',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1540359571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1540359571',id=37,image_ref='5f88f134-243e-4b50-b79f-e4f55465e506',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2215fROAiV0/De9CTyWzAdYd5xhnNpCXPLTNH7OpaK35XZI2YS6r/R0ypOYEte16Le66/v5GQdJTs0POUC9aj/cP/OSQC6duoQEmoOCmGaf11gRjpchp3L57Z1TYtZPg==',key_name='tempest-keypair-1313718759',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:30:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6791b0c999846e2a22d5735f91ea1aa',ramdisk_id='',reservation_id='r-au0os35b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1627976633',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1627976633-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1627976633',owner_user_name='tempest-TestVolumeBootPattern-1627976633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='081b00360a204be3bd6435807283f230',uuid=2f1865c9-3202-4162-8949-0ab0f6bc55ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3f47fc4-3002-416f-bd0f-323855e3c282", "address": "fa:16:3e:63:20:9b", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f47fc4-30", "ovs_interfaceid": "a3f47fc4-3002-416f-bd0f-323855e3c282", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converting VIF {"id": "a3f47fc4-3002-416f-bd0f-323855e3c282", "address": "fa:16:3e:63:20:9b", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f47fc4-30", "ovs_interfaceid": "a3f47fc4-3002-416f-bd0f-323855e3c282", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:20:9b,bridge_name='br-int',has_traffic_filtering=True,id=a3f47fc4-3002-416f-bd0f-323855e3c282,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f47fc4-30') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG os_vif [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:20:9b,bridge_name='br-int',has_traffic_filtering=True,id=a3f47fc4-3002-416f-bd0f-323855e3c282,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f47fc4-30') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3f47fc4-30, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04c1b5a9-53d7-4d4d-a21c-c4873d4d185c) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:18 user nova-compute[75356]: INFO os_vif [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:20:9b,bridge_name='br-int',has_traffic_filtering=True,id=a3f47fc4-3002-416f-bd0f-323855e3c282,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f47fc4-30')
Nov 29 20:32:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcRYNqWi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:32:18 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:32:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc0ba99-d592-45e0-860c-2246bc711dfc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:32:18 user nova-compute[75356]: No targets found.
Nov 29 20:32:18 user nova-compute[75356]: iSNS:
Nov 29 20:32:18 user nova-compute[75356]: No targets found.
Nov 29 20:32:18 user nova-compute[75356]: STATIC:
Nov 29 20:32:18 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09
Nov 29 20:32:18 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:32:18 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:32:18 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18
Nov 29 20:32:18 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:32:18 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:32:18 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460
Nov 29 20:32:18 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:32:18 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:32:18 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054
Nov 29 20:32:18 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:32:18 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:32:18 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8
Nov 29 20:32:18 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:32:18 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:32:18 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955
Nov 29 20:32:18 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:32:18 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:32:18 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:32:18 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:32:18 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:32:18 user nova-compute[75356]: FIRMWARE:
Nov 29 20:32:18 user nova-compute[75356]: No targets found.
Nov 29 20:32:18 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:32:18 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:32:18 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4388f0fd-fa12-41e1-9e31-734d6931317f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[897b841b-3d4e-4e85-86cf-b3eb4df7fb90]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:32:19 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:32:19 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:32:19 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:32:19 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:32:19 user nova-compute[75356]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:32:19 user nova-compute[75356]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 (non-flash)
Nov 29 20:32:19 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:32:19 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:32:19 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:32:19 user nova-compute[75356]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 (non-flash)
Nov 29 20:32:19 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:32:19 user nova-compute[75356]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:32:19 user nova-compute[75356]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 (non-flash)
Nov 29 20:32:19 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e4124af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054'): ({'sde'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Removing single pathed devices sde {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[628da26b-628f-47b7-8606-98350c43db40]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[309b9454-fd46-4142-860f-223a0eb7b857]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Flushing IO for device /dev/sde {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[62062a2b-92c5-4b66-a801-49123c74922d]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[318b69ad-5e83-4fbf-8e1b-5ffcbb15025c]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] SCSI volumes sde have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23730663664356266', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ee101c12', '/dev/disk/by-id/scsi-1SCST_BIOee101c12-70f6d5bfba9ae1fa') {{(pid=86863) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 20:32:19 user nova-compute[75356]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23730663664356266
Nov 29 20:32:19 user nova-compute[75356]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_ee101c12
Nov 29 20:32:19 user nova-compute[75356]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOee101c12-70f6d5bfba9ae1fa
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b23128-2ad0-4159-b0cd-f32fff81281f]: (4, None) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2faed4c-98a1-4c11-ad24-14ffcd0abe85]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf4fa53-bdcc-4e4e-915b-ca3f660fd24c]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054, portal: 172.16.0.220,3260]
Nov 29 20:32:19 user nova-compute[75356]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054, portal: 172.16.0.220,3260] successful.
Nov 29 20:32:19 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ff197dd-1740-48e3-87ff-29c2f748a054 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c022e5f-6d60-4fc7-99ed-2b725a5e198e]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] <== disconnect_volume: return (343ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:32:19 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Deleting instance files /opt/stack/data/nova/instances/2f1865c9-3202-4162-8949-0ab0f6bc55ec_del
Nov 29 20:32:19 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Deletion of /opt/stack/data/nova/instances/2f1865c9-3202-4162-8949-0ab0f6bc55ec_del complete
Nov 29 20:32:19 user nova-compute[75356]: INFO nova.compute.manager [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 29 20:32:19 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:32:19 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:32:19 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Took 0.63 seconds to deallocate network for instance.
Nov 29 20:32:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-da5f490a-4e6e-41a8-9a55-444fcd74037d req-01d86620-9b04-481c-b23f-14a3cd93c55c service nova] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Received event network-vif-deleted-a3f47fc4-3002-416f-bd0f-323855e3c282 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:32:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-9980bc23-78e0-41e1-879d-e94d88d6f6df req-88cb1719-c8b1-42f3-b07b-c3a8900a885b service nova] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Received event network-vif-plugged-a3f47fc4-3002-416f-bd0f-323855e3c282 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:32:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9980bc23-78e0-41e1-879d-e94d88d6f6df req-88cb1719-c8b1-42f3-b07b-c3a8900a885b service nova] Acquiring lock "2f1865c9-3202-4162-8949-0ab0f6bc55ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:32:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9980bc23-78e0-41e1-879d-e94d88d6f6df req-88cb1719-c8b1-42f3-b07b-c3a8900a885b service nova] Lock "2f1865c9-3202-4162-8949-0ab0f6bc55ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:32:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9980bc23-78e0-41e1-879d-e94d88d6f6df req-88cb1719-c8b1-42f3-b07b-c3a8900a885b service nova] Lock "2f1865c9-3202-4162-8949-0ab0f6bc55ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-9980bc23-78e0-41e1-879d-e94d88d6f6df req-88cb1719-c8b1-42f3-b07b-c3a8900a885b service nova] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] No waiting events found dispatching network-vif-plugged-a3f47fc4-3002-416f-bd0f-323855e3c282 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:32:20 user nova-compute[75356]: WARNING nova.compute.manager [req-9980bc23-78e0-41e1-879d-e94d88d6f6df req-88cb1719-c8b1-42f3-b07b-c3a8900a885b service nova] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Received unexpected event network-vif-plugged-a3f47fc4-3002-416f-bd0f-323855e3c282 for instance with vm_state active and task_state deleting.
Nov 29 20:32:21 user nova-compute[75356]: INFO nova.compute.manager [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Took 1.29 seconds to detach 1 volumes for instance.
Nov 29 20:32:21 user nova-compute[75356]: DEBUG nova.compute.manager [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 2f1865c9-3202-4162-8949-0ab0f6bc55ec] Deleting volume: 9ff197dd-1740-48e3-87ff-29c2f748a054 {{(pid=75356) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 20:32:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:32:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:32:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:32:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:32:21 user nova-compute[75356]: INFO nova.compute.manager [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Detaching volume e4777f60-6a05-4d0c-96bf-1ddee3fa1f18
Nov 29 20:32:21 user nova-compute[75356]: INFO nova.virt.block_device [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Attempting to driver detach volume e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 from mountpoint /dev/vdb
Nov 29 20:32:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Attempting to detach device vdb from instance 4713c9eb-4052-4d65-a4eb-23e62352185a from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:32:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:32:21 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:32:21 user nova-compute[75356]:   <source dev="/dev/sdg"/>
Nov 29 20:32:21 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:32:21 user nova-compute[75356]:   <serial>e4777f60-6a05-4d0c-96bf-1ddee3fa1f18</serial>
Nov 29 20:32:21 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:32:21 user nova-compute[75356]: </disk>
Nov 29 20:32:21 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:32:21 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Successfully detached device vdb from instance 4713c9eb-4052-4d65-a4eb-23e62352185a from the persistent domain config.
Nov 29 20:32:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4713c9eb-4052-4d65-a4eb-23e62352185a from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:32:21 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:32:21 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:32:21 user nova-compute[75356]:   <source dev="/dev/sdg"/>
Nov 29 20:32:21 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:32:21 user nova-compute[75356]:   <serial>e4777f60-6a05-4d0c-96bf-1ddee3fa1f18</serial>
Nov 29 20:32:21 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:32:21 user nova-compute[75356]: </disk>
Nov 29 20:32:21 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:32:21 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:32:21 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:32:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:21 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Deleted allocations for instance 2f1865c9-3202-4162-8949-0ab0f6bc55ec
Nov 29 20:32:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-89debead-49ed-4ea0-bc5a-a7229024d4be tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "2f1865c9-3202-4162-8949-0ab0f6bc55ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.832s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5273fc0b-98f1-4806-a5f1-1acc90f67d19 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:32:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5273fc0b-98f1-4806-a5f1-1acc90f67d19 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:32:22 user nova-compute[75356]: DEBUG nova.compute.manager [None req-5273fc0b-98f1-4806-a5f1-1acc90f67d19 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Going to confirm migration 2 {{(pid=75356) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 29 20:32:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4713c9eb-4052-4d65-a4eb-23e62352185a {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:32:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5273fc0b-98f1-4806-a5f1-1acc90f67d19 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "refresh_cache-873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:32:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5273fc0b-98f1-4806-a5f1-1acc90f67d19 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquired lock "refresh_cache-873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:32:22 user nova-compute[75356]: DEBUG nova.network.neutron [None req-5273fc0b-98f1-4806-a5f1-1acc90f67d19 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:32:22 user nova-compute[75356]: DEBUG nova.objects.instance [None req-5273fc0b-98f1-4806-a5f1-1acc90f67d19 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lazy-loading 'info_cache' on Instance uuid 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:32:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:22 user nova-compute[75356]: DEBUG nova.network.neutron [None req-5273fc0b-98f1-4806-a5f1-1acc90f67d19 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Updating instance_info_cache with network_info: [{"id": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "address": "fa:16:3e:ed:a6:4a", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c2f7e-7d", "ovs_interfaceid": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:32:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5273fc0b-98f1-4806-a5f1-1acc90f67d19 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Releasing lock "refresh_cache-873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:32:22 user nova-compute[75356]: DEBUG nova.objects.instance [None req-5273fc0b-98f1-4806-a5f1-1acc90f67d19 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lazy-loading 'migration_context' on Instance uuid 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:32:22 user nova-compute[75356]: DEBUG nova.objects.base [None req-5273fc0b-98f1-4806-a5f1-1acc90f67d19 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Object Instance<873a45a7-a06f-4bcd-b517-d6f0ade7e5a3> lazy-loaded attributes: info_cache,migration_context {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:32:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5273fc0b-98f1-4806-a5f1-1acc90f67d19 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:32:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5273fc0b-98f1-4806-a5f1-1acc90f67d19 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:32:23 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-5273fc0b-98f1-4806-a5f1-1acc90f67d19 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:32:23 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-5273fc0b-98f1-4806-a5f1-1acc90f67d19 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:32:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5273fc0b-98f1-4806-a5f1-1acc90f67d19 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.423s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:23 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-5273fc0b-98f1-4806-a5f1-1acc90f67d19 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Deleted allocation for migration 357f69a1-1c25-4514-b15c-a27acae10358
Nov 29 20:32:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-5273fc0b-98f1-4806-a5f1-1acc90f67d19 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.337s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:34 user nova-compute[75356]: INFO nova.compute.manager [None req-b32f9ccc-4533-4693-91f3-bb568303a5ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Unrescuing
Nov 29 20:32:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b32f9ccc-4533-4693-91f3-bb568303a5ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "refresh_cache-c477f425-e9ce-4b3a-b21a-8bf04401ad0b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:32:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b32f9ccc-4533-4693-91f3-bb568303a5ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquired lock "refresh_cache-c477f425-e9ce-4b3a-b21a-8bf04401ad0b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:32:34 user nova-compute[75356]: DEBUG nova.network.neutron [None req-b32f9ccc-4533-4693-91f3-bb568303a5ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:32:34 user nova-compute[75356]: DEBUG nova.network.neutron [None req-b32f9ccc-4533-4693-91f3-bb568303a5ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Updating instance_info_cache with network_info: [{"id": "084eeeb2-bcff-437d-ac75-85936e641045", "address": "fa:16:3e:a1:86:c2", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084eeeb2-bc", "ovs_interfaceid": "084eeeb2-bcff-437d-ac75-85936e641045", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:32:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b32f9ccc-4533-4693-91f3-bb568303a5ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Releasing lock "refresh_cache-c477f425-e9ce-4b3a-b21a-8bf04401ad0b" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:32:34 user nova-compute[75356]: DEBUG nova.objects.instance [None req-b32f9ccc-4533-4693-91f3-bb568303a5ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lazy-loading 'flavor' on Instance uuid c477f425-e9ce-4b3a-b21a-8bf04401ad0b {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:32:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:34 user nova-compute[75356]: DEBUG nova.compute.manager [req-c4e8d12c-bb9f-44d2-9b66-0d05566a7c8a req-f425aa8e-7970-4cc3-9ad2-1b4e7c9c061c service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received event network-vif-unplugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:32:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c4e8d12c-bb9f-44d2-9b66-0d05566a7c8a req-f425aa8e-7970-4cc3-9ad2-1b4e7c9c061c service nova] Acquiring lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:32:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c4e8d12c-bb9f-44d2-9b66-0d05566a7c8a req-f425aa8e-7970-4cc3-9ad2-1b4e7c9c061c service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:32:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c4e8d12c-bb9f-44d2-9b66-0d05566a7c8a req-f425aa8e-7970-4cc3-9ad2-1b4e7c9c061c service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:34 user nova-compute[75356]: DEBUG nova.compute.manager [req-c4e8d12c-bb9f-44d2-9b66-0d05566a7c8a req-f425aa8e-7970-4cc3-9ad2-1b4e7c9c061c service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] No waiting events found dispatching network-vif-unplugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:32:34 user nova-compute[75356]: WARNING nova.compute.manager [req-c4e8d12c-bb9f-44d2-9b66-0d05566a7c8a req-f425aa8e-7970-4cc3-9ad2-1b4e7c9c061c service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received unexpected event network-vif-unplugged-084eeeb2-bcff-437d-ac75-85936e641045 for instance with vm_state rescued and task_state unrescuing.
Nov 29 20:32:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:35 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Instance destroyed successfully.
Nov 29 20:32:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:36 user nova-compute[75356]: DEBUG nova.compute.manager [req-f05696d4-bc75-4a17-8cbd-e125970ebf0b req-ba9ed15c-42f8-4dd9-a521-a554c3cf4878 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:32:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f05696d4-bc75-4a17-8cbd-e125970ebf0b req-ba9ed15c-42f8-4dd9-a521-a554c3cf4878 service nova] Acquiring lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:32:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f05696d4-bc75-4a17-8cbd-e125970ebf0b req-ba9ed15c-42f8-4dd9-a521-a554c3cf4878 service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:32:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f05696d4-bc75-4a17-8cbd-e125970ebf0b req-ba9ed15c-42f8-4dd9-a521-a554c3cf4878 service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:36 user nova-compute[75356]: DEBUG nova.compute.manager [req-f05696d4-bc75-4a17-8cbd-e125970ebf0b req-ba9ed15c-42f8-4dd9-a521-a554c3cf4878 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] No waiting events found dispatching network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:32:36 user nova-compute[75356]: WARNING nova.compute.manager [req-f05696d4-bc75-4a17-8cbd-e125970ebf0b req-ba9ed15c-42f8-4dd9-a521-a554c3cf4878 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received unexpected event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 for instance with vm_state rescued and task_state unrescuing.
Nov 29 20:32:36 user nova-compute[75356]: DEBUG nova.compute.manager [req-f05696d4-bc75-4a17-8cbd-e125970ebf0b req-ba9ed15c-42f8-4dd9-a521-a554c3cf4878 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:32:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f05696d4-bc75-4a17-8cbd-e125970ebf0b req-ba9ed15c-42f8-4dd9-a521-a554c3cf4878 service nova] Acquiring lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:32:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f05696d4-bc75-4a17-8cbd-e125970ebf0b req-ba9ed15c-42f8-4dd9-a521-a554c3cf4878 service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:32:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f05696d4-bc75-4a17-8cbd-e125970ebf0b req-ba9ed15c-42f8-4dd9-a521-a554c3cf4878 service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:36 user nova-compute[75356]: DEBUG nova.compute.manager [req-f05696d4-bc75-4a17-8cbd-e125970ebf0b req-ba9ed15c-42f8-4dd9-a521-a554c3cf4878 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] No waiting events found dispatching network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:32:36 user nova-compute[75356]: WARNING nova.compute.manager [req-f05696d4-bc75-4a17-8cbd-e125970ebf0b req-ba9ed15c-42f8-4dd9-a521-a554c3cf4878 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received unexpected event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 for instance with vm_state rescued and task_state unrescuing.
Nov 29 20:32:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:38 user nova-compute[75356]: DEBUG nova.compute.manager [None req-b32f9ccc-4533-4693-91f3-bb568303a5ff tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:32:38 user nova-compute[75356]: DEBUG nova.compute.manager [req-fd5b5d32-b808-4d64-86b4-466b03ecbb92 req-3dcfa8ed-b795-4bac-ad27-934b20aef636 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:32:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-fd5b5d32-b808-4d64-86b4-466b03ecbb92 req-3dcfa8ed-b795-4bac-ad27-934b20aef636 service nova] Acquiring lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:32:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-fd5b5d32-b808-4d64-86b4-466b03ecbb92 req-3dcfa8ed-b795-4bac-ad27-934b20aef636 service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:32:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-fd5b5d32-b808-4d64-86b4-466b03ecbb92 req-3dcfa8ed-b795-4bac-ad27-934b20aef636 service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:38 user nova-compute[75356]: DEBUG nova.compute.manager [req-fd5b5d32-b808-4d64-86b4-466b03ecbb92 req-3dcfa8ed-b795-4bac-ad27-934b20aef636 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] No waiting events found dispatching network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:32:38 user nova-compute[75356]: WARNING nova.compute.manager [req-fd5b5d32-b808-4d64-86b4-466b03ecbb92 req-3dcfa8ed-b795-4bac-ad27-934b20aef636 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received unexpected event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 for instance with vm_state active and task_state None.
Nov 29 20:32:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:42 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4713c9eb-4052-4d65-a4eb-23e62352185a is timed out.
Nov 29 20:32:42 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Successfully detached device vdb from instance 4713c9eb-4052-4d65-a4eb-23e62352185a from the live domain config.
Nov 29 20:32:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KTpAgXbq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:32:42 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:32:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b798ef-e188-4cf7-b803-218bdf192d8d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:32:42 user nova-compute[75356]: No targets found.
Nov 29 20:32:42 user nova-compute[75356]: iSNS:
Nov 29 20:32:42 user nova-compute[75356]: No targets found.
Nov 29 20:32:42 user nova-compute[75356]: STATIC:
Nov 29 20:32:42 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09
Nov 29 20:32:42 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:32:42 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:32:42 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18
Nov 29 20:32:42 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:32:42 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:32:42 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460
Nov 29 20:32:42 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:32:42 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:32:42 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8
Nov 29 20:32:42 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:32:42 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:32:42 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955
Nov 29 20:32:42 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:32:42 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:32:42 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:32:42 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:32:42 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:32:42 user nova-compute[75356]: FIRMWARE:
Nov 29 20:32:42 user nova-compute[75356]: No targets found.
Nov 29 20:32:42 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:32:42 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:32:42 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ca320f-e390-4e62-947a-4e435e486d06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d899d469-845f-45a7-b98f-aff76bbc3423]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:32:42 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:32:42 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:32:42 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:32:42 user nova-compute[75356]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:32:42 user nova-compute[75356]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 (non-flash)
Nov 29 20:32:42 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:32:42 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:32:42 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:32:42 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:32:42 user nova-compute[75356]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:32:42 user nova-compute[75356]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 (non-flash)
Nov 29 20:32:42 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e44e04c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18'): ({'sdg'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Removing single pathed devices sdg {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de50a82-3924-408e-a19d-b9a2f85a9656]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:42 user nova-compute[75356]: INFO nova.compute.manager [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Terminating instance
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6414ad59-0a12-4a8c-b8a3-6d3a0dad123b]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Flushing IO for device /dev/sdg {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG nova.compute.manager [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[17153ea4-6eac-40b8-bbb5-c92cc9fbd847]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.055s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b51173e-10b5-4477-b718-260f17503d53]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] SCSI volumes sdg have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[857b31db-5d0d-45f4-8980-f4f9f6314f0a]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4be7593-194e-4ce3-a554-887223843fa5]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18, portal: 172.16.0.220,3260]
Nov 29 20:32:42 user nova-compute[75356]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18, portal: 172.16.0.220,3260] successful.
Nov 29 20:32:42 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4777f60-6a05-4d0c-96bf-1ddee3fa1f18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be2b4c2-2547-4b96-9e62-1f765ffa9544]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] <== disconnect_volume: return (380ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG nova.compute.manager [req-35323fbc-ba7b-41d6-be0e-2a00d524bf1d req-545090e2-91f8-463c-bc0c-a78d0a69befd service nova] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Received event network-vif-unplugged-8356e667-97df-4ba5-9f55-ed78fd4f4736 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-35323fbc-ba7b-41d6-be0e-2a00d524bf1d req-545090e2-91f8-463c-bc0c-a78d0a69befd service nova] Acquiring lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-35323fbc-ba7b-41d6-be0e-2a00d524bf1d req-545090e2-91f8-463c-bc0c-a78d0a69befd service nova] Lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-35323fbc-ba7b-41d6-be0e-2a00d524bf1d req-545090e2-91f8-463c-bc0c-a78d0a69befd service nova] Lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG nova.compute.manager [req-35323fbc-ba7b-41d6-be0e-2a00d524bf1d req-545090e2-91f8-463c-bc0c-a78d0a69befd service nova] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] No waiting events found dispatching network-vif-unplugged-8356e667-97df-4ba5-9f55-ed78fd4f4736 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG nova.compute.manager [req-35323fbc-ba7b-41d6-be0e-2a00d524bf1d req-545090e2-91f8-463c-bc0c-a78d0a69befd service nova] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Received event network-vif-unplugged-8356e667-97df-4ba5-9f55-ed78fd4f4736 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:32:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:43 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Instance destroyed successfully.
Nov 29 20:32:43 user nova-compute[75356]: DEBUG nova.objects.instance [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lazy-loading 'resources' on Instance uuid ee5bef74-04c5-4de1-8f8e-4baba05e2a6d {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:32:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:26:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1106581222',display_name='tempest-AttachVolumeNegativeTest-server-1106581222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1106581222',id=28,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrClDax9w/BZQtjtEMfxBjEFdbLgotDQbxwxKbfhEGLpZlUzTX5Y1WIF+iYbGM9fPZvzjUYX81Z5kzYFI32po2s3igv/rUV3xMR7WLOiFtqRTmxBLI8we7T6MblZBEx2g==',key_name='tempest-keypair-526946861',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:26:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='076539532d4847719e7fcf4165872bbe',ramdisk_id='',reservation_id='r-maaq534h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1182074567',owner_user_name='tempest-AttachVolumeNegativeTest-1182074567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:26:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbdba4f436df4dbb896258c4f4d6b180',uuid=ee5bef74-04c5-4de1-8f8e-4baba05e2a6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8356e667-97df-4ba5-9f55-ed78fd4f4736", "address": "fa:16:3e:1d:8d:b3", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8356e667-97", "ovs_interfaceid": "8356e667-97df-4ba5-9f55-ed78fd4f4736", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:32:43 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converting VIF {"id": "8356e667-97df-4ba5-9f55-ed78fd4f4736", "address": "fa:16:3e:1d:8d:b3", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8356e667-97", "ovs_interfaceid": "8356e667-97df-4ba5-9f55-ed78fd4f4736", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:32:43 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:8d:b3,bridge_name='br-int',has_traffic_filtering=True,id=8356e667-97df-4ba5-9f55-ed78fd4f4736,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8356e667-97') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:32:43 user nova-compute[75356]: DEBUG os_vif [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:8d:b3,bridge_name='br-int',has_traffic_filtering=True,id=8356e667-97df-4ba5-9f55-ed78fd4f4736,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8356e667-97') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:32:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8356e667-97, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:32:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:32:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2ad7960-7d3d-4d9e-8f03-b3a4941c51c9) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:32:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:32:43 user nova-compute[75356]: INFO os_vif [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:8d:b3,bridge_name='br-int',has_traffic_filtering=True,id=8356e667-97df-4ba5-9f55-ed78fd4f4736,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8356e667-97')
Nov 29 20:32:43 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Deleting instance files /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d_del
Nov 29 20:32:43 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Deletion of /opt/stack/data/nova/instances/ee5bef74-04c5-4de1-8f8e-4baba05e2a6d_del complete
Nov 29 20:32:43 user nova-compute[75356]: INFO nova.compute.manager [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 29 20:32:43 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:32:43 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:32:43 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:32:43 user nova-compute[75356]: DEBUG nova.objects.instance [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lazy-loading 'flavor' on Instance uuid 4713c9eb-4052-4d65-a4eb-23e62352185a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:32:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-26250c96-35c6-4042-8ece-cbc4c41453fc tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.915s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:44 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:32:44 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Took 0.85 seconds to deallocate network for instance.
Nov 29 20:32:44 user nova-compute[75356]: DEBUG nova.compute.manager [req-bbb0320a-deb3-43a0-87cd-60239634b8e0 req-e019d9d2-2da2-4107-acb6-707d8314c494 service nova] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Received event network-vif-deleted-8356e667-97df-4ba5-9f55-ed78fd4f4736 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:32:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:32:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:32:44 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:32:44 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:32:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:44 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Deleted allocations for instance ee5bef74-04c5-4de1-8f8e-4baba05e2a6d
Nov 29 20:32:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-36e48ba3-6007-4d6a-b9b8-152f1664cd4e tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.414s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:44 user nova-compute[75356]: DEBUG nova.compute.manager [req-a1c8917e-7024-44ea-b906-d1b881d9c113 req-befd8022-dc31-4a5a-8675-39b1a352cfce service nova] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Received event network-vif-plugged-8356e667-97df-4ba5-9f55-ed78fd4f4736 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:32:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a1c8917e-7024-44ea-b906-d1b881d9c113 req-befd8022-dc31-4a5a-8675-39b1a352cfce service nova] Acquiring lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:32:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a1c8917e-7024-44ea-b906-d1b881d9c113 req-befd8022-dc31-4a5a-8675-39b1a352cfce service nova] Lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:32:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a1c8917e-7024-44ea-b906-d1b881d9c113 req-befd8022-dc31-4a5a-8675-39b1a352cfce service nova] Lock "ee5bef74-04c5-4de1-8f8e-4baba05e2a6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:44 user nova-compute[75356]: DEBUG nova.compute.manager [req-a1c8917e-7024-44ea-b906-d1b881d9c113 req-befd8022-dc31-4a5a-8675-39b1a352cfce service nova] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] No waiting events found dispatching network-vif-plugged-8356e667-97df-4ba5-9f55-ed78fd4f4736 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:32:44 user nova-compute[75356]: WARNING nova.compute.manager [req-a1c8917e-7024-44ea-b906-d1b881d9c113 req-befd8022-dc31-4a5a-8675-39b1a352cfce service nova] [instance: ee5bef74-04c5-4de1-8f8e-4baba05e2a6d] Received unexpected event network-vif-plugged-8356e667-97df-4ba5-9f55-ed78fd4f4736 for instance with vm_state deleted and task_state None.
Nov 29 20:32:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:32:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:32:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:32:58 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:32:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:32:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:32:58 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:32:58 user nova-compute[75356]: INFO nova.compute.claims [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Claim successful on node user
Nov 29 20:32:58 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:32:58 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:32:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:59 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:32:59 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:32:59 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:32:59 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:32:59 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:32:59 user nova-compute[75356]: DEBUG nova.policy [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00cdfe6527e04f049b5e38685bc1f257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34dff0986b1d47fdaf305c87e323d19e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:32:59 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:32:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:32:59 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Creating image(s)
Nov 29 20:32:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:32:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "/opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:32:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "/opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.182s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:32:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:32:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.173s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:32:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk 1073741824" returned: 0 in 0.053s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:32:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:32:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:00 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Successfully created port: c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:33:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.178s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:00 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:33:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:00 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:33:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:00 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Cannot resize image /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:33:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:33:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Ensure instance console log exists: /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:33:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:00 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Successfully updated port: c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:33:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "refresh_cache-bf850b0d-88b6-4ec3-b3eb-df6195be2945" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:33:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquired lock "refresh_cache-bf850b0d-88b6-4ec3-b3eb-df6195be2945" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:33:00 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:33:00 user nova-compute[75356]: DEBUG nova.compute.manager [req-98aa7f03-24d1-437a-b267-7ea26632e6c6 req-7e7d3190-a1ad-47b6-9581-628171b13fee service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received event network-changed-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:33:00 user nova-compute[75356]: DEBUG nova.compute.manager [req-98aa7f03-24d1-437a-b267-7ea26632e6c6 req-7e7d3190-a1ad-47b6-9581-628171b13fee service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Refreshing instance network info cache due to event network-changed-c68da58a-baf1-4054-8d8c-d0736ec173a5. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:33:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-98aa7f03-24d1-437a-b267-7ea26632e6c6 req-7e7d3190-a1ad-47b6-9581-628171b13fee service nova] Acquiring lock "refresh_cache-bf850b0d-88b6-4ec3-b3eb-df6195be2945" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:33:00 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.network.neutron [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Updating instance_info_cache with network_info: [{"id": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "address": "fa:16:3e:57:b8:2a", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68da58a-ba", "ovs_interfaceid": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Releasing lock "refresh_cache-bf850b0d-88b6-4ec3-b3eb-df6195be2945" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Instance network_info: |[{"id": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "address": "fa:16:3e:57:b8:2a", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68da58a-ba", "ovs_interfaceid": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-98aa7f03-24d1-437a-b267-7ea26632e6c6 req-7e7d3190-a1ad-47b6-9581-628171b13fee service nova] Acquired lock "refresh_cache-bf850b0d-88b6-4ec3-b3eb-df6195be2945" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.network.neutron [req-98aa7f03-24d1-437a-b267-7ea26632e6c6 req-7e7d3190-a1ad-47b6-9581-628171b13fee service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Refreshing network info cache for port c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Start _get_guest_xml network_info=[{"id": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "address": "fa:16:3e:57:b8:2a", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68da58a-ba", "ovs_interfaceid": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:33:01 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:33:01 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:32:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1279500512',display_name='tempest-ServerRescueNegativeTestJSON-server-1279500512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1279500512',id=38,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF11C4US8gSibeaQM27SECgiQU3I/sB2B86cuWv8uvblsz8cGE+2M7ux0RHT1RkjaiHOFsNsN1i6QktVOsaM1fhYGGMYME9YUYb7wz5LFi1TSv4w9oVpMrtHeAYjjVJ7wQ==',key_name='tempest-keypair-897338036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34dff0986b1d47fdaf305c87e323d19e',ramdisk_id='',reservation_id='r-3fuhqa8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1204717931',owner_user_name='tempest-ServerRescueNegativeTestJSON-1204717931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:32:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00cdfe6527e04f049b5e38685bc1f257',uuid=bf850b0d-88b6-4ec3-b3eb-df6195be2945,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "address": "fa:16:3e:57:b8:2a", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68da58a-ba", "ovs_interfaceid": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converting VIF {"id": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "address": "fa:16:3e:57:b8:2a", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68da58a-ba", "ovs_interfaceid": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:b8:2a,bridge_name='br-int',has_traffic_filtering=True,id=c68da58a-baf1-4054-8d8c-d0736ec173a5,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc68da58a-ba') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.objects.instance [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'pci_devices' on Instance uuid bf850b0d-88b6-4ec3-b3eb-df6195be2945 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:33:01 user nova-compute[75356]:   <uuid>bf850b0d-88b6-4ec3-b3eb-df6195be2945</uuid>
Nov 29 20:33:01 user nova-compute[75356]:   <name>instance-00000026</name>
Nov 29 20:33:01 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:33:01 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:33:01 user nova-compute[75356]:   <metadata>
Nov 29 20:33:01 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:33:01 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:33:01 user nova-compute[75356]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1279500512</nova:name>
Nov 29 20:33:01 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:33:01</nova:creationTime>
Nov 29 20:33:01 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:33:01 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:33:01 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:33:01 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:33:01 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:33:01 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:33:01 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:33:01 user nova-compute[75356]:       <nova:owner>
Nov 29 20:33:01 user nova-compute[75356]:         <nova:user uuid="00cdfe6527e04f049b5e38685bc1f257">tempest-ServerRescueNegativeTestJSON-1204717931-project-member</nova:user>
Nov 29 20:33:01 user nova-compute[75356]:         <nova:project uuid="34dff0986b1d47fdaf305c87e323d19e">tempest-ServerRescueNegativeTestJSON-1204717931</nova:project>
Nov 29 20:33:01 user nova-compute[75356]:       </nova:owner>
Nov 29 20:33:01 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:33:01 user nova-compute[75356]:       <nova:ports>
Nov 29 20:33:01 user nova-compute[75356]:         <nova:port uuid="c68da58a-baf1-4054-8d8c-d0736ec173a5">
Nov 29 20:33:01 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 20:33:01 user nova-compute[75356]:         </nova:port>
Nov 29 20:33:01 user nova-compute[75356]:       </nova:ports>
Nov 29 20:33:01 user nova-compute[75356]:     </nova:instance>
Nov 29 20:33:01 user nova-compute[75356]:   </metadata>
Nov 29 20:33:01 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:33:01 user nova-compute[75356]:     <system>
Nov 29 20:33:01 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:33:01 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:33:01 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:33:01 user nova-compute[75356]:       <entry name="serial">bf850b0d-88b6-4ec3-b3eb-df6195be2945</entry>
Nov 29 20:33:01 user nova-compute[75356]:       <entry name="uuid">bf850b0d-88b6-4ec3-b3eb-df6195be2945</entry>
Nov 29 20:33:01 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:33:01 user nova-compute[75356]:     </system>
Nov 29 20:33:01 user nova-compute[75356]:   </sysinfo>
Nov 29 20:33:01 user nova-compute[75356]:   <os>
Nov 29 20:33:01 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:33:01 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:33:01 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:33:01 user nova-compute[75356]:   </os>
Nov 29 20:33:01 user nova-compute[75356]:   <features>
Nov 29 20:33:01 user nova-compute[75356]:     <acpi/>
Nov 29 20:33:01 user nova-compute[75356]:     <apic/>
Nov 29 20:33:01 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:33:01 user nova-compute[75356]:   </features>
Nov 29 20:33:01 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:33:01 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:33:01 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:33:01 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:33:01 user nova-compute[75356]:   </clock>
Nov 29 20:33:01 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:33:01 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:33:01 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:33:01 user nova-compute[75356]:   </cpu>
Nov 29 20:33:01 user nova-compute[75356]:   <devices>
Nov 29 20:33:01 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:33:01 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:33:01 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk"/>
Nov 29 20:33:01 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:33:01 user nova-compute[75356]:     </disk>
Nov 29 20:33:01 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:33:01 user nova-compute[75356]:       <mac address="fa:16:3e:57:b8:2a"/>
Nov 29 20:33:01 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:33:01 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:33:01 user nova-compute[75356]:       <target dev="tapc68da58a-ba"/>
Nov 29 20:33:01 user nova-compute[75356]:     </interface>
Nov 29 20:33:01 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:33:01 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/console.log" append="off"/>
Nov 29 20:33:01 user nova-compute[75356]:     </serial>
Nov 29 20:33:01 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:33:01 user nova-compute[75356]:     <video>
Nov 29 20:33:01 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:33:01 user nova-compute[75356]:     </video>
Nov 29 20:33:01 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:33:01 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:33:01 user nova-compute[75356]:     </rng>
Nov 29 20:33:01 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:33:01 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:33:01 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:33:01 user nova-compute[75356]:     </memballoon>
Nov 29 20:33:01 user nova-compute[75356]:   </devices>
Nov 29 20:33:01 user nova-compute[75356]: </domain>
Nov 29 20:33:01 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:32:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1279500512',display_name='tempest-ServerRescueNegativeTestJSON-server-1279500512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1279500512',id=38,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF11C4US8gSibeaQM27SECgiQU3I/sB2B86cuWv8uvblsz8cGE+2M7ux0RHT1RkjaiHOFsNsN1i6QktVOsaM1fhYGGMYME9YUYb7wz5LFi1TSv4w9oVpMrtHeAYjjVJ7wQ==',key_name='tempest-keypair-897338036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34dff0986b1d47fdaf305c87e323d19e',ramdisk_id='',reservation_id='r-3fuhqa8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1204717931',owner_user_name='tempest-ServerRescueNegativeTestJSON-1204717931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:32:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00cdfe6527e04f049b5e38685bc1f257',uuid=bf850b0d-88b6-4ec3-b3eb-df6195be2945,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "address": "fa:16:3e:57:b8:2a", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68da58a-ba", "ovs_interfaceid": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converting VIF {"id": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "address": "fa:16:3e:57:b8:2a", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68da58a-ba", "ovs_interfaceid": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:b8:2a,bridge_name='br-int',has_traffic_filtering=True,id=c68da58a-baf1-4054-8d8c-d0736ec173a5,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc68da58a-ba') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG os_vif [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:b8:2a,bridge_name='br-int',has_traffic_filtering=True,id=c68da58a-baf1-4054-8d8c-d0736ec173a5,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc68da58a-ba') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21050286-590e-5277-b15b-1c2843522b41', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc68da58a-ba, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc68da58a-ba, col_values=(('qos', UUID('4393cd68-62b5-4056-99ae-f8c3409fed99')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc68da58a-ba, col_values=(('external_ids', {'iface-id': 'c68da58a-baf1-4054-8d8c-d0736ec173a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:b8:2a', 'vm-uuid': 'bf850b0d-88b6-4ec3-b3eb-df6195be2945'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:01 user nova-compute[75356]: INFO os_vif [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:b8:2a,bridge_name='br-int',has_traffic_filtering=True,id=c68da58a-baf1-4054-8d8c-d0736ec173a5,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc68da58a-ba')
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] No VIF found with MAC fa:16:3e:57:b8:2a, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.network.neutron [req-98aa7f03-24d1-437a-b267-7ea26632e6c6 req-7e7d3190-a1ad-47b6-9581-628171b13fee service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Updated VIF entry in instance network info cache for port c68da58a-baf1-4054-8d8c-d0736ec173a5. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG nova.network.neutron [req-98aa7f03-24d1-437a-b267-7ea26632e6c6 req-7e7d3190-a1ad-47b6-9581-628171b13fee service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Updating instance_info_cache with network_info: [{"id": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "address": "fa:16:3e:57:b8:2a", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68da58a-ba", "ovs_interfaceid": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:33:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-98aa7f03-24d1-437a-b267-7ea26632e6c6 req-7e7d3190-a1ad-47b6-9581-628171b13fee service nova] Releasing lock "refresh_cache-bf850b0d-88b6-4ec3-b3eb-df6195be2945" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:33:02 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:33:02 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:33:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:33:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:33:02 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:33:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:02 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Updating instance_info_cache with network_info: [{"id": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "address": "fa:16:3e:6b:b2:4e", "network": {"id": "27a8d395-36c8-4f27-89cf-f5019ccbf9a2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45448e5cb4e84c14b1114846a6ccbdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ec4756-3f", "ovs_interfaceid": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:33:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:33:02 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:33:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-529971f8-1ea1-4a9c-8c2a-0bc443418478 req-5fe72a5b-b6c5-46e0-8443-13968c81c190 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received event network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:33:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-529971f8-1ea1-4a9c-8c2a-0bc443418478 req-5fe72a5b-b6c5-46e0-8443-13968c81c190 service nova] Acquiring lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-529971f8-1ea1-4a9c-8c2a-0bc443418478 req-5fe72a5b-b6c5-46e0-8443-13968c81c190 service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-529971f8-1ea1-4a9c-8c2a-0bc443418478 req-5fe72a5b-b6c5-46e0-8443-13968c81c190 service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-529971f8-1ea1-4a9c-8c2a-0bc443418478 req-5fe72a5b-b6c5-46e0-8443-13968c81c190 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] No waiting events found dispatching network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:33:02 user nova-compute[75356]: WARNING nova.compute.manager [req-529971f8-1ea1-4a9c-8c2a-0bc443418478 req-5fe72a5b-b6c5-46e0-8443-13968c81c190 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received unexpected event network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 for instance with vm_state building and task_state spawning.
Nov 29 20:33:04 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:33:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:33:04 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Instance spawned successfully.
Nov 29 20:33:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:33:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:33:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:33:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:33:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:33:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:33:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:33:04 user nova-compute[75356]: INFO nova.compute.manager [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 29 20:33:04 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:33:04 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:33:04 user nova-compute[75356]: DEBUG nova.compute.manager [req-98d40b51-2232-40fe-9679-8c225190391b req-2a86044b-ca48-475f-a88a-48e969651f85 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received event network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:33:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-98d40b51-2232-40fe-9679-8c225190391b req-2a86044b-ca48-475f-a88a-48e969651f85 service nova] Acquiring lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-98d40b51-2232-40fe-9679-8c225190391b req-2a86044b-ca48-475f-a88a-48e969651f85 service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-98d40b51-2232-40fe-9679-8c225190391b req-2a86044b-ca48-475f-a88a-48e969651f85 service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:04 user nova-compute[75356]: DEBUG nova.compute.manager [req-98d40b51-2232-40fe-9679-8c225190391b req-2a86044b-ca48-475f-a88a-48e969651f85 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] No waiting events found dispatching network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:33:04 user nova-compute[75356]: WARNING nova.compute.manager [req-98d40b51-2232-40fe-9679-8c225190391b req-2a86044b-ca48-475f-a88a-48e969651f85 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received unexpected event network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 for instance with vm_state building and task_state spawning.
Nov 29 20:33:04 user nova-compute[75356]: INFO nova.compute.manager [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Took 6.43 seconds to build instance.
Nov 29 20:33:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ed9a49be-6170-4c67-b532-44cce60a28c2 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.538s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:05 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:33:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:07 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:33:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:07 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:33:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:33:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:33:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:33:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:33:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:09 user nova-compute[75356]: DEBUG nova.compute.manager [req-3aa83ada-a3b7-4a67-b8a2-4e050fa640ec req-5f14be9a-d2c2-463b-aae8-d8bb19998bc6 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Received event network-changed-34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:33:09 user nova-compute[75356]: DEBUG nova.compute.manager [req-3aa83ada-a3b7-4a67-b8a2-4e050fa640ec req-5f14be9a-d2c2-463b-aae8-d8bb19998bc6 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Refreshing instance network info cache due to event network-changed-34d23443-7a73-4de5-972d-6c33ecf3e589. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:33:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3aa83ada-a3b7-4a67-b8a2-4e050fa640ec req-5f14be9a-d2c2-463b-aae8-d8bb19998bc6 service nova] Acquiring lock "refresh_cache-1e818d19-e8e8-4e41-83b4-53888ea21c93" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:33:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3aa83ada-a3b7-4a67-b8a2-4e050fa640ec req-5f14be9a-d2c2-463b-aae8-d8bb19998bc6 service nova] Acquired lock "refresh_cache-1e818d19-e8e8-4e41-83b4-53888ea21c93" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:33:09 user nova-compute[75356]: DEBUG nova.network.neutron [req-3aa83ada-a3b7-4a67-b8a2-4e050fa640ec req-5f14be9a-d2c2-463b-aae8-d8bb19998bc6 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Refreshing network info cache for port 34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:33:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:10 user nova-compute[75356]: DEBUG nova.network.neutron [req-3aa83ada-a3b7-4a67-b8a2-4e050fa640ec req-5f14be9a-d2c2-463b-aae8-d8bb19998bc6 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Updated VIF entry in instance network info cache for port 34d23443-7a73-4de5-972d-6c33ecf3e589. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:33:10 user nova-compute[75356]: DEBUG nova.network.neutron [req-3aa83ada-a3b7-4a67-b8a2-4e050fa640ec req-5f14be9a-d2c2-463b-aae8-d8bb19998bc6 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Updating instance_info_cache with network_info: [{"id": "34d23443-7a73-4de5-972d-6c33ecf3e589", "address": "fa:16:3e:74:01:d5", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d23443-7a", "ovs_interfaceid": "34d23443-7a73-4de5-972d-6c33ecf3e589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:33:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3aa83ada-a3b7-4a67-b8a2-4e050fa640ec req-5f14be9a-d2c2-463b-aae8-d8bb19998bc6 service nova] Releasing lock "refresh_cache-1e818d19-e8e8-4e41-83b4-53888ea21c93" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:33:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "1e818d19-e8e8-4e41-83b4-53888ea21c93" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:10 user nova-compute[75356]: INFO nova.compute.manager [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Detaching volume f7ed84ba-8a90-4031-9616-71473dec6955
Nov 29 20:33:10 user nova-compute[75356]: INFO nova.virt.block_device [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Attempting to driver detach volume f7ed84ba-8a90-4031-9616-71473dec6955 from mountpoint /dev/vdb
Nov 29 20:33:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Attempting to detach device vdb from instance 1e818d19-e8e8-4e41-83b4-53888ea21c93 from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:33:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:33:10 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:33:10 user nova-compute[75356]:   <source dev="/dev/sdi"/>
Nov 29 20:33:10 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:33:10 user nova-compute[75356]:   <serial>f7ed84ba-8a90-4031-9616-71473dec6955</serial>
Nov 29 20:33:10 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 20:33:10 user nova-compute[75356]: </disk>
Nov 29 20:33:10 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:33:10 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Successfully detached device vdb from instance 1e818d19-e8e8-4e41-83b4-53888ea21c93 from the persistent domain config.
Nov 29 20:33:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1e818d19-e8e8-4e41-83b4-53888ea21c93 from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:33:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:33:10 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:33:10 user nova-compute[75356]:   <source dev="/dev/sdi"/>
Nov 29 20:33:10 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:33:10 user nova-compute[75356]:   <serial>f7ed84ba-8a90-4031-9616-71473dec6955</serial>
Nov 29 20:33:10 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 20:33:10 user nova-compute[75356]: </disk>
Nov 29 20:33:10 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:33:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:33:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1e818d19-e8e8-4e41-83b4-53888ea21c93 {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:33:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:11 user nova-compute[75356]: DEBUG nova.compute.manager [req-a53af8bb-ad80-448e-b77f-3f6985b8bf39 req-9be7ce5e-28b9-40fc-95d6-bcc49aa42574 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Received event network-changed-34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:33:11 user nova-compute[75356]: DEBUG nova.compute.manager [req-a53af8bb-ad80-448e-b77f-3f6985b8bf39 req-9be7ce5e-28b9-40fc-95d6-bcc49aa42574 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Refreshing instance network info cache due to event network-changed-34d23443-7a73-4de5-972d-6c33ecf3e589. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:33:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a53af8bb-ad80-448e-b77f-3f6985b8bf39 req-9be7ce5e-28b9-40fc-95d6-bcc49aa42574 service nova] Acquiring lock "refresh_cache-1e818d19-e8e8-4e41-83b4-53888ea21c93" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:33:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a53af8bb-ad80-448e-b77f-3f6985b8bf39 req-9be7ce5e-28b9-40fc-95d6-bcc49aa42574 service nova] Acquired lock "refresh_cache-1e818d19-e8e8-4e41-83b4-53888ea21c93" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:33:11 user nova-compute[75356]: DEBUG nova.network.neutron [req-a53af8bb-ad80-448e-b77f-3f6985b8bf39 req-9be7ce5e-28b9-40fc-95d6-bcc49aa42574 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Refreshing network info cache for port 34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:33:11 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:33:11 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:33:11 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=7355MB free_disk=24.791446685791016GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:33:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0b59517a-c467-432a-a73a-d1460c1574e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance db0826f0-5fdc-47a8-ae36-5059844980c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 93183110-d2e2-4da7-ab7d-73378f5e0d42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance c3bb4cde-968f-4474-abcd-8dbd73300865 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance c477f425-e9ce-4b3a-b21a-8bf04401ad0b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 1e818d19-e8e8-4e41-83b4-53888ea21c93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4713c9eb-4052-4d65-a4eb-23e62352185a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance bf850b0d-88b6-4ec3-b3eb-df6195be2945 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing inventories for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Updating ProviderTree inventory for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Updating inventory in ProviderTree for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing aggregate associations for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a, aggregates: None {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing trait associations for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.772s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.network.neutron [req-a53af8bb-ad80-448e-b77f-3f6985b8bf39 req-9be7ce5e-28b9-40fc-95d6-bcc49aa42574 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Updated VIF entry in instance network info cache for port 34d23443-7a73-4de5-972d-6c33ecf3e589. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG nova.network.neutron [req-a53af8bb-ad80-448e-b77f-3f6985b8bf39 req-9be7ce5e-28b9-40fc-95d6-bcc49aa42574 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Updating instance_info_cache with network_info: [{"id": "34d23443-7a73-4de5-972d-6c33ecf3e589", "address": "fa:16:3e:74:01:d5", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d23443-7a", "ovs_interfaceid": "34d23443-7a73-4de5-972d-6c33ecf3e589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:33:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a53af8bb-ad80-448e-b77f-3f6985b8bf39 req-9be7ce5e-28b9-40fc-95d6-bcc49aa42574 service nova] Releasing lock "refresh_cache-1e818d19-e8e8-4e41-83b4-53888ea21c93" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "c3bb4cde-968f-4474-abcd-8dbd73300865" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "c3bb4cde-968f-4474-abcd-8dbd73300865" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "c3bb4cde-968f-4474-abcd-8dbd73300865-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "c3bb4cde-968f-4474-abcd-8dbd73300865-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "c3bb4cde-968f-4474-abcd-8dbd73300865-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:13 user nova-compute[75356]: INFO nova.compute.manager [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Terminating instance
Nov 29 20:33:13 user nova-compute[75356]: DEBUG nova.compute.manager [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Cleaning up deleted instances {{(pid=75356) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] There are 0 instances to clean {{(pid=75356) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-6e78c3f2-e37b-45ea-9faa-1da5498acc16 req-448b6b6f-3a98-4c10-960c-82509411a6fd service nova] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Received event network-vif-unplugged-1527f7c2-52c0-4bf7-bc50-6a4de4629933 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6e78c3f2-e37b-45ea-9faa-1da5498acc16 req-448b6b6f-3a98-4c10-960c-82509411a6fd service nova] Acquiring lock "c3bb4cde-968f-4474-abcd-8dbd73300865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6e78c3f2-e37b-45ea-9faa-1da5498acc16 req-448b6b6f-3a98-4c10-960c-82509411a6fd service nova] Lock "c3bb4cde-968f-4474-abcd-8dbd73300865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6e78c3f2-e37b-45ea-9faa-1da5498acc16 req-448b6b6f-3a98-4c10-960c-82509411a6fd service nova] Lock "c3bb4cde-968f-4474-abcd-8dbd73300865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-6e78c3f2-e37b-45ea-9faa-1da5498acc16 req-448b6b6f-3a98-4c10-960c-82509411a6fd service nova] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] No waiting events found dispatching network-vif-unplugged-1527f7c2-52c0-4bf7-bc50-6a4de4629933 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-6e78c3f2-e37b-45ea-9faa-1da5498acc16 req-448b6b6f-3a98-4c10-960c-82509411a6fd service nova] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Received event network-vif-unplugged-1527f7c2-52c0-4bf7-bc50-6a4de4629933 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:33:13 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Instance destroyed successfully.
Nov 29 20:33:13 user nova-compute[75356]: DEBUG nova.objects.instance [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lazy-loading 'resources' on Instance uuid c3bb4cde-968f-4474-abcd-8dbd73300865 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:28:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-356243207',display_name='tempest-TestVolumeBootPattern-volume-backed-server-356243207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-356243207',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8aG/CjLOXUOcOIERtoTroIOi2RmhdEo0aPpWl6gpMlqOwhNq+TskcE9T2CDvu6H26fDbrFkib0KecKeUkagcLT+qTSskuDxdbBTxueqKyu5LTCAqjQGQM33VVaijXQzQ==',key_name='tempest-keypair-214438908',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:28:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6791b0c999846e2a22d5735f91ea1aa',ramdisk_id='',reservation_id='r-2o7cj47e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1627976633',owner_user_name='tempest-TestVolumeBootPattern-1627976633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:28:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='081b00360a204be3bd6435807283f230',uuid=c3bb4cde-968f-4474-abcd-8dbd73300865,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1527f7c2-52c0-4bf7-bc50-6a4de4629933", "address": "fa:16:3e:f4:a3:a6", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1527f7c2-52", "ovs_interfaceid": "1527f7c2-52c0-4bf7-bc50-6a4de4629933", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converting VIF {"id": "1527f7c2-52c0-4bf7-bc50-6a4de4629933", "address": "fa:16:3e:f4:a3:a6", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1527f7c2-52", "ovs_interfaceid": "1527f7c2-52c0-4bf7-bc50-6a4de4629933", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:a3:a6,bridge_name='br-int',has_traffic_filtering=True,id=1527f7c2-52c0-4bf7-bc50-6a4de4629933,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1527f7c2-52') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG os_vif [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:a3:a6,bridge_name='br-int',has_traffic_filtering=True,id=1527f7c2-52c0-4bf7-bc50-6a4de4629933,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1527f7c2-52') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1527f7c2-52, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42ad3593-1184-45fc-900f-59e872d69d16) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:13 user nova-compute[75356]: INFO os_vif [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:a3:a6,bridge_name='br-int',has_traffic_filtering=True,id=1527f7c2-52c0-4bf7-bc50-6a4de4629933,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1527f7c2-52')
Nov 29 20:33:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJTjnqwB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:33:13 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:33:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec08a991-16e7-48ca-b348-0ad005611a75]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:33:13 user nova-compute[75356]: No targets found.
Nov 29 20:33:13 user nova-compute[75356]: iSNS:
Nov 29 20:33:13 user nova-compute[75356]: No targets found.
Nov 29 20:33:13 user nova-compute[75356]: STATIC:
Nov 29 20:33:13 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09
Nov 29 20:33:13 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:33:13 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:33:13 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460
Nov 29 20:33:13 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:33:13 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:33:13 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8
Nov 29 20:33:13 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:33:13 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:33:13 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955
Nov 29 20:33:13 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:33:13 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:33:13 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:33:13 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:33:13 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:33:13 user nova-compute[75356]: FIRMWARE:
Nov 29 20:33:13 user nova-compute[75356]: No targets found.
Nov 29 20:33:13 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:33:13 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:33:13 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0472c5ba-3323-460f-85d0-81bd285d9ce4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ca68ec-15c0-4d90-9867-fc3d04c3bceb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:33:14 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:33:14 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:33:14 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:33:14 user nova-compute[75356]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:33:14 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:33:14 user nova-compute[75356]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 (non-flash)
Nov 29 20:33:14 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:33:14 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:33:14 user nova-compute[75356]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:33:14 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8308711870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460'): ({'sdc'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Removing single pathed devices sdc {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc284da-afb8-409c-a210-3966f777abf3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5d5487-d2c7-4959-a5a8-24427e8e0400]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Flushing IO for device /dev/sdc {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48f0c80-7447-4f7a-b202-083c4325c883]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[110d53bf-6268-4b37-9e72-219cabbfba1a]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf9a941ff-24ae39fa7894ae50', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f9a941ff', '/dev/disk/by-id/scsi-23234616533396661') {{(pid=86863) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 20:33:14 user nova-compute[75356]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOf9a941ff-24ae39fa7894ae50
Nov 29 20:33:14 user nova-compute[75356]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_f9a941ff
Nov 29 20:33:14 user nova-compute[75356]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23234616533396661
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2222131-48a6-4764-9f9f-be6d94ab21c6]: (4, None) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db54913-5246-4daa-b3cb-9973781df24f]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75356) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[791ce138-d39a-46cc-865e-a34a045f9f4c]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460, portal: 172.16.0.220,3260]
Nov 29 20:33:14 user nova-compute[75356]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460, portal: 172.16.0.220,3260] successful.
Nov 29 20:33:14 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:840581e9-52c9-494b-91f3-0aab3d39a460 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[082f29fa-cca9-4f35-868b-9775c3e8ead1]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] <== disconnect_volume: return (350ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:33:14 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Deleting instance files /opt/stack/data/nova/instances/c3bb4cde-968f-4474-abcd-8dbd73300865_del
Nov 29 20:33:14 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Deletion of /opt/stack/data/nova/instances/c3bb4cde-968f-4474-abcd-8dbd73300865_del complete
Nov 29 20:33:14 user nova-compute[75356]: INFO nova.compute.manager [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG nova.objects.instance [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lazy-loading 'flavor' on Instance uuid 4713c9eb-4052-4d65-a4eb-23e62352185a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:14 user nova-compute[75356]: INFO nova.compute.manager [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Attaching volume 77104526-7ad1-4522-a9e5-90cbe317e87b to /dev/vdb
Nov 29 20:33:14 user nova-compute[75356]: DEBUG os_brick.utils [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[92748aa8-3323-4611-a823-f8e28c296b03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c7eba0-30f2-4e64-ae4e-61b4fba32e82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda7a782-22a7-42b5-9a83-0e4fd6d0faad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7447e30-803d-4cbd-a490-9cf418a7c87f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:33:14 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:33:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a942fe66-da5b-473e-8ec5-f3cf5bbae04c]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG os_brick.utils [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:33:14 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Updating existing volume attachment record: 89b02d14-447c-43bc-8caf-e2cae837df45 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:33:15 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:33:15 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Took 0.78 seconds to deallocate network for instance.
Nov 29 20:33:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-925edb58-9d41-403b-abc7-7687d3f4094c req-12c98f7e-7608-43bd-896f-a955c4681fa4 service nova] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Received event network-vif-plugged-1527f7c2-52c0-4bf7-bc50-6a4de4629933 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:33:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-925edb58-9d41-403b-abc7-7687d3f4094c req-12c98f7e-7608-43bd-896f-a955c4681fa4 service nova] Acquiring lock "c3bb4cde-968f-4474-abcd-8dbd73300865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-925edb58-9d41-403b-abc7-7687d3f4094c req-12c98f7e-7608-43bd-896f-a955c4681fa4 service nova] Lock "c3bb4cde-968f-4474-abcd-8dbd73300865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-925edb58-9d41-403b-abc7-7687d3f4094c req-12c98f7e-7608-43bd-896f-a955c4681fa4 service nova] Lock "c3bb4cde-968f-4474-abcd-8dbd73300865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-925edb58-9d41-403b-abc7-7687d3f4094c req-12c98f7e-7608-43bd-896f-a955c4681fa4 service nova] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] No waiting events found dispatching network-vif-plugged-1527f7c2-52c0-4bf7-bc50-6a4de4629933 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:33:15 user nova-compute[75356]: WARNING nova.compute.manager [req-925edb58-9d41-403b-abc7-7687d3f4094c req-12c98f7e-7608-43bd-896f-a955c4681fa4 service nova] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Received unexpected event network-vif-plugged-1527f7c2-52c0-4bf7-bc50-6a4de4629933 for instance with vm_state active and task_state deleting.
Nov 29 20:33:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-925edb58-9d41-403b-abc7-7687d3f4094c req-12c98f7e-7608-43bd-896f-a955c4681fa4 service nova] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Received event network-vif-deleted-1527f7c2-52c0-4bf7-bc50-6a4de4629933 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:33:15 user nova-compute[75356]: INFO nova.compute.manager [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Took 0.76 seconds to detach 1 volumes for instance.
Nov 29 20:33:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: c3bb4cde-968f-4474-abcd-8dbd73300865] Deleting volume: 840581e9-52c9-494b-91f3-0aab3d39a460 {{(pid=75356) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 20:33:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:16 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:33:16 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:33:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.387s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:16 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Deleted allocations for instance c3bb4cde-968f-4474-abcd-8dbd73300865
Nov 29 20:33:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-504ab3f0-e056-4b14-b1f0-5fc7e055e2d9 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "c3bb4cde-968f-4474-abcd-8dbd73300865" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.437s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:33:22 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dYgAXylv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:33:22 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:33:22 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:33:22 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:33:22 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:33:22 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:33:22 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:33:22 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:33:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:22 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b241ad9-3396-4c92-b1c3-bb2fedf841cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:22 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:33:22 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:22 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[206e24f0-d1eb-4e67-b39a-d219cb5d1ca4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:22 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b] added
Nov 29 20:33:22 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:22 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a586c6-90be-44ff-91ea-e9e5b5d3b068]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:22 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:22 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[20896243-e1a7-4bd1-9606-5c2262f37e16]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:22 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dYgAXylv {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dYgAXylv" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[da264a6e-dcb9-4c9a-b830-ce33f5253825]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dYgAXylv'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2626f452-b64f-412d-b029-9db967da7b06]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[69af5bb7-56be-4895-8e0d-35ca873abee2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:33:23 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:33:23 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:33:23 user nova-compute[75356]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:33:23 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:33:23 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:33:23 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:33:23 user nova-compute[75356]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:33:23 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16ed742-732b-4c13-bf6d-678ca74c2323]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b, portal: 172.16.0.220,3260]
Nov 29 20:33:23 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b, portal: 172.16.0.220,3260] successful.
Nov 29 20:33:23 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b9107e-25ac-4462-8d33-1045ae7fa2b1]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b547c82-da47-4b27-905f-c939588f3983]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:33:23 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:33:23 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:33:23 user nova-compute[75356]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:33:23 user nova-compute[75356]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b (non-flash)
Nov 29 20:33:23 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:33:23 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:33:23 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:33:23 user nova-compute[75356]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:33:23 user nova-compute[75356]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b (non-flash)
Nov 29 20:33:23 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[563a905b-dd33-4393-9014-7fe286ad6efa]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: None {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:33:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:24 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:33:24 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dYgAXylv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:33:24 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:33:24 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23932663131303665', 'path': '/dev/sdc'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:33:24 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932663131303665', 'path': '/dev/sdc'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:33:24 user nova-compute[75356]: DEBUG nova.objects.instance [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lazy-loading 'flavor' on Instance uuid 4713c9eb-4052-4d65-a4eb-23e62352185a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:33:24 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:33:24 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:33:24 user nova-compute[75356]:   <source dev="/dev/sdc"/>
Nov 29 20:33:24 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:33:24 user nova-compute[75356]:   <serial>77104526-7ad1-4522-a9e5-90cbe317e87b</serial>
Nov 29 20:33:24 user nova-compute[75356]: </disk>
Nov 29 20:33:24 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:33:24 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:33:24 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:33:24 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] No VIF found with MAC fa:16:3e:6d:3e:e2, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:33:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8696808b-dc41-4c2c-88a1-0f88fc9b2c75 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.997s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:26 user nova-compute[75356]: INFO nova.compute.manager [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Unshelving
Nov 29 20:33:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:26 user nova-compute[75356]: DEBUG nova.objects.instance [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lazy-loading 'pci_requests' on Instance uuid ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:33:26 user nova-compute[75356]: DEBUG nova.objects.instance [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lazy-loading 'numa_topology' on Instance uuid ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:33:26 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:33:26 user nova-compute[75356]: INFO nova.compute.claims [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Claim successful on node user
Nov 29 20:33:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:27 user nova-compute[75356]: INFO nova.compute.manager [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Detaching volume 77104526-7ad1-4522-a9e5-90cbe317e87b
Nov 29 20:33:27 user nova-compute[75356]: INFO nova.virt.block_device [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Attempting to driver detach volume 77104526-7ad1-4522-a9e5-90cbe317e87b from mountpoint /dev/vdb
Nov 29 20:33:27 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Attempting to detach device vdb from instance 4713c9eb-4052-4d65-a4eb-23e62352185a from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:33:27 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:33:27 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:33:27 user nova-compute[75356]:   <source dev="/dev/sdc"/>
Nov 29 20:33:27 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:33:27 user nova-compute[75356]:   <serial>77104526-7ad1-4522-a9e5-90cbe317e87b</serial>
Nov 29 20:33:27 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:33:27 user nova-compute[75356]: </disk>
Nov 29 20:33:27 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:33:27 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Successfully detached device vdb from instance 4713c9eb-4052-4d65-a4eb-23e62352185a from the persistent domain config.
Nov 29 20:33:27 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4713c9eb-4052-4d65-a4eb-23e62352185a from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:33:27 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:33:27 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:33:27 user nova-compute[75356]:   <source dev="/dev/sdc"/>
Nov 29 20:33:27 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:33:27 user nova-compute[75356]:   <serial>77104526-7ad1-4522-a9e5-90cbe317e87b</serial>
Nov 29 20:33:27 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:33:27 user nova-compute[75356]: </disk>
Nov 29 20:33:27 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:33:27 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:33:27 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:33:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:27 user nova-compute[75356]: INFO nova.network.neutron [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Updating port 617944a3-eb1e-431e-8b2f-f3090e4947e4 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 20:33:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:27 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4713c9eb-4052-4d65-a4eb-23e62352185a {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:33:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "refresh_cache-ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:33:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquired lock "refresh_cache-ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:33:28 user nova-compute[75356]: DEBUG nova.network.neutron [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:33:28 user nova-compute[75356]: DEBUG nova.compute.manager [req-d66a91bd-cda1-4cc7-9579-76e467fc18ba req-a912fa3e-6ef8-4693-bb1b-c64b2037f499 service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Received event network-changed-617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:33:28 user nova-compute[75356]: DEBUG nova.compute.manager [req-d66a91bd-cda1-4cc7-9579-76e467fc18ba req-a912fa3e-6ef8-4693-bb1b-c64b2037f499 service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Refreshing instance network info cache due to event network-changed-617944a3-eb1e-431e-8b2f-f3090e4947e4. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:33:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d66a91bd-cda1-4cc7-9579-76e467fc18ba req-a912fa3e-6ef8-4693-bb1b-c64b2037f499 service nova] Acquiring lock "refresh_cache-ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:33:28 user nova-compute[75356]: DEBUG nova.network.neutron [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Updating instance_info_cache with network_info: [{"id": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "address": "fa:16:3e:03:0f:9e", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617944a3-eb", "ovs_interfaceid": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:33:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Releasing lock "refresh_cache-ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:33:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:33:28 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Creating image(s)
Nov 29 20:33:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "/opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "/opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:28 user nova-compute[75356]: DEBUG nova.objects.instance [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lazy-loading 'trusted_certs' on Instance uuid ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:33:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d66a91bd-cda1-4cc7-9579-76e467fc18ba req-a912fa3e-6ef8-4693-bb1b-c64b2037f499 service nova] Acquired lock "refresh_cache-ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:33:28 user nova-compute[75356]: DEBUG nova.network.neutron [req-d66a91bd-cda1-4cc7-9579-76e467fc18ba req-a912fa3e-6ef8-4693-bb1b-c64b2037f499 service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Refreshing network info cache for port 617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:33:28 user nova-compute[75356]: DEBUG nova.objects.base [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Object Instance<ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:33:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "23e57a017c2f08320a144940a07993702711c3d9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "23e57a017c2f08320a144940a07993702711c3d9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23e57a017c2f08320a144940a07993702711c3d9.part --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23e57a017c2f08320a144940a07993702711c3d9.part --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:29 user nova-compute[75356]: DEBUG nova.virt.images [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] 901efec7-a805-499d-aacf-891b5d8acd78 was qcow2, converting to raw {{(pid=75356) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 20:33:29 user nova-compute[75356]: DEBUG nova.privsep.utils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75356) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 20:33:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/23e57a017c2f08320a144940a07993702711c3d9.part /opt/stack/data/nova/instances/_base/23e57a017c2f08320a144940a07993702711c3d9.converted {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:29 user nova-compute[75356]: DEBUG nova.network.neutron [req-d66a91bd-cda1-4cc7-9579-76e467fc18ba req-a912fa3e-6ef8-4693-bb1b-c64b2037f499 service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Updated VIF entry in instance network info cache for port 617944a3-eb1e-431e-8b2f-f3090e4947e4. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:33:29 user nova-compute[75356]: DEBUG nova.network.neutron [req-d66a91bd-cda1-4cc7-9579-76e467fc18ba req-a912fa3e-6ef8-4693-bb1b-c64b2037f499 service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Updating instance_info_cache with network_info: [{"id": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "address": "fa:16:3e:03:0f:9e", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617944a3-eb", "ovs_interfaceid": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:33:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d66a91bd-cda1-4cc7-9579-76e467fc18ba req-a912fa3e-6ef8-4693-bb1b-c64b2037f499 service nova] Releasing lock "refresh_cache-ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:33:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/23e57a017c2f08320a144940a07993702711c3d9.part /opt/stack/data/nova/instances/_base/23e57a017c2f08320a144940a07993702711c3d9.converted" returned: 0 in 0.568s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23e57a017c2f08320a144940a07993702711c3d9.converted --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23e57a017c2f08320a144940a07993702711c3d9.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "23e57a017c2f08320a144940a07993702711c3d9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.987s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23e57a017c2f08320a144940a07993702711c3d9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23e57a017c2f08320a144940a07993702711c3d9 --force-share --output=json" returned: 0 in 0.171s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "23e57a017c2f08320a144940a07993702711c3d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "23e57a017c2f08320a144940a07993702711c3d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23e57a017c2f08320a144940a07993702711c3d9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23e57a017c2f08320a144940a07993702711c3d9 --force-share --output=json" returned: 0 in 0.171s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23e57a017c2f08320a144940a07993702711c3d9,backing_fmt=raw /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23e57a017c2f08320a144940a07993702711c3d9,backing_fmt=raw /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk 1073741824" returned: 0 in 0.048s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "23e57a017c2f08320a144940a07993702711c3d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23e57a017c2f08320a144940a07993702711c3d9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23e57a017c2f08320a144940a07993702711c3d9 --force-share --output=json" returned: 0 in 0.172s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG nova.objects.instance [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lazy-loading 'migration_context' on Instance uuid ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG nova.objects.base [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Object Instance<ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:33:31 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Rebasing disk image.
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.172s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 -F raw /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:31 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1e818d19-e8e8-4e41-83b4-53888ea21c93 is timed out.
Nov 29 20:33:31 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Successfully detached device vdb from instance 1e818d19-e8e8-4e41-83b4-53888ea21c93 from the live domain config.
Nov 29 20:33:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMaoDjXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:33:31 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:33:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5292a86a-2da5-4904-bb0b-e09b95ed63f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:33:31 user nova-compute[75356]: No targets found.
Nov 29 20:33:31 user nova-compute[75356]: iSNS:
Nov 29 20:33:31 user nova-compute[75356]: No targets found.
Nov 29 20:33:31 user nova-compute[75356]: STATIC:
Nov 29 20:33:31 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09
Nov 29 20:33:31 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:33:31 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:33:31 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b
Nov 29 20:33:31 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:33:31 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:33:31 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8
Nov 29 20:33:31 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:33:31 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:33:31 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955
Nov 29 20:33:31 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:33:31 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:33:31 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:33:31 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:33:31 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:33:31 user nova-compute[75356]: FIRMWARE:
Nov 29 20:33:31 user nova-compute[75356]: No targets found.
Nov 29 20:33:31 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:33:31 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:33:31 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9b193e-a23b-4f31-b1a4-3733173ae7db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[27eda992-c424-40d5-862c-18b488939a61]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:33:31 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:33:31 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:33:31 user nova-compute[75356]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:33:31 user nova-compute[75356]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b (non-flash)
Nov 29 20:33:31 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:33:31 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:33:31 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:33:31 user nova-compute[75356]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 (non-flash)
Nov 29 20:33:31 user nova-compute[75356]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b (non-flash)
Nov 29 20:33:31 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f83083179a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955'): ({'sdi'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Removing single pathed devices sdi {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[abee37a6-f286-4893-96c0-b0e4c4077d33]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[95077456-3518-44f3-a51b-550967802fd1]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Flushing IO for device /dev/sdi {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3895534e-e1d0-4856-9631-c5b5003c2875]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.039s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccb8e87-2049-4c43-85ee-298578526131]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] SCSI volumes sdi have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[84be60ce-4d23-4dea-a77e-c358210709b2]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e860d9c-d3ce-475a-8882-fdfadf49523e]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955, portal: 172.16.0.220,3260]
Nov 29 20:33:31 user nova-compute[75356]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955, portal: 172.16.0.220,3260] successful.
Nov 29 20:33:31 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7ed84ba-8a90-4031-9616-71473dec6955 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03c8f1c-ee4c-4032-ba17-a188e1a1e33b]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] <== disconnect_volume: return (347ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:33:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:33:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:32 user nova-compute[75356]: DEBUG nova.objects.instance [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lazy-loading 'flavor' on Instance uuid 1e818d19-e8e8-4e41-83b4-53888ea21c93 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:33:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-054b6885-7fdd-46e1-befe-5e033e06dbbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.146s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:33 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 -F raw /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk" returned: 0 in 2.685s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:33:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Ensure instance console log exists: /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:33:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Start _get_guest_xml network_info=[{"id": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "address": "fa:16:3e:03:0f:9e", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617944a3-eb", "ovs_interfaceid": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='1a6f5d63d90128793ba1b91cc4a939ed',container_format='bare',created_at=2023-11-29T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=901efec7-a805-499d-aacf-891b5d8acd78,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1746543629-shelved',owner='71e99301081a4158bc9d188e2f796350',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T20:31:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:33:33 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:33:33 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:33:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:33:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:33:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:33:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:33:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:33:33 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1a6f5d63d90128793ba1b91cc4a939ed',container_format='bare',created_at=2023-11-29T20:31:34Z,direct_url=<?>,disk_format='qcow2',id=901efec7-a805-499d-aacf-891b5d8acd78,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1746543629-shelved',owner='71e99301081a4158bc9d188e2f796350',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T20:31:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:33:33 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:33:33 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:33:33 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:33:33 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:33:33 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:33:33 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:33:33 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:33:33 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:33:33 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:33:33 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:33:33 user nova-compute[75356]: DEBUG nova.objects.instance [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lazy-loading 'vcpu_model' on Instance uuid ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG nova.objects.base [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Object Instance<ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T20:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746543629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746543629',id=34,image_ref='901efec7-a805-499d-aacf-891b5d8acd78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1798007487',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:29:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='71e99301081a4158bc9d188e2f796350',ramdisk_id='',reservation_id='r-np63f8g4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1538416601',owner_user_name='tempest-AttachVolumeShelveTestJSON-1538416601-project-member',shelved_at='2023-11-29T20:31:38.483187',shelved_host='user',shelved_image_id='901efec7-a805-499d-aacf-891b5d8acd78'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:33:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecc96706ae3140ce8816c0e78e116d7d',uuid=ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "address": "fa:16:3e:03:0f:9e", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617944a3-eb", "ovs_interfaceid": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converting VIF {"id": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "address": "fa:16:3e:03:0f:9e", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617944a3-eb", "ovs_interfaceid": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:0f:9e,bridge_name='br-int',has_traffic_filtering=True,id=617944a3-eb1e-431e-8b2f-f3090e4947e4,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617944a3-eb') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG nova.objects.instance [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lazy-loading 'pci_devices' on Instance uuid ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG nova.objects.base [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Object Instance<ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:33:34 user nova-compute[75356]:   <uuid>ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb</uuid>
Nov 29 20:33:34 user nova-compute[75356]:   <name>instance-00000022</name>
Nov 29 20:33:34 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:33:34 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:33:34 user nova-compute[75356]:   <metadata>
Nov 29 20:33:34 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:33:34 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:33:34 user nova-compute[75356]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1746543629</nova:name>
Nov 29 20:33:34 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:33:33</nova:creationTime>
Nov 29 20:33:34 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:33:34 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:33:34 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:33:34 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:33:34 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:33:34 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:33:34 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:33:34 user nova-compute[75356]:       <nova:owner>
Nov 29 20:33:34 user nova-compute[75356]:         <nova:user uuid="ecc96706ae3140ce8816c0e78e116d7d">tempest-AttachVolumeShelveTestJSON-1538416601-project-member</nova:user>
Nov 29 20:33:34 user nova-compute[75356]:         <nova:project uuid="71e99301081a4158bc9d188e2f796350">tempest-AttachVolumeShelveTestJSON-1538416601</nova:project>
Nov 29 20:33:34 user nova-compute[75356]:       </nova:owner>
Nov 29 20:33:34 user nova-compute[75356]:       <nova:root type="image" uuid="901efec7-a805-499d-aacf-891b5d8acd78"/>
Nov 29 20:33:34 user nova-compute[75356]:       <nova:ports>
Nov 29 20:33:34 user nova-compute[75356]:         <nova:port uuid="617944a3-eb1e-431e-8b2f-f3090e4947e4">
Nov 29 20:33:34 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 20:33:34 user nova-compute[75356]:         </nova:port>
Nov 29 20:33:34 user nova-compute[75356]:       </nova:ports>
Nov 29 20:33:34 user nova-compute[75356]:     </nova:instance>
Nov 29 20:33:34 user nova-compute[75356]:   </metadata>
Nov 29 20:33:34 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:33:34 user nova-compute[75356]:     <system>
Nov 29 20:33:34 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:33:34 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:33:34 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:33:34 user nova-compute[75356]:       <entry name="serial">ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb</entry>
Nov 29 20:33:34 user nova-compute[75356]:       <entry name="uuid">ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb</entry>
Nov 29 20:33:34 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:33:34 user nova-compute[75356]:     </system>
Nov 29 20:33:34 user nova-compute[75356]:   </sysinfo>
Nov 29 20:33:34 user nova-compute[75356]:   <os>
Nov 29 20:33:34 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:33:34 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:33:34 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:33:34 user nova-compute[75356]:   </os>
Nov 29 20:33:34 user nova-compute[75356]:   <features>
Nov 29 20:33:34 user nova-compute[75356]:     <acpi/>
Nov 29 20:33:34 user nova-compute[75356]:     <apic/>
Nov 29 20:33:34 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:33:34 user nova-compute[75356]:   </features>
Nov 29 20:33:34 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:33:34 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:33:34 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:33:34 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:33:34 user nova-compute[75356]:   </clock>
Nov 29 20:33:34 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:33:34 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:33:34 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:33:34 user nova-compute[75356]:   </cpu>
Nov 29 20:33:34 user nova-compute[75356]:   <devices>
Nov 29 20:33:34 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:33:34 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:33:34 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk"/>
Nov 29 20:33:34 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:33:34 user nova-compute[75356]:     </disk>
Nov 29 20:33:34 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:33:34 user nova-compute[75356]:       <mac address="fa:16:3e:03:0f:9e"/>
Nov 29 20:33:34 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:33:34 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:33:34 user nova-compute[75356]:       <target dev="tap617944a3-eb"/>
Nov 29 20:33:34 user nova-compute[75356]:     </interface>
Nov 29 20:33:34 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:33:34 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/console.log" append="off"/>
Nov 29 20:33:34 user nova-compute[75356]:     </serial>
Nov 29 20:33:34 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:33:34 user nova-compute[75356]:     <video>
Nov 29 20:33:34 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:33:34 user nova-compute[75356]:     </video>
Nov 29 20:33:34 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:33:34 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:33:34 user nova-compute[75356]:     </rng>
Nov 29 20:33:34 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:33:34 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:33:34 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:33:34 user nova-compute[75356]:     </memballoon>
Nov 29 20:33:34 user nova-compute[75356]:   </devices>
Nov 29 20:33:34 user nova-compute[75356]: </domain>
Nov 29 20:33:34 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T20:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746543629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746543629',id=34,image_ref='901efec7-a805-499d-aacf-891b5d8acd78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1798007487',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:29:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='71e99301081a4158bc9d188e2f796350',ramdisk_id='',reservation_id='r-np63f8g4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1538416601',owner_user_name='tempest-AttachVolumeShelveTestJSON-1538416601-project-member',shelved_at='2023-11-29T20:31:38.483187',shelved_host='user',shelved_image_id='901efec7-a805-499d-aacf-891b5d8acd78'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:33:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecc96706ae3140ce8816c0e78e116d7d',uuid=ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "address": "fa:16:3e:03:0f:9e", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617944a3-eb", "ovs_interfaceid": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converting VIF {"id": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "address": "fa:16:3e:03:0f:9e", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617944a3-eb", "ovs_interfaceid": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:0f:9e,bridge_name='br-int',has_traffic_filtering=True,id=617944a3-eb1e-431e-8b2f-f3090e4947e4,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617944a3-eb') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG os_vif [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:0f:9e,bridge_name='br-int',has_traffic_filtering=True,id=617944a3-eb1e-431e-8b2f-f3090e4947e4,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617944a3-eb') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a30e5997-5fc7-5bdb-a957-44fd2db6bf89', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap617944a3-eb, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap617944a3-eb, col_values=(('qos', UUID('77034336-4c14-4233-ad8a-7aa626cc9fc5')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap617944a3-eb, col_values=(('external_ids', {'iface-id': '617944a3-eb1e-431e-8b2f-f3090e4947e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:0f:9e', 'vm-uuid': 'ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:34 user nova-compute[75356]: INFO os_vif [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:0f:9e,bridge_name='br-int',has_traffic_filtering=True,id=617944a3-eb1e-431e-8b2f-f3090e4947e4,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617944a3-eb')
Nov 29 20:33:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:33:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] No VIF found with MAC fa:16:3e:03:0f:9e, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:33:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:35 user nova-compute[75356]: DEBUG nova.compute.manager [req-9352d440-451a-4507-8e67-2677870240f8 req-ccc0702a-3ade-48ac-96b2-ce0a0269b786 service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Received event network-vif-plugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:33:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9352d440-451a-4507-8e67-2677870240f8 req-ccc0702a-3ade-48ac-96b2-ce0a0269b786 service nova] Acquiring lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9352d440-451a-4507-8e67-2677870240f8 req-ccc0702a-3ade-48ac-96b2-ce0a0269b786 service nova] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9352d440-451a-4507-8e67-2677870240f8 req-ccc0702a-3ade-48ac-96b2-ce0a0269b786 service nova] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:35 user nova-compute[75356]: DEBUG nova.compute.manager [req-9352d440-451a-4507-8e67-2677870240f8 req-ccc0702a-3ade-48ac-96b2-ce0a0269b786 service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] No waiting events found dispatching network-vif-plugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:33:35 user nova-compute[75356]: WARNING nova.compute.manager [req-9352d440-451a-4507-8e67-2677870240f8 req-ccc0702a-3ade-48ac-96b2-ce0a0269b786 service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Received unexpected event network-vif-plugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 20:33:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "efda3722-c523-47e1-b942-2ec2aacf6417" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "efda3722-c523-47e1-b942-2ec2aacf6417" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:36 user nova-compute[75356]: DEBUG nova.compute.manager [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:33:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:36 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:33:36 user nova-compute[75356]: INFO nova.compute.claims [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Claim successful on node user
Nov 29 20:33:37 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:33:37 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:33:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:37 user nova-compute[75356]: DEBUG nova.compute.manager [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:33:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:37 user nova-compute[75356]: DEBUG nova.compute.manager [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:33:37 user nova-compute[75356]: DEBUG nova.network.neutron [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:33:37 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:33:37 user nova-compute[75356]: DEBUG nova.compute.manager [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:33:37 user nova-compute[75356]: DEBUG nova.compute.manager [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:33:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:33:37 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Creating image(s)
Nov 29 20:33:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "/opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "/opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "/opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:37 user nova-compute[75356]: DEBUG nova.policy [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbdba4f436df4dbb896258c4f4d6b180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076539532d4847719e7fcf4165872bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:33:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.186s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:38 user nova-compute[75356]: DEBUG nova.compute.manager [req-07c5494d-068c-42d0-ac7a-1548a06fc56f req-37c4cdb9-1822-4e1f-8bb6-e1cb0f27ad3a service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Received event network-vif-plugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:33:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-07c5494d-068c-42d0-ac7a-1548a06fc56f req-37c4cdb9-1822-4e1f-8bb6-e1cb0f27ad3a service nova] Acquiring lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-07c5494d-068c-42d0-ac7a-1548a06fc56f req-37c4cdb9-1822-4e1f-8bb6-e1cb0f27ad3a service nova] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-07c5494d-068c-42d0-ac7a-1548a06fc56f req-37c4cdb9-1822-4e1f-8bb6-e1cb0f27ad3a service nova] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:38 user nova-compute[75356]: DEBUG nova.compute.manager [req-07c5494d-068c-42d0-ac7a-1548a06fc56f req-37c4cdb9-1822-4e1f-8bb6-e1cb0f27ad3a service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] No waiting events found dispatching network-vif-plugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:33:38 user nova-compute[75356]: WARNING nova.compute.manager [req-07c5494d-068c-42d0-ac7a-1548a06fc56f req-37c4cdb9-1822-4e1f-8bb6-e1cb0f27ad3a service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Received unexpected event network-vif-plugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 20:33:38 user nova-compute[75356]: DEBUG nova.compute.manager [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:33:38 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:33:38 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Instance spawned successfully.
Nov 29 20:33:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.195s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/disk 1073741824" returned: 0 in 0.051s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:38 user nova-compute[75356]: DEBUG nova.compute.manager [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:33:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7873ae94-bbd5-497c-bc2b-4e33b26aab72 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.558s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.183s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:38 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Checking if we can resize image /opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:33:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:38 user nova-compute[75356]: DEBUG nova.network.neutron [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Successfully created port: 9876a163-254d-4338-b881-4513f8acffca {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:33:38 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:38 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Cannot resize image /opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:33:38 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:33:38 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Ensure instance console log exists: /opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:33:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.network.neutron [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Successfully updated port: 9876a163-254d-4338-b881-4513f8acffca {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "refresh_cache-efda3722-c523-47e1-b942-2ec2aacf6417" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquired lock "refresh_cache-efda3722-c523-47e1-b942-2ec2aacf6417" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.network.neutron [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.compute.manager [req-9023f7d0-7ffe-4b0a-a805-e7e1a0e93c99 req-069336d9-82e3-41b4-add2-258733f0724a service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Received event network-changed-9876a163-254d-4338-b881-4513f8acffca {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.compute.manager [req-9023f7d0-7ffe-4b0a-a805-e7e1a0e93c99 req-069336d9-82e3-41b4-add2-258733f0724a service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Refreshing instance network info cache due to event network-changed-9876a163-254d-4338-b881-4513f8acffca. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9023f7d0-7ffe-4b0a-a805-e7e1a0e93c99 req-069336d9-82e3-41b4-add2-258733f0724a service nova] Acquiring lock "refresh_cache-efda3722-c523-47e1-b942-2ec2aacf6417" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.network.neutron [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.network.neutron [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Updating instance_info_cache with network_info: [{"id": "9876a163-254d-4338-b881-4513f8acffca", "address": "fa:16:3e:10:e7:71", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9876a163-25", "ovs_interfaceid": "9876a163-254d-4338-b881-4513f8acffca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Releasing lock "refresh_cache-efda3722-c523-47e1-b942-2ec2aacf6417" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.compute.manager [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Instance network_info: |[{"id": "9876a163-254d-4338-b881-4513f8acffca", "address": "fa:16:3e:10:e7:71", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9876a163-25", "ovs_interfaceid": "9876a163-254d-4338-b881-4513f8acffca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9023f7d0-7ffe-4b0a-a805-e7e1a0e93c99 req-069336d9-82e3-41b4-add2-258733f0724a service nova] Acquired lock "refresh_cache-efda3722-c523-47e1-b942-2ec2aacf6417" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.network.neutron [req-9023f7d0-7ffe-4b0a-a805-e7e1a0e93c99 req-069336d9-82e3-41b4-add2-258733f0724a service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Refreshing network info cache for port 9876a163-254d-4338-b881-4513f8acffca {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Start _get_guest_xml network_info=[{"id": "9876a163-254d-4338-b881-4513f8acffca", "address": "fa:16:3e:10:e7:71", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9876a163-25", "ovs_interfaceid": "9876a163-254d-4338-b881-4513f8acffca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:33:39 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:33:39 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1306069447',display_name='tempest-AttachVolumeNegativeTest-server-1306069447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1306069447',id=39,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfCeTRMageu0GSqkjDtfwFE3kWrXvnBjEF9r1BnT9wJIgyWgoUPh/A9I5i/W0TlDfzQJg4pKv5+X7KFGFKnId+0ctsA4vQwJHsF9sRm+rbkQX0g+tRwBZh4iHsqZ7SyEw==',key_name='tempest-keypair-1985273325',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='076539532d4847719e7fcf4165872bbe',ramdisk_id='',reservation_id='r-iz4jfudi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1182074567',owner_user_name='tempest-AttachVolumeNegativeTest-1182074567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:33:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbdba4f436df4dbb896258c4f4d6b180',uuid=efda3722-c523-47e1-b942-2ec2aacf6417,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9876a163-254d-4338-b881-4513f8acffca", "address": "fa:16:3e:10:e7:71", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9876a163-25", "ovs_interfaceid": "9876a163-254d-4338-b881-4513f8acffca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converting VIF {"id": "9876a163-254d-4338-b881-4513f8acffca", "address": "fa:16:3e:10:e7:71", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9876a163-25", "ovs_interfaceid": "9876a163-254d-4338-b881-4513f8acffca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:e7:71,bridge_name='br-int',has_traffic_filtering=True,id=9876a163-254d-4338-b881-4513f8acffca,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9876a163-25') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.objects.instance [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lazy-loading 'pci_devices' on Instance uuid efda3722-c523-47e1-b942-2ec2aacf6417 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:33:39 user nova-compute[75356]:   <uuid>efda3722-c523-47e1-b942-2ec2aacf6417</uuid>
Nov 29 20:33:39 user nova-compute[75356]:   <name>instance-00000027</name>
Nov 29 20:33:39 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:33:39 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:33:39 user nova-compute[75356]:   <metadata>
Nov 29 20:33:39 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:33:39 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:33:39 user nova-compute[75356]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1306069447</nova:name>
Nov 29 20:33:39 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:33:39</nova:creationTime>
Nov 29 20:33:39 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:33:39 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:33:39 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:33:39 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:33:39 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:33:39 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:33:39 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:33:39 user nova-compute[75356]:       <nova:owner>
Nov 29 20:33:39 user nova-compute[75356]:         <nova:user uuid="cbdba4f436df4dbb896258c4f4d6b180">tempest-AttachVolumeNegativeTest-1182074567-project-member</nova:user>
Nov 29 20:33:39 user nova-compute[75356]:         <nova:project uuid="076539532d4847719e7fcf4165872bbe">tempest-AttachVolumeNegativeTest-1182074567</nova:project>
Nov 29 20:33:39 user nova-compute[75356]:       </nova:owner>
Nov 29 20:33:39 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:33:39 user nova-compute[75356]:       <nova:ports>
Nov 29 20:33:39 user nova-compute[75356]:         <nova:port uuid="9876a163-254d-4338-b881-4513f8acffca">
Nov 29 20:33:39 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 20:33:39 user nova-compute[75356]:         </nova:port>
Nov 29 20:33:39 user nova-compute[75356]:       </nova:ports>
Nov 29 20:33:39 user nova-compute[75356]:     </nova:instance>
Nov 29 20:33:39 user nova-compute[75356]:   </metadata>
Nov 29 20:33:39 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:33:39 user nova-compute[75356]:     <system>
Nov 29 20:33:39 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:33:39 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:33:39 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:33:39 user nova-compute[75356]:       <entry name="serial">efda3722-c523-47e1-b942-2ec2aacf6417</entry>
Nov 29 20:33:39 user nova-compute[75356]:       <entry name="uuid">efda3722-c523-47e1-b942-2ec2aacf6417</entry>
Nov 29 20:33:39 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:33:39 user nova-compute[75356]:     </system>
Nov 29 20:33:39 user nova-compute[75356]:   </sysinfo>
Nov 29 20:33:39 user nova-compute[75356]:   <os>
Nov 29 20:33:39 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:33:39 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:33:39 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:33:39 user nova-compute[75356]:   </os>
Nov 29 20:33:39 user nova-compute[75356]:   <features>
Nov 29 20:33:39 user nova-compute[75356]:     <acpi/>
Nov 29 20:33:39 user nova-compute[75356]:     <apic/>
Nov 29 20:33:39 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:33:39 user nova-compute[75356]:   </features>
Nov 29 20:33:39 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:33:39 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:33:39 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:33:39 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:33:39 user nova-compute[75356]:   </clock>
Nov 29 20:33:39 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:33:39 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:33:39 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:33:39 user nova-compute[75356]:   </cpu>
Nov 29 20:33:39 user nova-compute[75356]:   <devices>
Nov 29 20:33:39 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:33:39 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:33:39 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/disk"/>
Nov 29 20:33:39 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:33:39 user nova-compute[75356]:     </disk>
Nov 29 20:33:39 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:33:39 user nova-compute[75356]:       <mac address="fa:16:3e:10:e7:71"/>
Nov 29 20:33:39 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:33:39 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:33:39 user nova-compute[75356]:       <target dev="tap9876a163-25"/>
Nov 29 20:33:39 user nova-compute[75356]:     </interface>
Nov 29 20:33:39 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:33:39 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/console.log" append="off"/>
Nov 29 20:33:39 user nova-compute[75356]:     </serial>
Nov 29 20:33:39 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:33:39 user nova-compute[75356]:     <video>
Nov 29 20:33:39 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:33:39 user nova-compute[75356]:     </video>
Nov 29 20:33:39 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:33:39 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:33:39 user nova-compute[75356]:     </rng>
Nov 29 20:33:39 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:33:39 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:33:39 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:33:39 user nova-compute[75356]:     </memballoon>
Nov 29 20:33:39 user nova-compute[75356]:   </devices>
Nov 29 20:33:39 user nova-compute[75356]: </domain>
Nov 29 20:33:39 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1306069447',display_name='tempest-AttachVolumeNegativeTest-server-1306069447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1306069447',id=39,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfCeTRMageu0GSqkjDtfwFE3kWrXvnBjEF9r1BnT9wJIgyWgoUPh/A9I5i/W0TlDfzQJg4pKv5+X7KFGFKnId+0ctsA4vQwJHsF9sRm+rbkQX0g+tRwBZh4iHsqZ7SyEw==',key_name='tempest-keypair-1985273325',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='076539532d4847719e7fcf4165872bbe',ramdisk_id='',reservation_id='r-iz4jfudi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1182074567',owner_user_name='tempest-AttachVolumeNegativeTest-1182074567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:33:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbdba4f436df4dbb896258c4f4d6b180',uuid=efda3722-c523-47e1-b942-2ec2aacf6417,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9876a163-254d-4338-b881-4513f8acffca", "address": "fa:16:3e:10:e7:71", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9876a163-25", "ovs_interfaceid": "9876a163-254d-4338-b881-4513f8acffca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converting VIF {"id": "9876a163-254d-4338-b881-4513f8acffca", "address": "fa:16:3e:10:e7:71", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9876a163-25", "ovs_interfaceid": "9876a163-254d-4338-b881-4513f8acffca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:e7:71,bridge_name='br-int',has_traffic_filtering=True,id=9876a163-254d-4338-b881-4513f8acffca,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9876a163-25') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG os_vif [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:e7:71,bridge_name='br-int',has_traffic_filtering=True,id=9876a163-254d-4338-b881-4513f8acffca,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9876a163-25') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '74a3a2a8-9669-5087-b1e7-9f702ab7afb0', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9876a163-25, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9876a163-25, col_values=(('qos', UUID('e7395124-6076-46e8-b546-47b19f0b8aa9')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9876a163-25, col_values=(('external_ids', {'iface-id': '9876a163-254d-4338-b881-4513f8acffca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:e7:71', 'vm-uuid': 'efda3722-c523-47e1-b942-2ec2aacf6417'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:39 user nova-compute[75356]: INFO os_vif [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:e7:71,bridge_name='br-int',has_traffic_filtering=True,id=9876a163-254d-4338-b881-4513f8acffca,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9876a163-25')
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:33:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] No VIF found with MAC fa:16:3e:10:e7:71, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG nova.network.neutron [req-9023f7d0-7ffe-4b0a-a805-e7e1a0e93c99 req-069336d9-82e3-41b4-add2-258733f0724a service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Updated VIF entry in instance network info cache for port 9876a163-254d-4338-b881-4513f8acffca. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG nova.network.neutron [req-9023f7d0-7ffe-4b0a-a805-e7e1a0e93c99 req-069336d9-82e3-41b4-add2-258733f0724a service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Updating instance_info_cache with network_info: [{"id": "9876a163-254d-4338-b881-4513f8acffca", "address": "fa:16:3e:10:e7:71", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9876a163-25", "ovs_interfaceid": "9876a163-254d-4338-b881-4513f8acffca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9023f7d0-7ffe-4b0a-a805-e7e1a0e93c99 req-069336d9-82e3-41b4-add2-258733f0724a service nova] Releasing lock "refresh_cache-efda3722-c523-47e1-b942-2ec2aacf6417" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Acquiring lock "9033b98b-fb6a-4702-8308-68363c60c6dc" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:40 user nova-compute[75356]: INFO nova.compute.manager [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Unshelving
Nov 29 20:33:40 user nova-compute[75356]: INFO nova.virt.block_device [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Booting with volume 8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 at /dev/vda
Nov 29 20:33:40 user nova-compute[75356]: DEBUG os_brick.utils [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ea38a2-4f7b-455a-93fb-7fa503ad7648]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b80abf-6c02-4fc4-ba22-d8f11e8bdf65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74166a9-d52b-4533-9a5e-28b3996a6322]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff2be39-e9c5-4cea-8097-04837a35966e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:33:40 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:33:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cec5afc-6926-4bd1-99b0-c67495658173]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG os_brick.utils [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:33:40 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Updating existing volume attachment record: 6c2b934e-8f49-4b3c-8b62-e86f23a6a660 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:33:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:41 user nova-compute[75356]: DEBUG nova.compute.manager [req-ca9288a2-22e1-48fd-a9a0-d3f51a4cddc2 req-b2c2cee7-1aa9-46b8-9b75-416c063808ef service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Received event network-vif-plugged-9876a163-254d-4338-b881-4513f8acffca {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:33:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ca9288a2-22e1-48fd-a9a0-d3f51a4cddc2 req-b2c2cee7-1aa9-46b8-9b75-416c063808ef service nova] Acquiring lock "efda3722-c523-47e1-b942-2ec2aacf6417-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ca9288a2-22e1-48fd-a9a0-d3f51a4cddc2 req-b2c2cee7-1aa9-46b8-9b75-416c063808ef service nova] Lock "efda3722-c523-47e1-b942-2ec2aacf6417-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ca9288a2-22e1-48fd-a9a0-d3f51a4cddc2 req-b2c2cee7-1aa9-46b8-9b75-416c063808ef service nova] Lock "efda3722-c523-47e1-b942-2ec2aacf6417-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:41 user nova-compute[75356]: DEBUG nova.compute.manager [req-ca9288a2-22e1-48fd-a9a0-d3f51a4cddc2 req-b2c2cee7-1aa9-46b8-9b75-416c063808ef service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] No waiting events found dispatching network-vif-plugged-9876a163-254d-4338-b881-4513f8acffca {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:33:41 user nova-compute[75356]: WARNING nova.compute.manager [req-ca9288a2-22e1-48fd-a9a0-d3f51a4cddc2 req-b2c2cee7-1aa9-46b8-9b75-416c063808ef service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Received unexpected event network-vif-plugged-9876a163-254d-4338-b881-4513f8acffca for instance with vm_state building and task_state spawning.
Nov 29 20:33:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-834fb82a-a000-44bf-adb2-830591ac887d req-dddf76fe-79c9-4232-8942-e5975cfba48a service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Received event network-vif-plugged-9876a163-254d-4338-b881-4513f8acffca {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:33:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-834fb82a-a000-44bf-adb2-830591ac887d req-dddf76fe-79c9-4232-8942-e5975cfba48a service nova] Acquiring lock "efda3722-c523-47e1-b942-2ec2aacf6417-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-834fb82a-a000-44bf-adb2-830591ac887d req-dddf76fe-79c9-4232-8942-e5975cfba48a service nova] Lock "efda3722-c523-47e1-b942-2ec2aacf6417-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-834fb82a-a000-44bf-adb2-830591ac887d req-dddf76fe-79c9-4232-8942-e5975cfba48a service nova] Lock "efda3722-c523-47e1-b942-2ec2aacf6417-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-834fb82a-a000-44bf-adb2-830591ac887d req-dddf76fe-79c9-4232-8942-e5975cfba48a service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] No waiting events found dispatching network-vif-plugged-9876a163-254d-4338-b881-4513f8acffca {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:33:43 user nova-compute[75356]: WARNING nova.compute.manager [req-834fb82a-a000-44bf-adb2-830591ac887d req-dddf76fe-79c9-4232-8942-e5975cfba48a service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Received unexpected event network-vif-plugged-9876a163-254d-4338-b881-4513f8acffca for instance with vm_state building and task_state spawning.
Nov 29 20:33:43 user nova-compute[75356]: DEBUG nova.compute.manager [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:33:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:33:43 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Instance spawned successfully.
Nov 29 20:33:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:33:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:33:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:33:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:33:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:33:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:33:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:33:43 user nova-compute[75356]: INFO nova.compute.manager [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Took 5.93 seconds to spawn the instance on the hypervisor.
Nov 29 20:33:43 user nova-compute[75356]: DEBUG nova.compute.manager [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:33:43 user nova-compute[75356]: INFO nova.compute.manager [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Took 6.88 seconds to build instance.
Nov 29 20:33:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-82bd1675-2465-4eda-b3d9-f8ff32a02164 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "efda3722-c523-47e1-b942-2ec2aacf6417" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.040s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:47 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4713c9eb-4052-4d65-a4eb-23e62352185a is timed out.
Nov 29 20:33:47 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Successfully detached device vdb from instance 4713c9eb-4052-4d65-a4eb-23e62352185a from the live domain config.
Nov 29 20:33:47 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dYgAXylv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:33:47 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:33:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b05c48e-0804-4ad8-97b5-e78348c9ccbf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:33:47 user nova-compute[75356]: No targets found.
Nov 29 20:33:47 user nova-compute[75356]: iSNS:
Nov 29 20:33:47 user nova-compute[75356]: No targets found.
Nov 29 20:33:47 user nova-compute[75356]: STATIC:
Nov 29 20:33:47 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09
Nov 29 20:33:47 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:33:47 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:33:47 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b
Nov 29 20:33:47 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:33:47 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:33:47 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8
Nov 29 20:33:47 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:33:47 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:33:47 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:33:47 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:33:47 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:33:47 user nova-compute[75356]: FIRMWARE:
Nov 29 20:33:47 user nova-compute[75356]: No targets found.
Nov 29 20:33:47 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:33:47 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:33:47 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e845d59-e93c-4c9e-b3bd-81f7cc2d32b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[01193a60-8659-4ca7-8e4c-5cfb280ff286]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:33:47 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:33:47 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:33:47 user nova-compute[75356]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b (non-flash)
Nov 29 20:33:47 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:33:47 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:33:47 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:33:47 user nova-compute[75356]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b (non-flash)
Nov 29 20:33:47 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e422e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b'): ({'sdc'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Removing single pathed devices sdc {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[60737f19-5a41-4389-ae27-02d49c4d9b50]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5619bc72-e83b-4a17-9802-fc6441502889]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Flushing IO for device /dev/sdc {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ca110b-f174-4d44-866b-3abcc799a0dc]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[346e11cf-eb0d-4b51-83da-d2edaeea9e2c]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e585d2-fa3c-471a-ad5e-cc6460bf4665]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[682065c0-89ab-4f3f-a7ba-1d86d0572b95]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b, portal: 172.16.0.220,3260]
Nov 29 20:33:47 user nova-compute[75356]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b, portal: 172.16.0.220,3260] successful.
Nov 29 20:33:47 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:47 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:48 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77104526-7ad1-4522-a9e5-90cbe317e87b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:48 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fe08b6-16d2-4007-a080-9feedc2f2e87]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:48 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:48 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:33:48 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] <== disconnect_volume: return (337ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:33:48 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:33:48 user nova-compute[75356]: DEBUG nova.objects.instance [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lazy-loading 'flavor' on Instance uuid 4713c9eb-4052-4d65-a4eb-23e62352185a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:33:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f4d6c411-cdd9-4fb6-b689-49621c00bd35 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.022s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:49 user nova-compute[75356]: DEBUG nova.objects.instance [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lazy-loading 'pci_requests' on Instance uuid 9033b98b-fb6a-4702-8308-68363c60c6dc {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:33:49 user nova-compute[75356]: DEBUG nova.objects.instance [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lazy-loading 'numa_topology' on Instance uuid 9033b98b-fb6a-4702-8308-68363c60c6dc {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:33:49 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:33:49 user nova-compute[75356]: INFO nova.compute.claims [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Claim successful on node user
Nov 29 20:33:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:49 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:33:49 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:33:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:50 user nova-compute[75356]: INFO nova.network.neutron [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Updating port 2d549e00-e710-4b20-b6b2-69deafe8ff8d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 20:33:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Acquiring lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:33:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Acquired lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:33:50 user nova-compute[75356]: DEBUG nova.network.neutron [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:33:50 user nova-compute[75356]: DEBUG nova.compute.manager [req-4ff13f7c-6ecb-450c-a0e6-282e8be2cdf5 req-4ec6843a-b079-4781-9735-8ba3cc56affb service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Received event network-changed-2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:33:50 user nova-compute[75356]: DEBUG nova.compute.manager [req-4ff13f7c-6ecb-450c-a0e6-282e8be2cdf5 req-4ec6843a-b079-4781-9735-8ba3cc56affb service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Refreshing instance network info cache due to event network-changed-2d549e00-e710-4b20-b6b2-69deafe8ff8d. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:33:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4ff13f7c-6ecb-450c-a0e6-282e8be2cdf5 req-4ec6843a-b079-4781-9735-8ba3cc56affb service nova] Acquiring lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.network.neutron [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Updating instance_info_cache with network_info: [{"id": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "address": "fa:16:3e:c3:30:66", "network": {"id": "48d05176-aee3-4bf7-a929-a2b3714e9c6e", "bridge": "br-int", "label": "tempest-TestShelveInstance-447192641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022c8a86cda4a7c90d96d60a8261cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d549e00-e7", "ovs_interfaceid": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Releasing lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:33:51 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Creating image(s)
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Did not create local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Ensure instance console log exists: /opt/stack/data/nova/instances/9033b98b-fb6a-4702-8308-68363c60c6dc/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Start _get_guest_xml network_info=[{"id": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "address": "fa:16:3e:c3:30:66", "network": {"id": "48d05176-aee3-4bf7-a929-a2b3714e9c6e", "bridge": "br-int", "label": "tempest-TestShelveInstance-447192641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022c8a86cda4a7c90d96d60a8261cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d549e00-e7", "ovs_interfaceid": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFVWetKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9033b98b-fb6a-4702-8308-68363c60c6dc', 'attached_at': '', 'detached_at': '', 'volume_id': '8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7', 'serial': '8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7'}, 'attachment_id': '6c2b934e-8f49-4b3c-8b62-e86f23a6a660', 'volume_type': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4ff13f7c-6ecb-450c-a0e6-282e8be2cdf5 req-4ec6843a-b079-4781-9735-8ba3cc56affb service nova] Acquired lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.network.neutron [req-4ff13f7c-6ecb-450c-a0e6-282e8be2cdf5 req-4ec6843a-b079-4781-9735-8ba3cc56affb service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Refreshing network info cache for port 2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:33:51 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:33:51 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.objects.instance [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9033b98b-fb6a-4702-8308-68363c60c6dc {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.objects.base [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Object Instance<9033b98b-fb6a-4702-8308-68363c60c6dc> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFVWetKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:33:51 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:33:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:33:51 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:33:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:33:51 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0500eae4-9583-4beb-b5da-f6ba94524236]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:33:51 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6fc3fd-5085-493e-a73a-1d0b4d545de6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7] added
Nov 29 20:33:51 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9b6f6e-56fd-43be-b06a-9a3b4ed19a20]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb71041-b434-40c9-85dc-e293b8894d2b]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pFVWetKY {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pFVWetKY" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[852a04bd-dfa8-43fc-be27-60731abb33d1]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pFVWetKY'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eefb8b1-3740-4373-a77d-8d62cd052a3d]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18756f7-a70d-4660-9e91-3e75f26e5d0d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:33:51 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:33:51 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:33:51 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:33:51 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:33:51 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:33:51 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9207a2-b80c-44dd-826a-a4d5664cf214]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7, portal: 172.16.0.220,3260]
Nov 29 20:33:51 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7, portal: 172.16.0.220,3260] successful.
Nov 29 20:33:51 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.network.neutron [req-4ff13f7c-6ecb-450c-a0e6-282e8be2cdf5 req-4ec6843a-b079-4781-9735-8ba3cc56affb service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Updated VIF entry in instance network info cache for port 2d549e00-e710-4b20-b6b2-69deafe8ff8d. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG nova.network.neutron [req-4ff13f7c-6ecb-450c-a0e6-282e8be2cdf5 req-4ec6843a-b079-4781-9735-8ba3cc56affb service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Updating instance_info_cache with network_info: [{"id": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "address": "fa:16:3e:c3:30:66", "network": {"id": "48d05176-aee3-4bf7-a929-a2b3714e9c6e", "bridge": "br-int", "label": "tempest-TestShelveInstance-447192641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022c8a86cda4a7c90d96d60a8261cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d549e00-e7", "ovs_interfaceid": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4ff13f7c-6ecb-450c-a0e6-282e8be2cdf5 req-4ec6843a-b079-4781-9735-8ba3cc56affb service nova] Releasing lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.105s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f10c42-dc9d-4890-bdf2-1b7f082ecda9]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[811fb0a6-f1f6-4922-a2fa-6bce1552b148]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:33:51 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:33:51 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:33:51 user nova-compute[75356]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:33:51 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:33:51 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:33:51 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:33:51 user nova-compute[75356]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:33:51 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f78274-a88d-4317-ab6a-9bfae2443afd]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:33:51 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFVWetKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] <== connect_volume: return (1440ms) {'type': 'block', 'scsi_wwn': '23331333836383439', 'path': '/dev/sdc'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331333836383439', 'path': '/dev/sdc'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T20:29:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-944208577',display_name='tempest-TestShelveInstance-server-944208577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-944208577',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1797487326',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:30:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b022c8a86cda4a7c90d96d60a8261cfb',ramdisk_id='',reservation_id='r-nnfyeth2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-930711373',owner_user_name='tempest-TestShelveInstance-930711373-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:33:40Z,user_data=None,user_id='3f5c736b58ab4ccc913b8efbd8d4365f',uuid=9033b98b-fb6a-4702-8308-68363c60c6dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "address": "fa:16:3e:c3:30:66", "network": {"id": "48d05176-aee3-4bf7-a929-a2b3714e9c6e", "bridge": "br-int", "label": "tempest-TestShelveInstance-447192641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022c8a86cda4a7c90d96d60a8261cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d549e00-e7", "ovs_interfaceid": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Converting VIF {"id": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "address": "fa:16:3e:c3:30:66", "network": {"id": "48d05176-aee3-4bf7-a929-a2b3714e9c6e", "bridge": "br-int", "label": "tempest-TestShelveInstance-447192641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022c8a86cda4a7c90d96d60a8261cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d549e00-e7", "ovs_interfaceid": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:30:66,bridge_name='br-int',has_traffic_filtering=True,id=2d549e00-e710-4b20-b6b2-69deafe8ff8d,network=Network(48d05176-aee3-4bf7-a929-a2b3714e9c6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d549e00-e7') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG nova.objects.instance [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lazy-loading 'pci_devices' on Instance uuid 9033b98b-fb6a-4702-8308-68363c60c6dc {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG nova.objects.base [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Object Instance<9033b98b-fb6a-4702-8308-68363c60c6dc> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:33:52 user nova-compute[75356]:   <uuid>9033b98b-fb6a-4702-8308-68363c60c6dc</uuid>
Nov 29 20:33:52 user nova-compute[75356]:   <name>instance-00000023</name>
Nov 29 20:33:52 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:33:52 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:33:52 user nova-compute[75356]:   <metadata>
Nov 29 20:33:52 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:33:52 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:33:52 user nova-compute[75356]:       <nova:name>tempest-TestShelveInstance-server-944208577</nova:name>
Nov 29 20:33:52 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:33:51</nova:creationTime>
Nov 29 20:33:52 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:33:52 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:33:52 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:33:52 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:33:52 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:33:52 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:33:52 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:33:52 user nova-compute[75356]:       <nova:owner>
Nov 29 20:33:52 user nova-compute[75356]:         <nova:user uuid="3f5c736b58ab4ccc913b8efbd8d4365f">tempest-TestShelveInstance-930711373-project-member</nova:user>
Nov 29 20:33:52 user nova-compute[75356]:         <nova:project uuid="b022c8a86cda4a7c90d96d60a8261cfb">tempest-TestShelveInstance-930711373</nova:project>
Nov 29 20:33:52 user nova-compute[75356]:       </nova:owner>
Nov 29 20:33:52 user nova-compute[75356]:       <nova:ports>
Nov 29 20:33:52 user nova-compute[75356]:         <nova:port uuid="2d549e00-e710-4b20-b6b2-69deafe8ff8d">
Nov 29 20:33:52 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 20:33:52 user nova-compute[75356]:         </nova:port>
Nov 29 20:33:52 user nova-compute[75356]:       </nova:ports>
Nov 29 20:33:52 user nova-compute[75356]:     </nova:instance>
Nov 29 20:33:52 user nova-compute[75356]:   </metadata>
Nov 29 20:33:52 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:33:52 user nova-compute[75356]:     <system>
Nov 29 20:33:52 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:33:52 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:33:52 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:33:52 user nova-compute[75356]:       <entry name="serial">9033b98b-fb6a-4702-8308-68363c60c6dc</entry>
Nov 29 20:33:52 user nova-compute[75356]:       <entry name="uuid">9033b98b-fb6a-4702-8308-68363c60c6dc</entry>
Nov 29 20:33:52 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:33:52 user nova-compute[75356]:     </system>
Nov 29 20:33:52 user nova-compute[75356]:   </sysinfo>
Nov 29 20:33:52 user nova-compute[75356]:   <os>
Nov 29 20:33:52 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:33:52 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:33:52 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:33:52 user nova-compute[75356]:   </os>
Nov 29 20:33:52 user nova-compute[75356]:   <features>
Nov 29 20:33:52 user nova-compute[75356]:     <acpi/>
Nov 29 20:33:52 user nova-compute[75356]:     <apic/>
Nov 29 20:33:52 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:33:52 user nova-compute[75356]:   </features>
Nov 29 20:33:52 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:33:52 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:33:52 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:33:52 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:33:52 user nova-compute[75356]:   </clock>
Nov 29 20:33:52 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:33:52 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:33:52 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:33:52 user nova-compute[75356]:   </cpu>
Nov 29 20:33:52 user nova-compute[75356]:   <devices>
Nov 29 20:33:52 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:33:52 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:33:52 user nova-compute[75356]:       <source dev="/dev/sdc"/>
Nov 29 20:33:52 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:33:52 user nova-compute[75356]:       <serial>8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7</serial>
Nov 29 20:33:52 user nova-compute[75356]:     </disk>
Nov 29 20:33:52 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:33:52 user nova-compute[75356]:       <mac address="fa:16:3e:c3:30:66"/>
Nov 29 20:33:52 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:33:52 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:33:52 user nova-compute[75356]:       <target dev="tap2d549e00-e7"/>
Nov 29 20:33:52 user nova-compute[75356]:     </interface>
Nov 29 20:33:52 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:33:52 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/9033b98b-fb6a-4702-8308-68363c60c6dc/console.log" append="off"/>
Nov 29 20:33:52 user nova-compute[75356]:     </serial>
Nov 29 20:33:52 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:33:52 user nova-compute[75356]:     <video>
Nov 29 20:33:52 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:33:52 user nova-compute[75356]:     </video>
Nov 29 20:33:52 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:33:52 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:33:52 user nova-compute[75356]:     </rng>
Nov 29 20:33:52 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:33:52 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:33:52 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:33:52 user nova-compute[75356]:     </memballoon>
Nov 29 20:33:52 user nova-compute[75356]:   </devices>
Nov 29 20:33:52 user nova-compute[75356]: </domain>
Nov 29 20:33:52 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T20:29:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-944208577',display_name='tempest-TestShelveInstance-server-944208577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-944208577',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1797487326',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:30:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b022c8a86cda4a7c90d96d60a8261cfb',ramdisk_id='',reservation_id='r-nnfyeth2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-930711373',owner_user_name='tempest-TestShelveInstance-930711373-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:33:40Z,user_data=None,user_id='3f5c736b58ab4ccc913b8efbd8d4365f',uuid=9033b98b-fb6a-4702-8308-68363c60c6dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "address": "fa:16:3e:c3:30:66", "network": {"id": "48d05176-aee3-4bf7-a929-a2b3714e9c6e", "bridge": "br-int", "label": "tempest-TestShelveInstance-447192641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022c8a86cda4a7c90d96d60a8261cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d549e00-e7", "ovs_interfaceid": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Converting VIF {"id": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "address": "fa:16:3e:c3:30:66", "network": {"id": "48d05176-aee3-4bf7-a929-a2b3714e9c6e", "bridge": "br-int", "label": "tempest-TestShelveInstance-447192641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022c8a86cda4a7c90d96d60a8261cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d549e00-e7", "ovs_interfaceid": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:30:66,bridge_name='br-int',has_traffic_filtering=True,id=2d549e00-e710-4b20-b6b2-69deafe8ff8d,network=Network(48d05176-aee3-4bf7-a929-a2b3714e9c6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d549e00-e7') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG os_vif [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:30:66,bridge_name='br-int',has_traffic_filtering=True,id=2d549e00-e710-4b20-b6b2-69deafe8ff8d,network=Network(48d05176-aee3-4bf7-a929-a2b3714e9c6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d549e00-e7') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36b389be-cf77-53eb-8076-af96c4666ad4', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d549e00-e7, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d549e00-e7, col_values=(('qos', UUID('62f81d06-ee4b-4ee5-ac1a-3d99e876e4ec')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d549e00-e7, col_values=(('external_ids', {'iface-id': '2d549e00-e710-4b20-b6b2-69deafe8ff8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:30:66', 'vm-uuid': '9033b98b-fb6a-4702-8308-68363c60c6dc'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:52 user nova-compute[75356]: INFO os_vif [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:30:66,bridge_name='br-int',has_traffic_filtering=True,id=2d549e00-e710-4b20-b6b2-69deafe8ff8d,network=Network(48d05176-aee3-4bf7-a929-a2b3714e9c6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d549e00-e7')
Nov 29 20:33:52 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:33:52 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] No VIF found with MAC fa:16:3e:c3:30:66, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:33:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:54 user nova-compute[75356]: DEBUG nova.compute.manager [req-005f0484-965b-44c2-9ad2-40df41ad715f req-25bd3c4e-d2a7-4a8d-bd05-2f38d1b35a4e service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Received event network-vif-plugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:33:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-005f0484-965b-44c2-9ad2-40df41ad715f req-25bd3c4e-d2a7-4a8d-bd05-2f38d1b35a4e service nova] Acquiring lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-005f0484-965b-44c2-9ad2-40df41ad715f req-25bd3c4e-d2a7-4a8d-bd05-2f38d1b35a4e service nova] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-005f0484-965b-44c2-9ad2-40df41ad715f req-25bd3c4e-d2a7-4a8d-bd05-2f38d1b35a4e service nova] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:54 user nova-compute[75356]: DEBUG nova.compute.manager [req-005f0484-965b-44c2-9ad2-40df41ad715f req-25bd3c4e-d2a7-4a8d-bd05-2f38d1b35a4e service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] No waiting events found dispatching network-vif-plugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:33:54 user nova-compute[75356]: WARNING nova.compute.manager [req-005f0484-965b-44c2-9ad2-40df41ad715f req-25bd3c4e-d2a7-4a8d-bd05-2f38d1b35a4e service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Received unexpected event network-vif-plugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 20:33:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:56 user nova-compute[75356]: DEBUG nova.compute.manager [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:33:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:33:56 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Instance spawned successfully.
Nov 29 20:33:56 user nova-compute[75356]: DEBUG nova.compute.manager [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:33:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-af547d9e-6872-45af-9188-819181d3c7d7 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.873s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:56 user nova-compute[75356]: DEBUG nova.compute.manager [req-7d069912-1c0b-4d29-be34-63b618ea2d29 req-133ca1ab-736d-4f7f-b676-c855b21fc485 service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Received event network-vif-plugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:33:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7d069912-1c0b-4d29-be34-63b618ea2d29 req-133ca1ab-736d-4f7f-b676-c855b21fc485 service nova] Acquiring lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:33:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7d069912-1c0b-4d29-be34-63b618ea2d29 req-133ca1ab-736d-4f7f-b676-c855b21fc485 service nova] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:33:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7d069912-1c0b-4d29-be34-63b618ea2d29 req-133ca1ab-736d-4f7f-b676-c855b21fc485 service nova] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:33:56 user nova-compute[75356]: DEBUG nova.compute.manager [req-7d069912-1c0b-4d29-be34-63b618ea2d29 req-133ca1ab-736d-4f7f-b676-c855b21fc485 service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] No waiting events found dispatching network-vif-plugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:33:56 user nova-compute[75356]: WARNING nova.compute.manager [req-7d069912-1c0b-4d29-be34-63b618ea2d29 req-133ca1ab-736d-4f7f-b676-c855b21fc485 service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Received unexpected event network-vif-plugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 20:33:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:33:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid 0b59517a-c467-432a-a73a-d1460c1574e7 {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid 28f5dcc3-db77-4c65-87af-e300f99d2be5 {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid db0826f0-5fdc-47a8-ae36-5059844980c9 {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid 93183110-d2e2-4da7-ab7d-73378f5e0d42 {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9 {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3 {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid c477f425-e9ce-4b3a-b21a-8bf04401ad0b {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid 1e818d19-e8e8-4e41-83b4-53888ea21c93 {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid 4713c9eb-4052-4d65-a4eb-23e62352185a {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid bf850b0d-88b6-4ec3-b3eb-df6195be2945 {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid efda3722-c523-47e1-b942-2ec2aacf6417 {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid 9033b98b-fb6a-4702-8308-68363c60c6dc {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "0b59517a-c467-432a-a73a-d1460c1574e7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "0b59517a-c467-432a-a73a-d1460c1574e7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "28f5dcc3-db77-4c65-87af-e300f99d2be5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "db0826f0-5fdc-47a8-ae36-5059844980c9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "db0826f0-5fdc-47a8-ae36-5059844980c9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "93183110-d2e2-4da7-ab7d-73378f5e0d42" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "1e818d19-e8e8-4e41-83b4-53888ea21c93" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "efda3722-c523-47e1-b942-2ec2aacf6417" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "efda3722-c523-47e1-b942-2ec2aacf6417" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "9033b98b-fb6a-4702-8308-68363c60c6dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "0b59517a-c467-432a-a73a-d1460c1574e7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "db0826f0-5fdc-47a8-ae36-5059844980c9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "efda3722-c523-47e1-b942-2ec2aacf6417" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.123s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:02 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:34:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:03 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:34:03 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:34:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-db0826f0-5fdc-47a8-ae36-5059844980c9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:34:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-db0826f0-5fdc-47a8-ae36-5059844980c9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:34:03 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:34:03 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Updating instance_info_cache with network_info: [{"id": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "address": "fa:16:3e:80:ff:16", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56560c36-ae", "ovs_interfaceid": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:34:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-db0826f0-5fdc-47a8-ae36-5059844980c9" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:34:03 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:34:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "1e818d19-e8e8-4e41-83b4-53888ea21c93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:05 user nova-compute[75356]: INFO nova.compute.manager [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Terminating instance
Nov 29 20:34:05 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:34:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-1f00689d-8553-47aa-b70f-261a8dbc0aaa req-5f49b834-efdf-4e80-bb52-819bbda67415 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Received event network-vif-unplugged-34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:34:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1f00689d-8553-47aa-b70f-261a8dbc0aaa req-5f49b834-efdf-4e80-bb52-819bbda67415 service nova] Acquiring lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1f00689d-8553-47aa-b70f-261a8dbc0aaa req-5f49b834-efdf-4e80-bb52-819bbda67415 service nova] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1f00689d-8553-47aa-b70f-261a8dbc0aaa req-5f49b834-efdf-4e80-bb52-819bbda67415 service nova] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-1f00689d-8553-47aa-b70f-261a8dbc0aaa req-5f49b834-efdf-4e80-bb52-819bbda67415 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] No waiting events found dispatching network-vif-unplugged-34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:34:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-1f00689d-8553-47aa-b70f-261a8dbc0aaa req-5f49b834-efdf-4e80-bb52-819bbda67415 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Received event network-vif-unplugged-34d23443-7a73-4de5-972d-6c33ecf3e589 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:34:06 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Instance destroyed successfully.
Nov 29 20:34:06 user nova-compute[75356]: DEBUG nova.objects.instance [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lazy-loading 'resources' on Instance uuid 1e818d19-e8e8-4e41-83b4-53888ea21c93 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:34:06 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:28:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-432095143',display_name='tempest-TestMinimumBasicScenario-server-432095143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-432095143',id=32,image_ref='107e2895-8c31-433b-b0ad-c9cadf20f693',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP20ADnO7ShB+++7hmlI1hDB+A3N0a6D8B4tazU/BSZ85WXgZZgkMXZKn//STQQevmVFinZMFXAAXQnCpTqyk3d8kwk47aFVBtiCC7Ft6IAn9HES9kUWYi4ZuFJyH0hDuA==',key_name='tempest-TestMinimumBasicScenario-1504152284',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:29:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11b97f9fbbb34b22ab013e1892dc91c1',ramdisk_id='',reservation_id='r-65b73uo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='107e2895-8c31-433b-b0ad-c9cadf20f693',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1742449158',owner_user_name='tempest-TestMinimumBasicScenario-1742449158-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:31:26Z,user_data=None,user_id='4a111049bab1401cbe074a03692b43af',uuid=1e818d19-e8e8-4e41-83b4-53888ea21c93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34d23443-7a73-4de5-972d-6c33ecf3e589", "address": "fa:16:3e:74:01:d5", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d23443-7a", "ovs_interfaceid": "34d23443-7a73-4de5-972d-6c33ecf3e589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:34:06 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Converting VIF {"id": "34d23443-7a73-4de5-972d-6c33ecf3e589", "address": "fa:16:3e:74:01:d5", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34d23443-7a", "ovs_interfaceid": "34d23443-7a73-4de5-972d-6c33ecf3e589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:34:06 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:01:d5,bridge_name='br-int',has_traffic_filtering=True,id=34d23443-7a73-4de5-972d-6c33ecf3e589,network=Network(7408e82d-2d0b-45c2-8f7d-1b4c69cc6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d23443-7a') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:34:06 user nova-compute[75356]: DEBUG os_vif [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:01:d5,bridge_name='br-int',has_traffic_filtering=True,id=34d23443-7a73-4de5-972d-6c33ecf3e589,network=Network(7408e82d-2d0b-45c2-8f7d-1b4c69cc6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d23443-7a') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:34:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34d23443-7a, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:34:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=635180b5-ac1a-4598-8503-3407b3f50dfb) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:34:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:06 user nova-compute[75356]: INFO os_vif [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:01:d5,bridge_name='br-int',has_traffic_filtering=True,id=34d23443-7a73-4de5-972d-6c33ecf3e589,network=Network(7408e82d-2d0b-45c2-8f7d-1b4c69cc6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34d23443-7a')
Nov 29 20:34:06 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Deleting instance files /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93_del
Nov 29 20:34:06 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Deletion of /opt/stack/data/nova/instances/1e818d19-e8e8-4e41-83b4-53888ea21c93_del complete
Nov 29 20:34:06 user nova-compute[75356]: INFO nova.compute.manager [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 29 20:34:06 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:34:06 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:34:06 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:34:07 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:34:07 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Took 0.49 seconds to deallocate network for instance.
Nov 29 20:34:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-62625e53-2643-4953-acb5-12b51456f531 req-c9a594a3-9b38-4053-8544-320904d1a0f4 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Received event network-vif-deleted-34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:34:07 user nova-compute[75356]: INFO nova.compute.manager [req-62625e53-2643-4953-acb5-12b51456f531 req-c9a594a3-9b38-4053-8544-320904d1a0f4 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Neutron deleted interface 34d23443-7a73-4de5-972d-6c33ecf3e589; detaching it from the instance and deleting it from the info cache
Nov 29 20:34:07 user nova-compute[75356]: DEBUG nova.network.neutron [req-62625e53-2643-4953-acb5-12b51456f531 req-c9a594a3-9b38-4053-8544-320904d1a0f4 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:34:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-62625e53-2643-4953-acb5-12b51456f531 req-c9a594a3-9b38-4053-8544-320904d1a0f4 service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Detach interface failed, port_id=34d23443-7a73-4de5-972d-6c33ecf3e589, reason: Instance 1e818d19-e8e8-4e41-83b4-53888ea21c93 could not be found. {{(pid=75356) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 20:34:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:07 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:34:07 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:34:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:07 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:34:07 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:34:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.501s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.399s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:07 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:34:07 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Deleted allocations for instance 1e818d19-e8e8-4e41-83b4-53888ea21c93
Nov 29 20:34:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ecf44a9b-3498-494e-87fd-52bb4fff3837 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.231s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:34:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-6f719cb5-f2e8-49a3-93d6-af6efaf875ae req-2963fde2-8965-47ec-acfb-b112d534342c service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Received event network-vif-plugged-34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:34:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6f719cb5-f2e8-49a3-93d6-af6efaf875ae req-2963fde2-8965-47ec-acfb-b112d534342c service nova] Acquiring lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6f719cb5-f2e8-49a3-93d6-af6efaf875ae req-2963fde2-8965-47ec-acfb-b112d534342c service nova] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6f719cb5-f2e8-49a3-93d6-af6efaf875ae req-2963fde2-8965-47ec-acfb-b112d534342c service nova] Lock "1e818d19-e8e8-4e41-83b4-53888ea21c93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-6f719cb5-f2e8-49a3-93d6-af6efaf875ae req-2963fde2-8965-47ec-acfb-b112d534342c service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] No waiting events found dispatching network-vif-plugged-34d23443-7a73-4de5-972d-6c33ecf3e589 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:34:08 user nova-compute[75356]: WARNING nova.compute.manager [req-6f719cb5-f2e8-49a3-93d6-af6efaf875ae req-2963fde2-8965-47ec-acfb-b112d534342c service nova] [instance: 1e818d19-e8e8-4e41-83b4-53888ea21c93] Received unexpected event network-vif-plugged-34d23443-7a73-4de5-972d-6c33ecf3e589 for instance with vm_state deleted and task_state None.
Nov 29 20:34:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:34:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:34:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:34:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:12 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:34:12 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:34:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=7056MB free_disk=24.73491668701172GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:34:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0b59517a-c467-432a-a73a-d1460c1574e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:34:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:34:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance db0826f0-5fdc-47a8-ae36-5059844980c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:34:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:34:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 93183110-d2e2-4da7-ab7d-73378f5e0d42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:34:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:34:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance c477f425-e9ce-4b3a-b21a-8bf04401ad0b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:34:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4713c9eb-4052-4d65-a4eb-23e62352185a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:34:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:34:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance bf850b0d-88b6-4ec3-b3eb-df6195be2945 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:34:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:34:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance efda3722-c523-47e1-b942-2ec2aacf6417 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:34:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 9033b98b-fb6a-4702-8308-68363c60c6dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:34:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:34:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:34:13 user nova-compute[75356]: INFO nova.compute.manager [None req-6fcccde8-dc88-495a-9325-a1fa70be49db tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Get console output
Nov 29 20:34:13 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:34:13 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:34:13 user nova-compute[75356]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 29 20:34:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:34:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.579s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:34:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:34:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:34:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:34:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:34:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:34:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "6f70aee5-c3b8-4da8-8903-a305b1275552" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "6f70aee5-c3b8-4da8-8903-a305b1275552" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:34:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:34:14 user nova-compute[75356]: INFO nova.compute.claims [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Claim successful on node user
Nov 29 20:34:15 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG nova.network.neutron [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:34:15 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:34:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG nova.policy [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '081b00360a204be3bd6435807283f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6791b0c999846e2a22d5735f91ea1aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:34:15 user nova-compute[75356]: INFO nova.virt.block_device [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Booting with volume 1832be70-b887-4daf-85a9-3769ecc4059c at /dev/vda
Nov 29 20:34:15 user nova-compute[75356]: DEBUG os_brick.utils [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea89c43-2981-4759-af19-b61fac2f468e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84ece46-115f-40ce-bc17-53bb2d7e5a9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[beac43ae-8623-4a6e-a9c1-4bcc1999c6ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d8c9aa-f71d-4374-a8bf-5952b9b59a83]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:34:15 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:34:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[32982a51-bdfb-4f99-825a-d9b98bebb39d]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG os_brick.utils [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:34:15 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Updating existing volume attachment record: 3ce55a07-c3eb-4f3d-a6c1-2b39d4b5d7f9 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:34:16 user nova-compute[75356]: DEBUG nova.network.neutron [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Successfully created port: ee4221aa-038d-4682-841d-998caa343459 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:34:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:17 user nova-compute[75356]: DEBUG nova.network.neutron [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Successfully updated port: ee4221aa-038d-4682-841d-998caa343459 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:34:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "refresh_cache-6f70aee5-c3b8-4da8-8903-a305b1275552" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:34:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquired lock "refresh_cache-6f70aee5-c3b8-4da8-8903-a305b1275552" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:34:17 user nova-compute[75356]: DEBUG nova.network.neutron [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:34:17 user nova-compute[75356]: DEBUG nova.compute.manager [req-16477055-16a3-4d14-be3b-3cdfe33099f5 req-a49314d2-9292-4ed7-8f65-03298d4e8f85 service nova] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Received event network-changed-ee4221aa-038d-4682-841d-998caa343459 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:34:17 user nova-compute[75356]: DEBUG nova.compute.manager [req-16477055-16a3-4d14-be3b-3cdfe33099f5 req-a49314d2-9292-4ed7-8f65-03298d4e8f85 service nova] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Refreshing instance network info cache due to event network-changed-ee4221aa-038d-4682-841d-998caa343459. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:34:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-16477055-16a3-4d14-be3b-3cdfe33099f5 req-a49314d2-9292-4ed7-8f65-03298d4e8f85 service nova] Acquiring lock "refresh_cache-6f70aee5-c3b8-4da8-8903-a305b1275552" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:34:17 user nova-compute[75356]: DEBUG nova.network.neutron [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:34:17 user nova-compute[75356]: DEBUG nova.network.neutron [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Updating instance_info_cache with network_info: [{"id": "ee4221aa-038d-4682-841d-998caa343459", "address": "fa:16:3e:42:8d:f2", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee4221aa-03", "ovs_interfaceid": "ee4221aa-038d-4682-841d-998caa343459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:34:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Releasing lock "refresh_cache-6f70aee5-c3b8-4da8-8903-a305b1275552" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:34:17 user nova-compute[75356]: DEBUG nova.compute.manager [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Instance network_info: |[{"id": "ee4221aa-038d-4682-841d-998caa343459", "address": "fa:16:3e:42:8d:f2", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee4221aa-03", "ovs_interfaceid": "ee4221aa-038d-4682-841d-998caa343459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:34:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-16477055-16a3-4d14-be3b-3cdfe33099f5 req-a49314d2-9292-4ed7-8f65-03298d4e8f85 service nova] Acquired lock "refresh_cache-6f70aee5-c3b8-4da8-8903-a305b1275552" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:34:17 user nova-compute[75356]: DEBUG nova.network.neutron [req-16477055-16a3-4d14-be3b-3cdfe33099f5 req-a49314d2-9292-4ed7-8f65-03298d4e8f85 service nova] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Refreshing network info cache for port ee4221aa-038d-4682-841d-998caa343459 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:34:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:17 user nova-compute[75356]: DEBUG nova.network.neutron [req-16477055-16a3-4d14-be3b-3cdfe33099f5 req-a49314d2-9292-4ed7-8f65-03298d4e8f85 service nova] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Updated VIF entry in instance network info cache for port ee4221aa-038d-4682-841d-998caa343459. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:34:17 user nova-compute[75356]: DEBUG nova.network.neutron [req-16477055-16a3-4d14-be3b-3cdfe33099f5 req-a49314d2-9292-4ed7-8f65-03298d4e8f85 service nova] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Updating instance_info_cache with network_info: [{"id": "ee4221aa-038d-4682-841d-998caa343459", "address": "fa:16:3e:42:8d:f2", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee4221aa-03", "ovs_interfaceid": "ee4221aa-038d-4682-841d-998caa343459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:34:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-16477055-16a3-4d14-be3b-3cdfe33099f5 req-a49314d2-9292-4ed7-8f65-03298d4e8f85 service nova] Releasing lock "refresh_cache-6f70aee5-c3b8-4da8-8903-a305b1275552" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG nova.objects.instance [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lazy-loading 'flavor' on Instance uuid 4713c9eb-4052-4d65-a4eb-23e62352185a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:20 user nova-compute[75356]: INFO nova.compute.manager [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Attaching volume 28367bdb-268b-438c-b508-c8e395f47c52 to /dev/vdb
Nov 29 20:34:20 user nova-compute[75356]: DEBUG os_brick.utils [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6553f0-8d53-4ade-b31d-26daebc7f827]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5eeb5ac-9fa5-42e5-8747-e851a66d929a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27060ce-2c2b-449e-94d4-c20edc21c43f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1b6a2f-cdc9-45dd-a803-31e52166eebd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:34:20 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:34:20 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b3368b-c70c-4910-a55e-3f21ccf3c229]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG os_brick.utils [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:34:20 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Updating existing volume attachment record: 6bf905fb-295b-41f7-9973-2f898c69af1a {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:34:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG nova.compute.manager [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:34:23 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Creating image(s)
Nov 29 20:34:23 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Did not create local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Ensure instance console log exists: /opt/stack/data/nova/instances/6f70aee5-c3b8-4da8-8903-a305b1275552/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Start _get_guest_xml network_info=[{"id": "ee4221aa-038d-4682-841d-998caa343459", "address": "fa:16:3e:42:8d:f2", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee4221aa-03", "ovs_interfaceid": "ee4221aa-038d-4682-841d-998caa343459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVgCudKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6f70aee5-c3b8-4da8-8903-a305b1275552', 'attached_at': '', 'detached_at': '', 'volume_id': '1832be70-b887-4daf-85a9-3769ecc4059c', 'serial': '1832be70-b887-4daf-85a9-3769ecc4059c'}, 'attachment_id': '3ce55a07-c3eb-4f3d-a6c1-2b39d4b5d7f9', 'volume_type': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:34:23 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:34:23 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:34:23 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVgCudKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:34:23 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:34:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:34:23 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:34:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:34:23 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:34:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa1520c-6d18-4c7f-996a-d5b4707cdda2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:34:23 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a406301c-607d-4d3d-80b0-1fd3f7574a39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c] added
Nov 29 20:34:23 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ee236a-597a-41fd-8dae-ce94e8f1a9b8]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a512a70c-2428-41fd-b078-10e63d8c356b]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sVgCudKk {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sVgCudKk" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fea472-5445-4f7c-9ac9-82c223cec12a]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sVgCudKk'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0630c478-cdf0-4027-a6c6-c7577ca34137]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab8422e-2ee8-4f95-8efc-b3f6707f3345]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:34:24 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:34:24 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:34:24 user nova-compute[75356]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:34:24 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:34:24 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:34:24 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:34:24 user nova-compute[75356]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:34:24 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[353333a7-3aa8-4a58-8ae6-3b0d808e3604]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c, portal: 172.16.0.220,3260]
Nov 29 20:34:24 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c, portal: 172.16.0.220,3260] successful.
Nov 29 20:34:24 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b786d4-6374-4fc4-814c-1211c9d0ff6b]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53c22be-cab9-468a-a6ce-d247b978ec9e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:34:24 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:34:24 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:34:24 user nova-compute[75356]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:34:24 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:34:24 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:34:24 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:34:24 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:34:24 user nova-compute[75356]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:34:24 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:34:24 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4715c014-d92c-491e-820b-d9aac5d857b0]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVgCudKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:24 user nova-compute[75356]: INFO nova.compute.manager [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Terminating instance
Nov 29 20:34:24 user nova-compute[75356]: DEBUG nova.compute.manager [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:34:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-5da96d03-9335-4658-950a-52ef49a4a0ab req-ab00a9eb-4326-4c7e-b975-46377aaa1742 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received event network-vif-unplugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5da96d03-9335-4658-950a-52ef49a4a0ab req-ab00a9eb-4326-4c7e-b975-46377aaa1742 service nova] Acquiring lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5da96d03-9335-4658-950a-52ef49a4a0ab req-ab00a9eb-4326-4c7e-b975-46377aaa1742 service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5da96d03-9335-4658-950a-52ef49a4a0ab req-ab00a9eb-4326-4c7e-b975-46377aaa1742 service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-5da96d03-9335-4658-950a-52ef49a4a0ab req-ab00a9eb-4326-4c7e-b975-46377aaa1742 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] No waiting events found dispatching network-vif-unplugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-5da96d03-9335-4658-950a-52ef49a4a0ab req-ab00a9eb-4326-4c7e-b975-46377aaa1742 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received event network-vif-unplugged-084eeeb2-bcff-437d-ac75-85936e641045 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26131633634666164', 'path': '/dev/sdd'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131633634666164', 'path': '/dev/sdd'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:34:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-586646496',display_name='tempest-TestVolumeBootPattern-server-586646496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-586646496',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0zsffzZhgXAi/NOnOb6jr5SbjRUa5Ws+6E3ecNSbb6yR1bA/I1Lldbh3v8Eu9yysHBBgvc3puTY35+MIoawU5+qPudnUjWfeo2D4YgfUZH7hVHtowFiKG6iSLDsjXIsA==',key_name='tempest-TestVolumeBootPattern-313405727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6791b0c999846e2a22d5735f91ea1aa',ramdisk_id='',reservation_id='r-ic6sagkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1627976633',owner_user_name='tempest-TestVolumeBootPattern-1627976633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:34:16Z,user_data=None,user_id='081b00360a204be3bd6435807283f230',uuid=6f70aee5-c3b8-4da8-8903-a305b1275552,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee4221aa-038d-4682-841d-998caa343459", "address": "fa:16:3e:42:8d:f2", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee4221aa-03", "ovs_interfaceid": "ee4221aa-038d-4682-841d-998caa343459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converting VIF {"id": "ee4221aa-038d-4682-841d-998caa343459", "address": "fa:16:3e:42:8d:f2", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee4221aa-03", "ovs_interfaceid": "ee4221aa-038d-4682-841d-998caa343459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:8d:f2,bridge_name='br-int',has_traffic_filtering=True,id=ee4221aa-038d-4682-841d-998caa343459,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee4221aa-03') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG nova.objects.instance [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f70aee5-c3b8-4da8-8903-a305b1275552 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:34:25 user nova-compute[75356]:   <uuid>6f70aee5-c3b8-4da8-8903-a305b1275552</uuid>
Nov 29 20:34:25 user nova-compute[75356]:   <name>instance-00000028</name>
Nov 29 20:34:25 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:34:25 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:34:25 user nova-compute[75356]:   <metadata>
Nov 29 20:34:25 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:34:25 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:34:25 user nova-compute[75356]:       <nova:name>tempest-TestVolumeBootPattern-server-586646496</nova:name>
Nov 29 20:34:25 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:34:23</nova:creationTime>
Nov 29 20:34:25 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:34:25 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:34:25 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:34:25 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:34:25 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:34:25 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:34:25 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:34:25 user nova-compute[75356]:       <nova:owner>
Nov 29 20:34:25 user nova-compute[75356]:         <nova:user uuid="081b00360a204be3bd6435807283f230">tempest-TestVolumeBootPattern-1627976633-project-member</nova:user>
Nov 29 20:34:25 user nova-compute[75356]:         <nova:project uuid="f6791b0c999846e2a22d5735f91ea1aa">tempest-TestVolumeBootPattern-1627976633</nova:project>
Nov 29 20:34:25 user nova-compute[75356]:       </nova:owner>
Nov 29 20:34:25 user nova-compute[75356]:       <nova:ports>
Nov 29 20:34:25 user nova-compute[75356]:         <nova:port uuid="ee4221aa-038d-4682-841d-998caa343459">
Nov 29 20:34:25 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 20:34:25 user nova-compute[75356]:         </nova:port>
Nov 29 20:34:25 user nova-compute[75356]:       </nova:ports>
Nov 29 20:34:25 user nova-compute[75356]:     </nova:instance>
Nov 29 20:34:25 user nova-compute[75356]:   </metadata>
Nov 29 20:34:25 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:34:25 user nova-compute[75356]:     <system>
Nov 29 20:34:25 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:34:25 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:34:25 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:34:25 user nova-compute[75356]:       <entry name="serial">6f70aee5-c3b8-4da8-8903-a305b1275552</entry>
Nov 29 20:34:25 user nova-compute[75356]:       <entry name="uuid">6f70aee5-c3b8-4da8-8903-a305b1275552</entry>
Nov 29 20:34:25 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:34:25 user nova-compute[75356]:     </system>
Nov 29 20:34:25 user nova-compute[75356]:   </sysinfo>
Nov 29 20:34:25 user nova-compute[75356]:   <os>
Nov 29 20:34:25 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:34:25 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:34:25 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:34:25 user nova-compute[75356]:   </os>
Nov 29 20:34:25 user nova-compute[75356]:   <features>
Nov 29 20:34:25 user nova-compute[75356]:     <acpi/>
Nov 29 20:34:25 user nova-compute[75356]:     <apic/>
Nov 29 20:34:25 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:34:25 user nova-compute[75356]:   </features>
Nov 29 20:34:25 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:34:25 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:34:25 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:34:25 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:34:25 user nova-compute[75356]:   </clock>
Nov 29 20:34:25 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:34:25 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:34:25 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:34:25 user nova-compute[75356]:   </cpu>
Nov 29 20:34:25 user nova-compute[75356]:   <devices>
Nov 29 20:34:25 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:34:25 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:34:25 user nova-compute[75356]:       <source dev="/dev/sdd"/>
Nov 29 20:34:25 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:34:25 user nova-compute[75356]:       <serial>1832be70-b887-4daf-85a9-3769ecc4059c</serial>
Nov 29 20:34:25 user nova-compute[75356]:     </disk>
Nov 29 20:34:25 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:34:25 user nova-compute[75356]:       <mac address="fa:16:3e:42:8d:f2"/>
Nov 29 20:34:25 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:34:25 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:34:25 user nova-compute[75356]:       <target dev="tapee4221aa-03"/>
Nov 29 20:34:25 user nova-compute[75356]:     </interface>
Nov 29 20:34:25 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:34:25 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/6f70aee5-c3b8-4da8-8903-a305b1275552/console.log" append="off"/>
Nov 29 20:34:25 user nova-compute[75356]:     </serial>
Nov 29 20:34:25 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:34:25 user nova-compute[75356]:     <video>
Nov 29 20:34:25 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:34:25 user nova-compute[75356]:     </video>
Nov 29 20:34:25 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:34:25 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:34:25 user nova-compute[75356]:     </rng>
Nov 29 20:34:25 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:34:25 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:34:25 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:34:25 user nova-compute[75356]:     </memballoon>
Nov 29 20:34:25 user nova-compute[75356]:   </devices>
Nov 29 20:34:25 user nova-compute[75356]: </domain>
Nov 29 20:34:25 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:34:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-586646496',display_name='tempest-TestVolumeBootPattern-server-586646496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-586646496',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0zsffzZhgXAi/NOnOb6jr5SbjRUa5Ws+6E3ecNSbb6yR1bA/I1Lldbh3v8Eu9yysHBBgvc3puTY35+MIoawU5+qPudnUjWfeo2D4YgfUZH7hVHtowFiKG6iSLDsjXIsA==',key_name='tempest-TestVolumeBootPattern-313405727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6791b0c999846e2a22d5735f91ea1aa',ramdisk_id='',reservation_id='r-ic6sagkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1627976633',owner_user_name='tempest-TestVolumeBootPattern-1627976633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:34:16Z,user_data=None,user_id='081b00360a204be3bd6435807283f230',uuid=6f70aee5-c3b8-4da8-8903-a305b1275552,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee4221aa-038d-4682-841d-998caa343459", "address": "fa:16:3e:42:8d:f2", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee4221aa-03", "ovs_interfaceid": "ee4221aa-038d-4682-841d-998caa343459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converting VIF {"id": "ee4221aa-038d-4682-841d-998caa343459", "address": "fa:16:3e:42:8d:f2", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee4221aa-03", "ovs_interfaceid": "ee4221aa-038d-4682-841d-998caa343459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:8d:f2,bridge_name='br-int',has_traffic_filtering=True,id=ee4221aa-038d-4682-841d-998caa343459,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee4221aa-03') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG os_vif [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:8d:f2,bridge_name='br-int',has_traffic_filtering=True,id=ee4221aa-038d-4682-841d-998caa343459,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee4221aa-03') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e67c33ea-150d-5d2d-8d4c-7769981b4c08', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee4221aa-03, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee4221aa-03, col_values=(('qos', UUID('3273cd0f-0f18-427c-b673-ec04691b82e8')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee4221aa-03, col_values=(('external_ids', {'iface-id': 'ee4221aa-038d-4682-841d-998caa343459', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:8d:f2', 'vm-uuid': '6f70aee5-c3b8-4da8-8903-a305b1275552'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:25 user nova-compute[75356]: INFO os_vif [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:8d:f2,bridge_name='br-int',has_traffic_filtering=True,id=ee4221aa-038d-4682-841d-998caa343459,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee4221aa-03')
Nov 29 20:34:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] No VIF found with MAC fa:16:3e:42:8d:f2, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:25 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Instance destroyed successfully.
Nov 29 20:34:25 user nova-compute[75356]: DEBUG nova.objects.instance [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lazy-loading 'resources' on Instance uuid c477f425-e9ce-4b3a-b21a-8bf04401ad0b {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:28:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1570981937',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1570981937',id=31,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:30:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bed33acdfd5f48b9967d1dd68c261d78',ramdisk_id='',reservation_id='r-oglasv8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2041863686',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:32:39Z,user_data=None,user_id='e395b4248b794d65915edf2d23bbbeaf',uuid=c477f425-e9ce-4b3a-b21a-8bf04401ad0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "084eeeb2-bcff-437d-ac75-85936e641045", "address": "fa:16:3e:a1:86:c2", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084eeeb2-bc", "ovs_interfaceid": "084eeeb2-bcff-437d-ac75-85936e641045", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Converting VIF {"id": "084eeeb2-bcff-437d-ac75-85936e641045", "address": "fa:16:3e:a1:86:c2", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084eeeb2-bc", "ovs_interfaceid": "084eeeb2-bcff-437d-ac75-85936e641045", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:86:c2,bridge_name='br-int',has_traffic_filtering=True,id=084eeeb2-bcff-437d-ac75-85936e641045,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084eeeb2-bc') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:34:25 user nova-compute[75356]: DEBUG os_vif [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:86:c2,bridge_name='br-int',has_traffic_filtering=True,id=084eeeb2-bcff-437d-ac75-85936e641045,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084eeeb2-bc') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap084eeeb2-bc, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6686e28-b211-4a8a-97dd-ed34f58bdbb9) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:26 user nova-compute[75356]: INFO os_vif [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:86:c2,bridge_name='br-int',has_traffic_filtering=True,id=084eeeb2-bcff-437d-ac75-85936e641045,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084eeeb2-bc')
Nov 29 20:34:26 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGgkRYyn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:34:26 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:34:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8394879d-0044-4552-ac07-c9882f387a54]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:34:26 user nova-compute[75356]: No targets found.
Nov 29 20:34:26 user nova-compute[75356]: iSNS:
Nov 29 20:34:26 user nova-compute[75356]: No targets found.
Nov 29 20:34:26 user nova-compute[75356]: STATIC:
Nov 29 20:34:26 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c
Nov 29 20:34:26 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:34:26 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:34:26 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09
Nov 29 20:34:26 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:34:26 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:34:26 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7
Nov 29 20:34:26 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:34:26 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:34:26 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8
Nov 29 20:34:26 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:34:26 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:34:26 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:34:26 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:34:26 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:34:26 user nova-compute[75356]: FIRMWARE:
Nov 29 20:34:26 user nova-compute[75356]: No targets found.
Nov 29 20:34:26 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:34:26 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:34:26 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c160201-5a96-4fdf-89f5-2ae7cb3ea72a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c03751d-4d94-4896-a733-2b3bc8e48641]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:34:26 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:34:26 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:34:26 user nova-compute[75356]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:34:26 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:34:26 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:34:26 user nova-compute[75356]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 (non-flash)
Nov 29 20:34:26 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:34:26 user nova-compute[75356]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:34:26 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:34:26 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e422c4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8'): ({'sdf'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Removing single pathed devices sdf {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a8c083-cfb5-4f59-95c1-140887e3ad6c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d23d3fc-fa9a-4451-8775-fde9b5f1948d]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Flushing IO for device /dev/sdf {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9441e627-c710-463a-8b6e-74ab4c045113]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[331edcb9-bceb-4e9d-b0cb-c57566eb6784]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] SCSI volumes sdf have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb7125b-bd55-4e57-b883-f39758039d2a]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdab38e-d308-4fb4-bdf1-2cd2d22f3fa8]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8, portal: 172.16.0.220,3260]
Nov 29 20:34:26 user nova-compute[75356]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8, portal: 172.16.0.220,3260] successful.
Nov 29 20:34:26 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18e1140c-2d7b-4c23-b3d3-9e7fc6bed4f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[399e1735-f87d-4cee-89fd-da691dea0bf1]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] <== disconnect_volume: return (336ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:34:26 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Deleting instance files /opt/stack/data/nova/instances/c477f425-e9ce-4b3a-b21a-8bf04401ad0b_del
Nov 29 20:34:26 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Deletion of /opt/stack/data/nova/instances/c477f425-e9ce-4b3a-b21a-8bf04401ad0b_del complete
Nov 29 20:34:26 user nova-compute[75356]: INFO nova.compute.manager [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Took 1.54 seconds to destroy the instance on the hypervisor.
Nov 29 20:34:26 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-0d752f84-822c-454f-8148-cdb123eeafc5 req-1d08bd4a-4e5a-463f-9636-5f4e06dfd456 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received event network-vif-deleted-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:34:27 user nova-compute[75356]: INFO nova.compute.manager [req-0d752f84-822c-454f-8148-cdb123eeafc5 req-1d08bd4a-4e5a-463f-9636-5f4e06dfd456 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Neutron deleted interface 084eeeb2-bcff-437d-ac75-85936e641045; detaching it from the instance and deleting it from the info cache
Nov 29 20:34:27 user nova-compute[75356]: DEBUG nova.network.neutron [req-0d752f84-822c-454f-8148-cdb123eeafc5 req-1d08bd4a-4e5a-463f-9636-5f4e06dfd456 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:34:27 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Took 0.71 seconds to deallocate network for instance.
Nov 29 20:34:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-0d752f84-822c-454f-8148-cdb123eeafc5 req-1d08bd4a-4e5a-463f-9636-5f4e06dfd456 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Detach interface failed, port_id=084eeeb2-bcff-437d-ac75-85936e641045, reason: Instance c477f425-e9ce-4b3a-b21a-8bf04401ad0b could not be found. {{(pid=75356) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] Acquiring lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] No waiting events found dispatching network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:34:27 user nova-compute[75356]: WARNING nova.compute.manager [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received unexpected event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 for instance with vm_state active and task_state deleting.
Nov 29 20:34:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] Acquiring lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] No waiting events found dispatching network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:34:27 user nova-compute[75356]: WARNING nova.compute.manager [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received unexpected event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 for instance with vm_state active and task_state deleting.
Nov 29 20:34:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] Acquiring lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] No waiting events found dispatching network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:34:27 user nova-compute[75356]: WARNING nova.compute.manager [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received unexpected event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 for instance with vm_state active and task_state deleting.
Nov 29 20:34:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received event network-vif-unplugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] Acquiring lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] No waiting events found dispatching network-vif-unplugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received event network-vif-unplugged-084eeeb2-bcff-437d-ac75-85936e641045 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] Acquiring lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] No waiting events found dispatching network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:34:27 user nova-compute[75356]: WARNING nova.compute.manager [req-e9496a7e-d828-4c8f-b27c-9fcb4801818b req-d465648d-d7b6-4f5e-ab4c-14323910efd3 service nova] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Received unexpected event network-vif-plugged-084eeeb2-bcff-437d-ac75-85936e641045 for instance with vm_state active and task_state deleting.
Nov 29 20:34:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:28 user nova-compute[75356]: INFO nova.compute.manager [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: c477f425-e9ce-4b3a-b21a-8bf04401ad0b] Took 0.86 seconds to detach 1 volumes for instance.
Nov 29 20:34:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:28 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Deleted allocations for instance c477f425-e9ce-4b3a-b21a-8bf04401ad0b
Nov 29 20:34:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-9816b57a-315f-45e6-af8a-d1b626f4dd26 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "c477f425-e9ce-4b3a-b21a-8bf04401ad0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.746s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OPnArjEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:34:28 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:34:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:34:28 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:34:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:34:28 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:34:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[801677db-55dc-4eaf-86cd-c1d0cd903ce1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:34:28 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7fd578-c320-49e2-9f69-57d92c4a7858]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52] added
Nov 29 20:34:28 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[04210290-4721-4f29-9dde-acfb35d92f6e]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1495f46c-969f-4c56-8d01-c3514e8e3656]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OPnArjEK {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OPnArjEK" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e54c410-dad3-4970-b31f-35653c75d779]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OPnArjEK'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[269054fe-a88c-4446-8c75-aab543d101ae]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:28 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f417f5-d315-48ba-9ff2-33cde92e9181]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:34:29 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:34:29 user nova-compute[75356]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:34:29 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:34:29 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:34:29 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:34:29 user nova-compute[75356]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:34:29 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:34:29 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG nova.compute.manager [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:34:29 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Instance spawned successfully.
Nov 29 20:34:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec328a6-825d-47d8-b404-77c64a1aab6d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52, portal: 172.16.0.220,3260]
Nov 29 20:34:29 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52, portal: 172.16.0.220,3260] successful.
Nov 29 20:34:29 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9da7181-592c-4e3e-9441-a7b8cc323229]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e10f5df-55bc-4b20-830c-00ad66bed1dd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:34:29 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:34:29 user nova-compute[75356]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:34:29 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:34:29 user nova-compute[75356]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 (non-flash)
Nov 29 20:34:29 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:34:29 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:34:29 user nova-compute[75356]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:34:29 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:34:29 user nova-compute[75356]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 (non-flash)
Nov 29 20:34:29 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cb0738-821b-4c54-a9e6-628e9a977e63]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OPnArjEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG nova.compute.manager [req-48b51683-881a-4725-a7ff-38d6f52f4308 req-aecc3d6b-d81d-4cdc-871a-5434aa89c4fc service nova] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Received event network-vif-plugged-ee4221aa-038d-4682-841d-998caa343459 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-48b51683-881a-4725-a7ff-38d6f52f4308 req-aecc3d6b-d81d-4cdc-871a-5434aa89c4fc service nova] Acquiring lock "6f70aee5-c3b8-4da8-8903-a305b1275552-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-48b51683-881a-4725-a7ff-38d6f52f4308 req-aecc3d6b-d81d-4cdc-871a-5434aa89c4fc service nova] Lock "6f70aee5-c3b8-4da8-8903-a305b1275552-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-48b51683-881a-4725-a7ff-38d6f52f4308 req-aecc3d6b-d81d-4cdc-871a-5434aa89c4fc service nova] Lock "6f70aee5-c3b8-4da8-8903-a305b1275552-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG nova.compute.manager [req-48b51683-881a-4725-a7ff-38d6f52f4308 req-aecc3d6b-d81d-4cdc-871a-5434aa89c4fc service nova] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] No waiting events found dispatching network-vif-plugged-ee4221aa-038d-4682-841d-998caa343459 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:34:29 user nova-compute[75356]: WARNING nova.compute.manager [req-48b51683-881a-4725-a7ff-38d6f52f4308 req-aecc3d6b-d81d-4cdc-871a-5434aa89c4fc service nova] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Received unexpected event network-vif-plugged-ee4221aa-038d-4682-841d-998caa343459 for instance with vm_state building and task_state spawning.
Nov 29 20:34:29 user nova-compute[75356]: DEBUG nova.compute.manager [req-48b51683-881a-4725-a7ff-38d6f52f4308 req-aecc3d6b-d81d-4cdc-871a-5434aa89c4fc service nova] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Received event network-vif-plugged-ee4221aa-038d-4682-841d-998caa343459 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-48b51683-881a-4725-a7ff-38d6f52f4308 req-aecc3d6b-d81d-4cdc-871a-5434aa89c4fc service nova] Acquiring lock "6f70aee5-c3b8-4da8-8903-a305b1275552-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-48b51683-881a-4725-a7ff-38d6f52f4308 req-aecc3d6b-d81d-4cdc-871a-5434aa89c4fc service nova] Lock "6f70aee5-c3b8-4da8-8903-a305b1275552-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-48b51683-881a-4725-a7ff-38d6f52f4308 req-aecc3d6b-d81d-4cdc-871a-5434aa89c4fc service nova] Lock "6f70aee5-c3b8-4da8-8903-a305b1275552-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:29 user nova-compute[75356]: DEBUG nova.compute.manager [req-48b51683-881a-4725-a7ff-38d6f52f4308 req-aecc3d6b-d81d-4cdc-871a-5434aa89c4fc service nova] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] No waiting events found dispatching network-vif-plugged-ee4221aa-038d-4682-841d-998caa343459 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:34:29 user nova-compute[75356]: WARNING nova.compute.manager [req-48b51683-881a-4725-a7ff-38d6f52f4308 req-aecc3d6b-d81d-4cdc-871a-5434aa89c4fc service nova] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Received unexpected event network-vif-plugged-ee4221aa-038d-4682-841d-998caa343459 for instance with vm_state building and task_state spawning.
Nov 29 20:34:29 user nova-compute[75356]: INFO nova.compute.manager [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 29 20:34:29 user nova-compute[75356]: DEBUG nova.compute.manager [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:34:29 user nova-compute[75356]: INFO nova.compute.manager [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Took 14.38 seconds to build instance.
Nov 29 20:34:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-819c50c1-f678-42b8-8a9f-822675712939 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "6f70aee5-c3b8-4da8-8903-a305b1275552" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.476s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:34:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23366383031333131', 'path': '/dev/sde'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:34:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366383031333131', 'path': '/dev/sde'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:34:30 user nova-compute[75356]: DEBUG nova.objects.instance [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lazy-loading 'flavor' on Instance uuid 4713c9eb-4052-4d65-a4eb-23e62352185a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:34:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:34:30 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:34:30 user nova-compute[75356]:   <source dev="/dev/sde"/>
Nov 29 20:34:30 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:34:30 user nova-compute[75356]:   <serial>28367bdb-268b-438c-b508-c8e395f47c52</serial>
Nov 29 20:34:30 user nova-compute[75356]: </disk>
Nov 29 20:34:30 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:34:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:34:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:34:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] No VIF found with MAC fa:16:3e:6d:3e:e2, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:34:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-67b424ab-2bc2-4a4a-9c2b-4d8cb94261d3 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.370s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:32 user nova-compute[75356]: INFO nova.compute.manager [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Detaching volume 28367bdb-268b-438c-b508-c8e395f47c52
Nov 29 20:34:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:32 user nova-compute[75356]: INFO nova.virt.block_device [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Attempting to driver detach volume 28367bdb-268b-438c-b508-c8e395f47c52 from mountpoint /dev/vdb
Nov 29 20:34:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Attempting to detach device vdb from instance 4713c9eb-4052-4d65-a4eb-23e62352185a from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:34:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:34:32 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:34:32 user nova-compute[75356]:   <source dev="/dev/sde"/>
Nov 29 20:34:32 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:34:32 user nova-compute[75356]:   <serial>28367bdb-268b-438c-b508-c8e395f47c52</serial>
Nov 29 20:34:32 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:34:32 user nova-compute[75356]: </disk>
Nov 29 20:34:32 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:34:32 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Successfully detached device vdb from instance 4713c9eb-4052-4d65-a4eb-23e62352185a from the persistent domain config.
Nov 29 20:34:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4713c9eb-4052-4d65-a4eb-23e62352185a from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:34:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:34:32 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:34:32 user nova-compute[75356]:   <source dev="/dev/sde"/>
Nov 29 20:34:32 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:34:32 user nova-compute[75356]:   <serial>28367bdb-268b-438c-b508-c8e395f47c52</serial>
Nov 29 20:34:32 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:34:32 user nova-compute[75356]: </disk>
Nov 29 20:34:32 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:34:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4713c9eb-4052-4d65-a4eb-23e62352185a {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:34:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:34:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG nova.compute.manager [req-c7173db6-73fc-462f-9b4f-cbd14867b47f req-4dc6d92c-452f-4ab6-9d27-d4dad3484712 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received event network-changed-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG nova.compute.manager [req-c7173db6-73fc-462f-9b4f-cbd14867b47f req-4dc6d92c-452f-4ab6-9d27-d4dad3484712 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Refreshing instance network info cache due to event network-changed-c68da58a-baf1-4054-8d8c-d0736ec173a5. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c7173db6-73fc-462f-9b4f-cbd14867b47f req-4dc6d92c-452f-4ab6-9d27-d4dad3484712 service nova] Acquiring lock "refresh_cache-bf850b0d-88b6-4ec3-b3eb-df6195be2945" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c7173db6-73fc-462f-9b4f-cbd14867b47f req-4dc6d92c-452f-4ab6-9d27-d4dad3484712 service nova] Acquired lock "refresh_cache-bf850b0d-88b6-4ec3-b3eb-df6195be2945" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG nova.network.neutron [req-c7173db6-73fc-462f-9b4f-cbd14867b47f req-4dc6d92c-452f-4ab6-9d27-d4dad3484712 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Refreshing network info cache for port c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG nova.objects.instance [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'flavor' on Instance uuid bf850b0d-88b6-4ec3-b3eb-df6195be2945 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:34:49 user nova-compute[75356]: INFO nova.compute.manager [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Attaching volume 6ff66e71-1b63-495e-b333-2d3df67f7345 to /dev/vdb
Nov 29 20:34:49 user nova-compute[75356]: DEBUG os_brick.utils [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c47ed1a-9e3b-4937-be04-0c952ee0cc9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df1c0ef-18d0-41db-9396-603ba459e7f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[545b70b3-ca86-4ae2-a420-460a2466e802]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb11842-4bc0-4f23-894b-12fdd3c17c9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG nova.network.neutron [req-c7173db6-73fc-462f-9b4f-cbd14867b47f req-4dc6d92c-452f-4ab6-9d27-d4dad3484712 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Updated VIF entry in instance network info cache for port c68da58a-baf1-4054-8d8c-d0736ec173a5. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG nova.network.neutron [req-c7173db6-73fc-462f-9b4f-cbd14867b47f req-4dc6d92c-452f-4ab6-9d27-d4dad3484712 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Updating instance_info_cache with network_info: [{"id": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "address": "fa:16:3e:57:b8:2a", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68da58a-ba", "ovs_interfaceid": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:34:49 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:34:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c7173db6-73fc-462f-9b4f-cbd14867b47f req-4dc6d92c-452f-4ab6-9d27-d4dad3484712 service nova] Releasing lock "refresh_cache-bf850b0d-88b6-4ec3-b3eb-df6195be2945" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3a980c-e552-4e7d-8d23-fc6e99b708b4]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG os_brick.utils [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:34:49 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Updating existing volume attachment record: 577d572e-1523-4c19-b967-34be6a02e351 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:34:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:53 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4713c9eb-4052-4d65-a4eb-23e62352185a is timed out.
Nov 29 20:34:53 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Successfully detached device vdb from instance 4713c9eb-4052-4d65-a4eb-23e62352185a from the live domain config.
Nov 29 20:34:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OPnArjEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:34:53 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:34:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[07938801-8894-4aea-808a-473d8c22c9b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:34:53 user nova-compute[75356]: No targets found.
Nov 29 20:34:53 user nova-compute[75356]: iSNS:
Nov 29 20:34:53 user nova-compute[75356]: No targets found.
Nov 29 20:34:53 user nova-compute[75356]: STATIC:
Nov 29 20:34:53 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c
Nov 29 20:34:53 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:34:53 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:34:53 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09
Nov 29 20:34:53 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:34:53 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:34:53 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7
Nov 29 20:34:53 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:34:53 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:34:53 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52
Nov 29 20:34:53 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:34:53 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:34:53 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:34:53 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:34:53 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:34:53 user nova-compute[75356]: FIRMWARE:
Nov 29 20:34:53 user nova-compute[75356]: No targets found.
Nov 29 20:34:53 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:34:53 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:34:53 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5afa593-77c4-4038-8fba-a241dad5d4f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5130eb-1e86-4655-9d36-acac85a0cc86]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:34:53 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:34:53 user nova-compute[75356]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:34:53 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:34:53 user nova-compute[75356]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 (non-flash)
Nov 29 20:34:53 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:34:53 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:34:53 user nova-compute[75356]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:34:53 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:34:53 user nova-compute[75356]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 (non-flash)
Nov 29 20:34:53 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e41b2ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52'): ({'sde'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Removing single pathed devices sde {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[87524f9a-8751-40c7-9930-8c30970d19e9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4959eecd-96e8-47f6-9d95-0496661287e2]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Flushing IO for device /dev/sde {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[802a9fb7-f446-48b2-8c23-779894ba9a83]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2e527e-53b8-49fc-b027-cadf8aaf1775]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] SCSI volumes sde have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[838fd5dd-311f-43cc-894a-04efa3b7c6d7]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b6213c-0f71-4358-9693-f41611003696]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52, portal: 172.16.0.220,3260]
Nov 29 20:34:53 user nova-compute[75356]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52, portal: 172.16.0.220,3260] successful.
Nov 29 20:34:53 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28367bdb-268b-438c-b508-c8e395f47c52 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[410fa37c-d172-464b-a615-396f98755762]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] <== disconnect_volume: return (328ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:34:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:34:54 user nova-compute[75356]: DEBUG nova.objects.instance [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lazy-loading 'flavor' on Instance uuid 4713c9eb-4052-4d65-a4eb-23e62352185a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:34:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-90b59156-ef5b-47a9-92c0-012085cb4f62 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.790s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:34:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jBDvpZQt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:34:57 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:34:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:34:57 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:34:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:34:57 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c427e276-1e4c-44d6-9581-b4c2f01a3117]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:34:57 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[936c4b85-7b2f-4f79-90cd-33d74f182a7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345] added
Nov 29 20:34:57 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83fc221-3293-4677-acf0-b2da666567e4]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eda5571-6943-42ce-838e-0800832c00dc]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jBDvpZQt {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jBDvpZQt" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f59b65-3aa2-43e2-8a2a-89141fb51ec2]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jBDvpZQt'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a556f2a-f780-4c76-a4fb-18898ef98a0d]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[914c6459-4fae-4de0-9a81-70ddf05e61b9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:34:57 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:34:57 user nova-compute[75356]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:34:57 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:34:57 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:34:57 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:34:57 user nova-compute[75356]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:34:57 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:34:57 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[766acd1c-a36f-4545-94de-2a3666cab8ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345, portal: 172.16.0.220,3260]
Nov 29 20:34:57 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345, portal: 172.16.0.220,3260] successful.
Nov 29 20:34:57 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d940b70-1d63-4cc1-b025-041ea06d94c9]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3fb092-40ef-4574-b837-422169133401]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:34:57 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:34:57 user nova-compute[75356]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:34:57 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:34:57 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:34:57 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:34:57 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:34:57 user nova-compute[75356]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:34:57 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:34:57 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:34:57 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:34:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f38ea3-c1cd-4deb-8418-ccc7618fa45a]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:34:58 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: None {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:34:59 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:34:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jBDvpZQt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:34:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:34:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23166623631353434', 'path': '/dev/sde'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:34:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166623631353434', 'path': '/dev/sde'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:34:59 user nova-compute[75356]: DEBUG nova.objects.instance [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'flavor' on Instance uuid bf850b0d-88b6-4ec3-b3eb-df6195be2945 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:34:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:34:59 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:34:59 user nova-compute[75356]:   <source dev="/dev/sde"/>
Nov 29 20:34:59 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:34:59 user nova-compute[75356]:   <serial>6ff66e71-1b63-495e-b333-2d3df67f7345</serial>
Nov 29 20:34:59 user nova-compute[75356]: </disk>
Nov 29 20:34:59 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:34:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:34:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:34:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] No VIF found with MAC fa:16:3e:57:b8:2a, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:34:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e40d74ad-2591-4822-b1ec-7151f6de4228 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.042s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "ffb04928-4f5f-4461-aa24-6363d1c9b941" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:35:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:00 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:35:00 user nova-compute[75356]: INFO nova.compute.claims [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Claim successful on node user
Nov 29 20:35:00 user nova-compute[75356]: INFO nova.compute.manager [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Rescuing
Nov 29 20:35:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "refresh_cache-bf850b0d-88b6-4ec3-b3eb-df6195be2945" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:35:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquired lock "refresh_cache-bf850b0d-88b6-4ec3-b3eb-df6195be2945" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:35:00 user nova-compute[75356]: DEBUG nova.network.neutron [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:35:00 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:35:00 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:35:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:35:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:35:00 user nova-compute[75356]: DEBUG nova.network.neutron [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:35:00 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:35:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:35:01 user nova-compute[75356]: DEBUG nova.compute.manager [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:35:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:35:01 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Creating image(s)
Nov 29 20:35:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "/opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "/opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "/opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:01 user nova-compute[75356]: DEBUG nova.policy [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a111049bab1401cbe074a03692b43af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b97f9fbbb34b22ab013e1892dc91c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:35:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7.part --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:01 user nova-compute[75356]: DEBUG nova.network.neutron [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Updating instance_info_cache with network_info: [{"id": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "address": "fa:16:3e:57:b8:2a", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68da58a-ba", "ovs_interfaceid": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:35:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Releasing lock "refresh_cache-bf850b0d-88b6-4ec3-b3eb-df6195be2945" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:35:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7.part --force-share --output=json" returned: 0 in 0.223s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:01 user nova-compute[75356]: DEBUG nova.virt.images [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] 6ee4f8ae-4cf2-4957-8248-d49911d42db6 was qcow2, converting to raw {{(pid=75356) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 20:35:01 user nova-compute[75356]: DEBUG nova.privsep.utils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75356) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 20:35:01 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7.part /opt/stack/data/nova/instances/_base/1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7.converted {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:01 user nova-compute[75356]: DEBUG nova.network.neutron [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Successfully created port: 65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:35:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:02 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:35:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-f6e2f160-d479-4570-a86c-3a2dbe613eab req-2202413c-5999-4d92-886a-52d1e20ebaf0 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received event network-vif-unplugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:35:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f6e2f160-d479-4570-a86c-3a2dbe613eab req-2202413c-5999-4d92-886a-52d1e20ebaf0 service nova] Acquiring lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f6e2f160-d479-4570-a86c-3a2dbe613eab req-2202413c-5999-4d92-886a-52d1e20ebaf0 service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f6e2f160-d479-4570-a86c-3a2dbe613eab req-2202413c-5999-4d92-886a-52d1e20ebaf0 service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-f6e2f160-d479-4570-a86c-3a2dbe613eab req-2202413c-5999-4d92-886a-52d1e20ebaf0 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] No waiting events found dispatching network-vif-unplugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:35:02 user nova-compute[75356]: WARNING nova.compute.manager [req-f6e2f160-d479-4570-a86c-3a2dbe613eab req-2202413c-5999-4d92-886a-52d1e20ebaf0 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received unexpected event network-vif-unplugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 for instance with vm_state active and task_state rescuing.
Nov 29 20:35:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7.part /opt/stack/data/nova/instances/_base/1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7.converted" returned: 0 in 1.046s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7.converted --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.866s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:02 user nova-compute[75356]: DEBUG nova.network.neutron [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Successfully updated port: 65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:35:02 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Instance destroyed successfully.
Nov 29 20:35:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "refresh_cache-ffb04928-4f5f-4461-aa24-6363d1c9b941" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:35:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquired lock "refresh_cache-ffb04928-4f5f-4461-aa24-6363d1c9b941" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:35:02 user nova-compute[75356]: DEBUG nova.network.neutron [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:35:02 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Attempting rescue
Nov 29 20:35:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75356) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 20:35:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Instance directory exists: not creating {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 20:35:03 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Creating image(s)
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "/opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "/opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.objects.instance [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'trusted_certs' on Instance uuid bf850b0d-88b6-4ec3-b3eb-df6195be2945 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.network.neutron [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7 --force-share --output=json" returned: 0 in 0.193s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.173s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk.rescue {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk.rescue" returned: 0 in 0.049s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.objects.instance [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'migration_context' on Instance uuid bf850b0d-88b6-4ec3-b3eb-df6195be2945 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.objects.base [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Object Instance<bf850b0d-88b6-4ec3-b3eb-df6195be2945> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Start _get_guest_xml network_info=[{"id": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "address": "fa:16:3e:57:b8:2a", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "vif_mac": "fa:16:3e:57:b8:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68da58a-ba", "ovs_interfaceid": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.objects.instance [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'resources' on Instance uuid bf850b0d-88b6-4ec3-b3eb-df6195be2945 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7 --force-share --output=json" returned: 0 in 0.173s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7,backing_fmt=raw /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.objects.base [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Object Instance<bf850b0d-88b6-4ec3-b3eb-df6195be2945> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.objects.instance [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'numa_topology' on Instance uuid bf850b0d-88b6-4ec3-b3eb-df6195be2945 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7,backing_fmt=raw /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk 1073741824" returned: 0 in 0.054s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.objects.base [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Object Instance<bf850b0d-88b6-4ec3-b3eb-df6195be2945> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:03 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:35:03 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.objects.instance [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'vcpu_model' on Instance uuid bf850b0d-88b6-4ec3-b3eb-df6195be2945 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.network.neutron [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Updating instance_info_cache with network_info: [{"id": "65c10bc1-9ed3-4330-82bf-bb977579b739", "address": "fa:16:3e:83:e1:42", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c10bc1-9e", "ovs_interfaceid": "65c10bc1-9ed3-4330-82bf-bb977579b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.objects.base [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Object Instance<bf850b0d-88b6-4ec3-b3eb-df6195be2945> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:32:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1279500512',display_name='tempest-ServerRescueNegativeTestJSON-server-1279500512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1279500512',id=38,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF11C4US8gSibeaQM27SECgiQU3I/sB2B86cuWv8uvblsz8cGE+2M7ux0RHT1RkjaiHOFsNsN1i6QktVOsaM1fhYGGMYME9YUYb7wz5LFi1TSv4w9oVpMrtHeAYjjVJ7wQ==',key_name='tempest-keypair-897338036',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:33:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34dff0986b1d47fdaf305c87e323d19e',ramdisk_id='',reservation_id='r-3fuhqa8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1204717931',owner_user_name='tempest-ServerRescueNegativeTestJSON-1204717931-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:33:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00cdfe6527e04f049b5e38685bc1f257',uuid=bf850b0d-88b6-4ec3-b3eb-df6195be2945,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "address": "fa:16:3e:57:b8:2a", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "vif_mac": "fa:16:3e:57:b8:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68da58a-ba", "ovs_interfaceid": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converting VIF {"id": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "address": "fa:16:3e:57:b8:2a", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "vif_mac": "fa:16:3e:57:b8:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68da58a-ba", "ovs_interfaceid": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:b8:2a,bridge_name='br-int',has_traffic_filtering=True,id=c68da58a-baf1-4054-8d8c-d0736ec173a5,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc68da58a-ba') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.objects.instance [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'pci_devices' on Instance uuid bf850b0d-88b6-4ec3-b3eb-df6195be2945 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Releasing lock "refresh_cache-ffb04928-4f5f-4461-aa24-6363d1c9b941" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.compute.manager [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Instance network_info: |[{"id": "65c10bc1-9ed3-4330-82bf-bb977579b739", "address": "fa:16:3e:83:e1:42", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c10bc1-9e", "ovs_interfaceid": "65c10bc1-9ed3-4330-82bf-bb977579b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.objects.base [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Object Instance<bf850b0d-88b6-4ec3-b3eb-df6195be2945> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:35:03 user nova-compute[75356]:   <uuid>bf850b0d-88b6-4ec3-b3eb-df6195be2945</uuid>
Nov 29 20:35:03 user nova-compute[75356]:   <name>instance-00000026</name>
Nov 29 20:35:03 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:35:03 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:35:03 user nova-compute[75356]:   <metadata>
Nov 29 20:35:03 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:35:03 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:35:03 user nova-compute[75356]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1279500512</nova:name>
Nov 29 20:35:03 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:35:03</nova:creationTime>
Nov 29 20:35:03 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:35:03 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:35:03 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:35:03 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:35:03 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:35:03 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:35:03 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:35:03 user nova-compute[75356]:       <nova:owner>
Nov 29 20:35:03 user nova-compute[75356]:         <nova:user uuid="00cdfe6527e04f049b5e38685bc1f257">tempest-ServerRescueNegativeTestJSON-1204717931-project-member</nova:user>
Nov 29 20:35:03 user nova-compute[75356]:         <nova:project uuid="34dff0986b1d47fdaf305c87e323d19e">tempest-ServerRescueNegativeTestJSON-1204717931</nova:project>
Nov 29 20:35:03 user nova-compute[75356]:       </nova:owner>
Nov 29 20:35:03 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:35:03 user nova-compute[75356]:       <nova:ports>
Nov 29 20:35:03 user nova-compute[75356]:         <nova:port uuid="c68da58a-baf1-4054-8d8c-d0736ec173a5">
Nov 29 20:35:03 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 20:35:03 user nova-compute[75356]:         </nova:port>
Nov 29 20:35:03 user nova-compute[75356]:       </nova:ports>
Nov 29 20:35:03 user nova-compute[75356]:     </nova:instance>
Nov 29 20:35:03 user nova-compute[75356]:   </metadata>
Nov 29 20:35:03 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:35:03 user nova-compute[75356]:     <system>
Nov 29 20:35:03 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:35:03 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:35:03 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:35:03 user nova-compute[75356]:       <entry name="serial">bf850b0d-88b6-4ec3-b3eb-df6195be2945</entry>
Nov 29 20:35:03 user nova-compute[75356]:       <entry name="uuid">bf850b0d-88b6-4ec3-b3eb-df6195be2945</entry>
Nov 29 20:35:03 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:35:03 user nova-compute[75356]:     </system>
Nov 29 20:35:03 user nova-compute[75356]:   </sysinfo>
Nov 29 20:35:03 user nova-compute[75356]:   <os>
Nov 29 20:35:03 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:35:03 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:35:03 user nova-compute[75356]:   </os>
Nov 29 20:35:03 user nova-compute[75356]:   <features>
Nov 29 20:35:03 user nova-compute[75356]:     <acpi/>
Nov 29 20:35:03 user nova-compute[75356]:     <apic/>
Nov 29 20:35:03 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:35:03 user nova-compute[75356]:   </features>
Nov 29 20:35:03 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:35:03 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:35:03 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:35:03 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:35:03 user nova-compute[75356]:   </clock>
Nov 29 20:35:03 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:35:03 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:35:03 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:35:03 user nova-compute[75356]:   </cpu>
Nov 29 20:35:03 user nova-compute[75356]:   <devices>
Nov 29 20:35:03 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:35:03 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:35:03 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk.rescue"/>
Nov 29 20:35:03 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:35:03 user nova-compute[75356]:     </disk>
Nov 29 20:35:03 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:35:03 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:35:03 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk"/>
Nov 29 20:35:03 user nova-compute[75356]:       <target dev="vdb" bus="virtio"/>
Nov 29 20:35:03 user nova-compute[75356]:     </disk>
Nov 29 20:35:03 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:35:03 user nova-compute[75356]:       <mac address="fa:16:3e:57:b8:2a"/>
Nov 29 20:35:03 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:35:03 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:35:03 user nova-compute[75356]:       <target dev="tapc68da58a-ba"/>
Nov 29 20:35:03 user nova-compute[75356]:     </interface>
Nov 29 20:35:03 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:35:03 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/console.log" append="off"/>
Nov 29 20:35:03 user nova-compute[75356]:     </serial>
Nov 29 20:35:03 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:35:03 user nova-compute[75356]:     <video>
Nov 29 20:35:03 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:35:03 user nova-compute[75356]:     </video>
Nov 29 20:35:03 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:35:03 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:35:03 user nova-compute[75356]:     </rng>
Nov 29 20:35:03 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:35:03 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:35:03 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:35:03 user nova-compute[75356]:     </memballoon>
Nov 29 20:35:03 user nova-compute[75356]:   </devices>
Nov 29 20:35:03 user nova-compute[75356]: </domain>
Nov 29 20:35:03 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:35:03 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Instance destroyed successfully.
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7 --force-share --output=json" returned: 0 in 0.170s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] No VIF found with MAC fa:16:3e:57:b8:2a, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Cannot resize image /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Ensure instance console log exists: /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Start _get_guest_xml network_info=[{"id": "65c10bc1-9ed3-4330-82bf-bb977579b739", "address": "fa:16:3e:83:e1:42", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c10bc1-9e", "ovs_interfaceid": "65c10bc1-9ed3-4330-82bf-bb977579b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:34:57Z,direct_url=<?>,disk_format='qcow2',id=6ee4f8ae-4cf2-4957-8248-d49911d42db6,min_disk=0,min_ram=0,name='tempest-scenario-img--1690694709',owner='11b97f9fbbb34b22ab013e1892dc91c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:34:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ee4f8ae-4cf2-4957-8248-d49911d42db6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:35:03 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:35:03 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:34:57Z,direct_url=<?>,disk_format='qcow2',id=6ee4f8ae-4cf2-4957-8248-d49911d42db6,min_disk=0,min_ram=0,name='tempest-scenario-img--1690694709',owner='11b97f9fbbb34b22ab013e1892dc91c1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:34:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:34:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1231567600',display_name='tempest-TestMinimumBasicScenario-server-1231567600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1231567600',id=41,image_ref='6ee4f8ae-4cf2-4957-8248-d49911d42db6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh2TlSBw89rfB0YmOzfQzT5wbEXRqpuSHLaV54eHLkkWwjH4CSC29qNd4qfM46vqxeJg8k40Euc1XZCyBWlQ2Aigpns1zqJF2EVhDaaoKJYdqrcJVI8YWk74Y8FzB8E4g==',key_name='tempest-TestMinimumBasicScenario-436042911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11b97f9fbbb34b22ab013e1892dc91c1',ramdisk_id='',reservation_id='r-vxz80l0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ee4f8ae-4cf2-4957-8248-d49911d42db6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1742449158',owner_user_name='tempest-TestMinimumBasicScenario-1742449158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:35:01Z,user_data=None,user_id='4a111049bab1401cbe074a03692b43af',uuid=ffb04928-4f5f-4461-aa24-6363d1c9b941,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65c10bc1-9ed3-4330-82bf-bb977579b739", "address": "fa:16:3e:83:e1:42", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c10bc1-9e", "ovs_interfaceid": "65c10bc1-9ed3-4330-82bf-bb977579b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Converting VIF {"id": "65c10bc1-9ed3-4330-82bf-bb977579b739", "address": "fa:16:3e:83:e1:42", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c10bc1-9e", "ovs_interfaceid": "65c10bc1-9ed3-4330-82bf-bb977579b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:e1:42,bridge_name='br-int',has_traffic_filtering=True,id=65c10bc1-9ed3-4330-82bf-bb977579b739,network=Network(7408e82d-2d0b-45c2-8f7d-1b4c69cc6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65c10bc1-9e') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.objects.instance [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lazy-loading 'pci_devices' on Instance uuid ffb04928-4f5f-4461-aa24-6363d1c9b941 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:35:03 user nova-compute[75356]:   <uuid>ffb04928-4f5f-4461-aa24-6363d1c9b941</uuid>
Nov 29 20:35:03 user nova-compute[75356]:   <name>instance-00000029</name>
Nov 29 20:35:03 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:35:03 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:35:03 user nova-compute[75356]:   <metadata>
Nov 29 20:35:03 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:35:03 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:35:03 user nova-compute[75356]:       <nova:name>tempest-TestMinimumBasicScenario-server-1231567600</nova:name>
Nov 29 20:35:03 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:35:03</nova:creationTime>
Nov 29 20:35:03 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:35:03 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:35:03 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:35:03 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:35:03 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:35:03 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:35:03 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:35:03 user nova-compute[75356]:       <nova:owner>
Nov 29 20:35:03 user nova-compute[75356]:         <nova:user uuid="4a111049bab1401cbe074a03692b43af">tempest-TestMinimumBasicScenario-1742449158-project-member</nova:user>
Nov 29 20:35:03 user nova-compute[75356]:         <nova:project uuid="11b97f9fbbb34b22ab013e1892dc91c1">tempest-TestMinimumBasicScenario-1742449158</nova:project>
Nov 29 20:35:03 user nova-compute[75356]:       </nova:owner>
Nov 29 20:35:03 user nova-compute[75356]:       <nova:root type="image" uuid="6ee4f8ae-4cf2-4957-8248-d49911d42db6"/>
Nov 29 20:35:03 user nova-compute[75356]:       <nova:ports>
Nov 29 20:35:03 user nova-compute[75356]:         <nova:port uuid="65c10bc1-9ed3-4330-82bf-bb977579b739">
Nov 29 20:35:03 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 20:35:03 user nova-compute[75356]:         </nova:port>
Nov 29 20:35:03 user nova-compute[75356]:       </nova:ports>
Nov 29 20:35:03 user nova-compute[75356]:     </nova:instance>
Nov 29 20:35:03 user nova-compute[75356]:   </metadata>
Nov 29 20:35:03 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:35:03 user nova-compute[75356]:     <system>
Nov 29 20:35:03 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:35:03 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:35:03 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:35:03 user nova-compute[75356]:       <entry name="serial">ffb04928-4f5f-4461-aa24-6363d1c9b941</entry>
Nov 29 20:35:03 user nova-compute[75356]:       <entry name="uuid">ffb04928-4f5f-4461-aa24-6363d1c9b941</entry>
Nov 29 20:35:03 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:35:03 user nova-compute[75356]:     </system>
Nov 29 20:35:03 user nova-compute[75356]:   </sysinfo>
Nov 29 20:35:03 user nova-compute[75356]:   <os>
Nov 29 20:35:03 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:35:03 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:35:03 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:35:03 user nova-compute[75356]:   </os>
Nov 29 20:35:03 user nova-compute[75356]:   <features>
Nov 29 20:35:03 user nova-compute[75356]:     <acpi/>
Nov 29 20:35:03 user nova-compute[75356]:     <apic/>
Nov 29 20:35:03 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:35:03 user nova-compute[75356]:   </features>
Nov 29 20:35:03 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:35:03 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:35:03 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:35:03 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:35:03 user nova-compute[75356]:   </clock>
Nov 29 20:35:03 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:35:03 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:35:03 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:35:03 user nova-compute[75356]:   </cpu>
Nov 29 20:35:03 user nova-compute[75356]:   <devices>
Nov 29 20:35:03 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:35:03 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:35:03 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk"/>
Nov 29 20:35:03 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:35:03 user nova-compute[75356]:     </disk>
Nov 29 20:35:03 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:35:03 user nova-compute[75356]:       <mac address="fa:16:3e:83:e1:42"/>
Nov 29 20:35:03 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:35:03 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:35:03 user nova-compute[75356]:       <target dev="tap65c10bc1-9e"/>
Nov 29 20:35:03 user nova-compute[75356]:     </interface>
Nov 29 20:35:03 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:35:03 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/console.log" append="off"/>
Nov 29 20:35:03 user nova-compute[75356]:     </serial>
Nov 29 20:35:03 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:35:03 user nova-compute[75356]:     <video>
Nov 29 20:35:03 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:35:03 user nova-compute[75356]:     </video>
Nov 29 20:35:03 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:35:03 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:35:03 user nova-compute[75356]:     </rng>
Nov 29 20:35:03 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:35:03 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:35:03 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:35:03 user nova-compute[75356]:     </memballoon>
Nov 29 20:35:03 user nova-compute[75356]:   </devices>
Nov 29 20:35:03 user nova-compute[75356]: </domain>
Nov 29 20:35:03 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:34:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1231567600',display_name='tempest-TestMinimumBasicScenario-server-1231567600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1231567600',id=41,image_ref='6ee4f8ae-4cf2-4957-8248-d49911d42db6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh2TlSBw89rfB0YmOzfQzT5wbEXRqpuSHLaV54eHLkkWwjH4CSC29qNd4qfM46vqxeJg8k40Euc1XZCyBWlQ2Aigpns1zqJF2EVhDaaoKJYdqrcJVI8YWk74Y8FzB8E4g==',key_name='tempest-TestMinimumBasicScenario-436042911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11b97f9fbbb34b22ab013e1892dc91c1',ramdisk_id='',reservation_id='r-vxz80l0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ee4f8ae-4cf2-4957-8248-d49911d42db6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1742449158',owner_user_name='tempest-TestMinimumBasicScenario-1742449158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:35:01Z,user_data=None,user_id='4a111049bab1401cbe074a03692b43af',uuid=ffb04928-4f5f-4461-aa24-6363d1c9b941,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65c10bc1-9ed3-4330-82bf-bb977579b739", "address": "fa:16:3e:83:e1:42", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c10bc1-9e", "ovs_interfaceid": "65c10bc1-9ed3-4330-82bf-bb977579b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Converting VIF {"id": "65c10bc1-9ed3-4330-82bf-bb977579b739", "address": "fa:16:3e:83:e1:42", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c10bc1-9e", "ovs_interfaceid": "65c10bc1-9ed3-4330-82bf-bb977579b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:e1:42,bridge_name='br-int',has_traffic_filtering=True,id=65c10bc1-9ed3-4330-82bf-bb977579b739,network=Network(7408e82d-2d0b-45c2-8f7d-1b4c69cc6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65c10bc1-9e') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG os_vif [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:e1:42,bridge_name='br-int',has_traffic_filtering=True,id=65c10bc1-9ed3-4330-82bf-bb977579b739,network=Network(7408e82d-2d0b-45c2-8f7d-1b4c69cc6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65c10bc1-9e') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44102f05-1d16-56fb-8485-24c22ac19b39', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65c10bc1-9e, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65c10bc1-9e, col_values=(('qos', UUID('9ee92fd8-a138-40ae-985d-9a4027a6bc58')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65c10bc1-9e, col_values=(('external_ids', {'iface-id': '65c10bc1-9ed3-4330-82bf-bb977579b739', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:e1:42', 'vm-uuid': 'ffb04928-4f5f-4461-aa24-6363d1c9b941'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:03 user nova-compute[75356]: INFO os_vif [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:e1:42,bridge_name='br-int',has_traffic_filtering=True,id=65c10bc1-9ed3-4330-82bf-bb977579b739,network=Network(7408e82d-2d0b-45c2-8f7d-1b4c69cc6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65c10bc1-9e')
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:35:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] No VIF found with MAC fa:16:3e:83:e1:42, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:35:04 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:35:04 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:35:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:35:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:35:04 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:35:04 user nova-compute[75356]: DEBUG nova.compute.manager [req-e1ed4679-cc6a-42c4-82f5-c58e695b9a3e req-d7b64d3b-9e44-41d7-8983-8d7cbf8cf914 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received event network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:35:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e1ed4679-cc6a-42c4-82f5-c58e695b9a3e req-d7b64d3b-9e44-41d7-8983-8d7cbf8cf914 service nova] Acquiring lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e1ed4679-cc6a-42c4-82f5-c58e695b9a3e req-d7b64d3b-9e44-41d7-8983-8d7cbf8cf914 service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e1ed4679-cc6a-42c4-82f5-c58e695b9a3e req-d7b64d3b-9e44-41d7-8983-8d7cbf8cf914 service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:04 user nova-compute[75356]: DEBUG nova.compute.manager [req-e1ed4679-cc6a-42c4-82f5-c58e695b9a3e req-d7b64d3b-9e44-41d7-8983-8d7cbf8cf914 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] No waiting events found dispatching network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:35:04 user nova-compute[75356]: WARNING nova.compute.manager [req-e1ed4679-cc6a-42c4-82f5-c58e695b9a3e req-d7b64d3b-9e44-41d7-8983-8d7cbf8cf914 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received unexpected event network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 for instance with vm_state active and task_state rescuing.
Nov 29 20:35:04 user nova-compute[75356]: DEBUG nova.compute.manager [req-e1ed4679-cc6a-42c4-82f5-c58e695b9a3e req-d7b64d3b-9e44-41d7-8983-8d7cbf8cf914 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Received event network-changed-65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:35:04 user nova-compute[75356]: DEBUG nova.compute.manager [req-e1ed4679-cc6a-42c4-82f5-c58e695b9a3e req-d7b64d3b-9e44-41d7-8983-8d7cbf8cf914 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Refreshing instance network info cache due to event network-changed-65c10bc1-9ed3-4330-82bf-bb977579b739. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:35:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e1ed4679-cc6a-42c4-82f5-c58e695b9a3e req-d7b64d3b-9e44-41d7-8983-8d7cbf8cf914 service nova] Acquiring lock "refresh_cache-ffb04928-4f5f-4461-aa24-6363d1c9b941" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:35:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e1ed4679-cc6a-42c4-82f5-c58e695b9a3e req-d7b64d3b-9e44-41d7-8983-8d7cbf8cf914 service nova] Acquired lock "refresh_cache-ffb04928-4f5f-4461-aa24-6363d1c9b941" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:35:04 user nova-compute[75356]: DEBUG nova.network.neutron [req-e1ed4679-cc6a-42c4-82f5-c58e695b9a3e req-d7b64d3b-9e44-41d7-8983-8d7cbf8cf914 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Refreshing network info cache for port 65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:35:05 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Updating instance_info_cache with network_info: [{"id": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "address": "fa:16:3e:91:30:da", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a14e591-f6", "ovs_interfaceid": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:35:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:35:05 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:35:05 user nova-compute[75356]: DEBUG nova.network.neutron [req-e1ed4679-cc6a-42c4-82f5-c58e695b9a3e req-d7b64d3b-9e44-41d7-8983-8d7cbf8cf914 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Updated VIF entry in instance network info cache for port 65c10bc1-9ed3-4330-82bf-bb977579b739. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:35:05 user nova-compute[75356]: DEBUG nova.network.neutron [req-e1ed4679-cc6a-42c4-82f5-c58e695b9a3e req-d7b64d3b-9e44-41d7-8983-8d7cbf8cf914 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Updating instance_info_cache with network_info: [{"id": "65c10bc1-9ed3-4330-82bf-bb977579b739", "address": "fa:16:3e:83:e1:42", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c10bc1-9e", "ovs_interfaceid": "65c10bc1-9ed3-4330-82bf-bb977579b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:35:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e1ed4679-cc6a-42c4-82f5-c58e695b9a3e req-d7b64d3b-9e44-41d7-8983-8d7cbf8cf914 service nova] Releasing lock "refresh_cache-ffb04928-4f5f-4461-aa24-6363d1c9b941" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:35:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-aad0d30c-e69d-4d54-a039-308f4a9e0f33 req-90e9a45e-7375-4a69-a537-0800de5eb26d service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received event network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:35:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-aad0d30c-e69d-4d54-a039-308f4a9e0f33 req-90e9a45e-7375-4a69-a537-0800de5eb26d service nova] Acquiring lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-aad0d30c-e69d-4d54-a039-308f4a9e0f33 req-90e9a45e-7375-4a69-a537-0800de5eb26d service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-aad0d30c-e69d-4d54-a039-308f4a9e0f33 req-90e9a45e-7375-4a69-a537-0800de5eb26d service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-aad0d30c-e69d-4d54-a039-308f4a9e0f33 req-90e9a45e-7375-4a69-a537-0800de5eb26d service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] No waiting events found dispatching network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:35:06 user nova-compute[75356]: WARNING nova.compute.manager [req-aad0d30c-e69d-4d54-a039-308f4a9e0f33 req-90e9a45e-7375-4a69-a537-0800de5eb26d service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received unexpected event network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 for instance with vm_state active and task_state rescuing.
Nov 29 20:35:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-aad0d30c-e69d-4d54-a039-308f4a9e0f33 req-90e9a45e-7375-4a69-a537-0800de5eb26d service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received event network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:35:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-aad0d30c-e69d-4d54-a039-308f4a9e0f33 req-90e9a45e-7375-4a69-a537-0800de5eb26d service nova] Acquiring lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-aad0d30c-e69d-4d54-a039-308f4a9e0f33 req-90e9a45e-7375-4a69-a537-0800de5eb26d service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-aad0d30c-e69d-4d54-a039-308f4a9e0f33 req-90e9a45e-7375-4a69-a537-0800de5eb26d service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-aad0d30c-e69d-4d54-a039-308f4a9e0f33 req-90e9a45e-7375-4a69-a537-0800de5eb26d service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] No waiting events found dispatching network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:35:06 user nova-compute[75356]: WARNING nova.compute.manager [req-aad0d30c-e69d-4d54-a039-308f4a9e0f33 req-90e9a45e-7375-4a69-a537-0800de5eb26d service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received unexpected event network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 for instance with vm_state active and task_state rescuing.
Nov 29 20:35:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-aad0d30c-e69d-4d54-a039-308f4a9e0f33 req-90e9a45e-7375-4a69-a537-0800de5eb26d service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Received event network-vif-plugged-65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:35:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-aad0d30c-e69d-4d54-a039-308f4a9e0f33 req-90e9a45e-7375-4a69-a537-0800de5eb26d service nova] Acquiring lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-aad0d30c-e69d-4d54-a039-308f4a9e0f33 req-90e9a45e-7375-4a69-a537-0800de5eb26d service nova] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-aad0d30c-e69d-4d54-a039-308f4a9e0f33 req-90e9a45e-7375-4a69-a537-0800de5eb26d service nova] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-aad0d30c-e69d-4d54-a039-308f4a9e0f33 req-90e9a45e-7375-4a69-a537-0800de5eb26d service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] No waiting events found dispatching network-vif-plugged-65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:35:06 user nova-compute[75356]: WARNING nova.compute.manager [req-aad0d30c-e69d-4d54-a039-308f4a9e0f33 req-90e9a45e-7375-4a69-a537-0800de5eb26d service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Received unexpected event network-vif-plugged-65c10bc1-9ed3-4330-82bf-bb977579b739 for instance with vm_state building and task_state spawning.
Nov 29 20:35:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:08 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:35:08 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:35:08 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:35:08 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:35:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-dabd927a-6354-40f5-a97a-4086e2a07726 req-aea13916-6977-40af-bcc8-5d75bc690fbc service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Received event network-vif-plugged-65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:35:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-dabd927a-6354-40f5-a97a-4086e2a07726 req-aea13916-6977-40af-bcc8-5d75bc690fbc service nova] Acquiring lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-dabd927a-6354-40f5-a97a-4086e2a07726 req-aea13916-6977-40af-bcc8-5d75bc690fbc service nova] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-dabd927a-6354-40f5-a97a-4086e2a07726 req-aea13916-6977-40af-bcc8-5d75bc690fbc service nova] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-dabd927a-6354-40f5-a97a-4086e2a07726 req-aea13916-6977-40af-bcc8-5d75bc690fbc service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] No waiting events found dispatching network-vif-plugged-65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:35:08 user nova-compute[75356]: WARNING nova.compute.manager [req-dabd927a-6354-40f5-a97a-4086e2a07726 req-aea13916-6977-40af-bcc8-5d75bc690fbc service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Received unexpected event network-vif-plugged-65c10bc1-9ed3-4330-82bf-bb977579b739 for instance with vm_state building and task_state spawning.
Nov 29 20:35:08 user nova-compute[75356]: DEBUG nova.compute.manager [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:35:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:35:08 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Instance spawned successfully.
Nov 29 20:35:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:35:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:35:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:35:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:35:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:35:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:35:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:35:08 user nova-compute[75356]: DEBUG nova.compute.manager [None req-144abd52-9d2d-452b-8a20-e06dbe002f9d tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:35:08 user nova-compute[75356]: INFO nova.compute.manager [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Took 7.70 seconds to spawn the instance on the hypervisor.
Nov 29 20:35:08 user nova-compute[75356]: DEBUG nova.compute.manager [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:35:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:08 user nova-compute[75356]: INFO nova.compute.manager [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Took 8.56 seconds to build instance.
Nov 29 20:35:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-57b02a8b-7f8c-427f-904e-56536965a20c tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.652s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:09 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:35:09 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:35:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:09 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:35:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:35:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:35:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:35:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:12 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:35:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:35:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:13 user nova-compute[75356]: INFO nova.compute.manager [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Terminating instance
Nov 29 20:35:13 user nova-compute[75356]: DEBUG nova.compute.manager [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:35:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:14 user nova-compute[75356]: DEBUG nova.compute.manager [req-35c58b30-ad61-4655-8b50-e22315ec885d req-c08b1e2b-d9e7-46b1-a9c6-c4e740fabc0d service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Received event network-vif-unplugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:35:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-35c58b30-ad61-4655-8b50-e22315ec885d req-c08b1e2b-d9e7-46b1-a9c6-c4e740fabc0d service nova] Acquiring lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-35c58b30-ad61-4655-8b50-e22315ec885d req-c08b1e2b-d9e7-46b1-a9c6-c4e740fabc0d service nova] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-35c58b30-ad61-4655-8b50-e22315ec885d req-c08b1e2b-d9e7-46b1-a9c6-c4e740fabc0d service nova] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:14 user nova-compute[75356]: DEBUG nova.compute.manager [req-35c58b30-ad61-4655-8b50-e22315ec885d req-c08b1e2b-d9e7-46b1-a9c6-c4e740fabc0d service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] No waiting events found dispatching network-vif-unplugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:35:14 user nova-compute[75356]: DEBUG nova.compute.manager [req-35c58b30-ad61-4655-8b50-e22315ec885d req-c08b1e2b-d9e7-46b1-a9c6-c4e740fabc0d service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Received event network-vif-unplugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:35:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:14 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Instance destroyed successfully.
Nov 29 20:35:14 user nova-compute[75356]: DEBUG nova.objects.instance [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lazy-loading 'resources' on Instance uuid 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:35:14 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:35:14 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:35:14 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=7140MB free_disk=24.691814422607422GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:35:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:28:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2053095889',display_name='tempest-ServerActionsTestOtherA-server-2053095889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2053095889',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBES/hmUhRPMEp7jxGNAJkTADe+ykaGX7onK5o5CXk4BGHWdyPerc54MOJxjy4wx3hHylMSlWH2Wjk+mHShNqdbk6ZSJg34jMi+lLZfOCW4j+M+c+q1Lzq5VJUbAeMltLBQ==',key_name='tempest-keypair-777625238',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:30:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b14efb1a4d34a3db7a51bd79234b86b',ramdisk_id='',reservation_id='r-nplu3go6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1000495362',owner_user_name='tempest-ServerActionsTestOtherA-1000495362-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:32:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc7cfc71d0c448cbbe8d42f8b617d8b',uuid=873a45a7-a06f-4bcd-b517-d6f0ade7e5a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "address": "fa:16:3e:ed:a6:4a", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c2f7e-7d", "ovs_interfaceid": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converting VIF {"id": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "address": "fa:16:3e:ed:a6:4a", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap803c2f7e-7d", "ovs_interfaceid": "803c2f7e-7d7c-46aa-b1a8-63165a13b9a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:a6:4a,bridge_name='br-int',has_traffic_filtering=True,id=803c2f7e-7d7c-46aa-b1a8-63165a13b9a1,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803c2f7e-7d') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG os_vif [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:a6:4a,bridge_name='br-int',has_traffic_filtering=True,id=803c2f7e-7d7c-46aa-b1a8-63165a13b9a1,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803c2f7e-7d') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap803c2f7e-7d, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f6f5f08-1499-4ed6-9151-89a94019bcdc) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:15 user nova-compute[75356]: INFO os_vif [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:a6:4a,bridge_name='br-int',has_traffic_filtering=True,id=803c2f7e-7d7c-46aa-b1a8-63165a13b9a1,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap803c2f7e-7d')
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixFVyosu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:35:15 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:35:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb40d5dd-9f79-4dec-8573-d0f3bff8c669]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:35:15 user nova-compute[75356]: No targets found.
Nov 29 20:35:15 user nova-compute[75356]: iSNS:
Nov 29 20:35:15 user nova-compute[75356]: No targets found.
Nov 29 20:35:15 user nova-compute[75356]: STATIC:
Nov 29 20:35:15 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c
Nov 29 20:35:15 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:35:15 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:35:15 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09
Nov 29 20:35:15 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:35:15 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:35:15 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345
Nov 29 20:35:15 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:35:15 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:35:15 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7
Nov 29 20:35:15 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:35:15 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:35:15 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:35:15 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:35:15 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:35:15 user nova-compute[75356]: FIRMWARE:
Nov 29 20:35:15 user nova-compute[75356]: No targets found.
Nov 29 20:35:15 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:35:15 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:35:15 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5490dd1d-5f29-48db-8929-b7c0d0d27122]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c7df3c-9b48-4e57-9af6-affe18b74fb6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:35:15 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:35:15 user nova-compute[75356]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:35:15 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:35:15 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:35:15 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:35:15 user nova-compute[75356]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 (non-flash)
Nov 29 20:35:15 user nova-compute[75356]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:35:15 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:35:15 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:35:15 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830818dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09'): ({'sdh'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Removing single pathed devices sdh {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2616d426-2e48-420b-9e33-ce36795a6d01]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2d6850-9cb0-4917-8ef4-a9da42da822b]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Flushing IO for device /dev/sdh {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfeaa14-ceda-4ded-8b0d-eb3f985e3472]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0b59517a-c467-432a-a73a-d1460c1574e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance db0826f0-5fdc-47a8-ae36-5059844980c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 93183110-d2e2-4da7-ab7d-73378f5e0d42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4713c9eb-4052-4d65-a4eb-23e62352185a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance bf850b0d-88b6-4ec3-b3eb-df6195be2945 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance efda3722-c523-47e1-b942-2ec2aacf6417 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 9033b98b-fb6a-4702-8308-68363c60c6dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 6f70aee5-c3b8-4da8-8903-a305b1275552 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ffb04928-4f5f-4461-aa24-6363d1c9b941 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58492c5-5fa8-481f-83d5-d01c9cfa56aa]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] SCSI volumes sdh have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9bdb4f-5d29-4e91-b605-169415015c3c]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3629f246-f79f-4c72-a33f-16dbe599258b]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09, portal: 172.16.0.220,3260]
Nov 29 20:35:15 user nova-compute[75356]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09, portal: 172.16.0.220,3260] successful.
Nov 29 20:35:15 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33217dc4-b5a2-4843-87d8-ca6acb430f09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a53cad2-36ef-4786-adef-0a9ffe890373]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] <== disconnect_volume: return (377ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:35:15 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Deleting instance files /opt/stack/data/nova/instances/873a45a7-a06f-4bcd-b517-d6f0ade7e5a3_del
Nov 29 20:35:15 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Deletion of /opt/stack/data/nova/instances/873a45a7-a06f-4bcd-b517-d6f0ade7e5a3_del complete
Nov 29 20:35:15 user nova-compute[75356]: INFO nova.compute.manager [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Took 1.56 seconds to destroy the instance on the hypervisor.
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.746s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:15 user nova-compute[75356]: INFO nova.compute.manager [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Terminating instance
Nov 29 20:35:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-581f5d0e-0235-45a2-a9c8-243cf0c84981 req-e05930a2-c75e-4df7-82c4-7ddb72ed4a8a service nova] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Received event network-vif-unplugged-d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-581f5d0e-0235-45a2-a9c8-243cf0c84981 req-e05930a2-c75e-4df7-82c4-7ddb72ed4a8a service nova] Acquiring lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-581f5d0e-0235-45a2-a9c8-243cf0c84981 req-e05930a2-c75e-4df7-82c4-7ddb72ed4a8a service nova] Lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-581f5d0e-0235-45a2-a9c8-243cf0c84981 req-e05930a2-c75e-4df7-82c4-7ddb72ed4a8a service nova] Lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-581f5d0e-0235-45a2-a9c8-243cf0c84981 req-e05930a2-c75e-4df7-82c4-7ddb72ed4a8a service nova] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] No waiting events found dispatching network-vif-unplugged-d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-581f5d0e-0235-45a2-a9c8-243cf0c84981 req-e05930a2-c75e-4df7-82c4-7ddb72ed4a8a service nova] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Received event network-vif-unplugged-d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-5ccba9aa-e839-40a0-8c44-bfe9d4a7cd92 req-6cced1db-3b78-430e-bc5b-95f93671a069 service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Received event network-vif-plugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5ccba9aa-e839-40a0-8c44-bfe9d4a7cd92 req-6cced1db-3b78-430e-bc5b-95f93671a069 service nova] Acquiring lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5ccba9aa-e839-40a0-8c44-bfe9d4a7cd92 req-6cced1db-3b78-430e-bc5b-95f93671a069 service nova] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5ccba9aa-e839-40a0-8c44-bfe9d4a7cd92 req-6cced1db-3b78-430e-bc5b-95f93671a069 service nova] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-5ccba9aa-e839-40a0-8c44-bfe9d4a7cd92 req-6cced1db-3b78-430e-bc5b-95f93671a069 service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] No waiting events found dispatching network-vif-plugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:35:16 user nova-compute[75356]: WARNING nova.compute.manager [req-5ccba9aa-e839-40a0-8c44-bfe9d4a7cd92 req-6cced1db-3b78-430e-bc5b-95f93671a069 service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Received unexpected event network-vif-plugged-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 for instance with vm_state active and task_state deleting.
Nov 29 20:35:16 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:35:16 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Took 0.81 seconds to deallocate network for instance.
Nov 29 20:35:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-dcd9d51a-8de3-4e4e-9c67-f3cfa00bedff req-9ac1e801-faa3-4aa1-8b86-49ce7dbcbec1 service nova] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Received event network-vif-deleted-803c2f7e-7d7c-46aa-b1a8-63165a13b9a1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:35:16 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Instance destroyed successfully.
Nov 29 20:35:16 user nova-compute[75356]: DEBUG nova.objects.instance [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lazy-loading 'resources' on Instance uuid ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:25:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1940095636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1940095636',id=27,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:25:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bed33acdfd5f48b9967d1dd68c261d78',ramdisk_id='',reservation_id='r-pzkhzskg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2041863686',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:27:49Z,user_data=None,user_id='e395b4248b794d65915edf2d23bbbeaf',uuid=ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4", "address": "fa:16:3e:96:21:98", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6fd1ef4-2d", "ovs_interfaceid": "d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Converting VIF {"id": "d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4", "address": "fa:16:3e:96:21:98", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6fd1ef4-2d", "ovs_interfaceid": "d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:21:98,bridge_name='br-int',has_traffic_filtering=True,id=d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6fd1ef4-2d') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG os_vif [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:21:98,bridge_name='br-int',has_traffic_filtering=True,id=d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6fd1ef4-2d') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6fd1ef4-2d, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=906a18ee-d182-45e8-9129-cc20e6cc13fd) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:35:16 user nova-compute[75356]: INFO os_vif [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:21:98,bridge_name='br-int',has_traffic_filtering=True,id=d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6fd1ef4-2d')
Nov 29 20:35:16 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Deleting instance files /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9_del
Nov 29 20:35:16 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Deletion of /opt/stack/data/nova/instances/ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9_del complete
Nov 29 20:35:16 user nova-compute[75356]: INFO nova.compute.manager [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 29 20:35:16 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:35:16 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:35:17 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:35:17 user nova-compute[75356]: INFO nova.compute.manager [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Took 0.90 seconds to detach 1 volumes for instance.
Nov 29 20:35:17 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Took 0.50 seconds to deallocate network for instance.
Nov 29 20:35:17 user nova-compute[75356]: DEBUG nova.compute.manager [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3] Deleting volume: 33217dc4-b5a2-4843-87d8-ca6acb430f09 {{(pid=75356) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 20:35:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:17 user nova-compute[75356]: INFO nova.compute.manager [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Terminating instance
Nov 29 20:35:17 user nova-compute[75356]: DEBUG nova.compute.manager [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:35:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:17 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:35:17 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:35:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.659s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.570s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:17 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Deleted allocations for instance ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9
Nov 29 20:35:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d033baa4-9a16-417f-a6e1-6482e9deb2d3 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.351s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:18 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Instance destroyed successfully.
Nov 29 20:35:18 user nova-compute[75356]: DEBUG nova.objects.instance [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lazy-loading 'resources' on Instance uuid ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-04e4d4cb-8207-4208-96db-f219369fe2c5 req-b488d576-c030-4e5c-89b2-e84351cc91a7 service nova] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Received event network-vif-plugged-d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-04e4d4cb-8207-4208-96db-f219369fe2c5 req-b488d576-c030-4e5c-89b2-e84351cc91a7 service nova] Acquiring lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-04e4d4cb-8207-4208-96db-f219369fe2c5 req-b488d576-c030-4e5c-89b2-e84351cc91a7 service nova] Lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-04e4d4cb-8207-4208-96db-f219369fe2c5 req-b488d576-c030-4e5c-89b2-e84351cc91a7 service nova] Lock "ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-04e4d4cb-8207-4208-96db-f219369fe2c5 req-b488d576-c030-4e5c-89b2-e84351cc91a7 service nova] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] No waiting events found dispatching network-vif-plugged-d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:35:18 user nova-compute[75356]: WARNING nova.compute.manager [req-04e4d4cb-8207-4208-96db-f219369fe2c5 req-b488d576-c030-4e5c-89b2-e84351cc91a7 service nova] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Received unexpected event network-vif-plugged-d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4 for instance with vm_state deleted and task_state None.
Nov 29 20:35:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T20:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746543629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746543629',id=34,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoBYhUZTHHk0CREN0lXpO01HfOR1JC0gy8IkTdtaqmqYZSwBX5tvSh0xRk0q4YRJyhgG6K0SdzHAwxFF/zK8Mb+8/lRRNokeiBDcNpDtwZ4Op8oi1jdXBF3LvLyPmY1Tg==',key_name='tempest-keypair-1798007487',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:33:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71e99301081a4158bc9d188e2f796350',ramdisk_id='',reservation_id='r-np63f8g4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1538416601',owner_user_name='tempest-AttachVolumeShelveTestJSON-1538416601-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:33:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecc96706ae3140ce8816c0e78e116d7d',uuid=ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "address": "fa:16:3e:03:0f:9e", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617944a3-eb", "ovs_interfaceid": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converting VIF {"id": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "address": "fa:16:3e:03:0f:9e", "network": {"id": "ac505a63-c19f-4cdf-b38a-3441eafc464c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2056768475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71e99301081a4158bc9d188e2f796350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617944a3-eb", "ovs_interfaceid": "617944a3-eb1e-431e-8b2f-f3090e4947e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:0f:9e,bridge_name='br-int',has_traffic_filtering=True,id=617944a3-eb1e-431e-8b2f-f3090e4947e4,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617944a3-eb') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG os_vif [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:0f:9e,bridge_name='br-int',has_traffic_filtering=True,id=617944a3-eb1e-431e-8b2f-f3090e4947e4,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617944a3-eb') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap617944a3-eb, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77034336-4c14-4233-ad8a-7aa626cc9fc5) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:18 user nova-compute[75356]: INFO os_vif [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:0f:9e,bridge_name='br-int',has_traffic_filtering=True,id=617944a3-eb1e-431e-8b2f-f3090e4947e4,network=Network(ac505a63-c19f-4cdf-b38a-3441eafc464c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617944a3-eb')
Nov 29 20:35:18 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Deleting instance files /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb_del
Nov 29 20:35:18 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Deletion of /opt/stack/data/nova/instances/ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb_del complete
Nov 29 20:35:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-6d76ccbe-400d-40a3-bbaa-30d7155b0d4e req-92571f78-321d-4c77-b9c2-4ce76ee2f363 service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Received event network-vif-unplugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6d76ccbe-400d-40a3-bbaa-30d7155b0d4e req-92571f78-321d-4c77-b9c2-4ce76ee2f363 service nova] Acquiring lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6d76ccbe-400d-40a3-bbaa-30d7155b0d4e req-92571f78-321d-4c77-b9c2-4ce76ee2f363 service nova] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6d76ccbe-400d-40a3-bbaa-30d7155b0d4e req-92571f78-321d-4c77-b9c2-4ce76ee2f363 service nova] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-6d76ccbe-400d-40a3-bbaa-30d7155b0d4e req-92571f78-321d-4c77-b9c2-4ce76ee2f363 service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] No waiting events found dispatching network-vif-unplugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-6d76ccbe-400d-40a3-bbaa-30d7155b0d4e req-92571f78-321d-4c77-b9c2-4ce76ee2f363 service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Received event network-vif-unplugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-6d76ccbe-400d-40a3-bbaa-30d7155b0d4e req-92571f78-321d-4c77-b9c2-4ce76ee2f363 service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Received event network-vif-plugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6d76ccbe-400d-40a3-bbaa-30d7155b0d4e req-92571f78-321d-4c77-b9c2-4ce76ee2f363 service nova] Acquiring lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6d76ccbe-400d-40a3-bbaa-30d7155b0d4e req-92571f78-321d-4c77-b9c2-4ce76ee2f363 service nova] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6d76ccbe-400d-40a3-bbaa-30d7155b0d4e req-92571f78-321d-4c77-b9c2-4ce76ee2f363 service nova] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-6d76ccbe-400d-40a3-bbaa-30d7155b0d4e req-92571f78-321d-4c77-b9c2-4ce76ee2f363 service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] No waiting events found dispatching network-vif-plugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:35:18 user nova-compute[75356]: WARNING nova.compute.manager [req-6d76ccbe-400d-40a3-bbaa-30d7155b0d4e req-92571f78-321d-4c77-b9c2-4ce76ee2f363 service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Received unexpected event network-vif-plugged-617944a3-eb1e-431e-8b2f-f3090e4947e4 for instance with vm_state active and task_state deleting.
Nov 29 20:35:18 user nova-compute[75356]: INFO nova.compute.manager [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 29 20:35:18 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-8fda69a2-d7e4-4de3-abf3-269a11ca6602 req-fc16cdaa-9a48-4be2-a417-6997cf68fc5e service nova] [instance: ebc3ee69-5d09-4990-b6cc-b2cc0088a6f9] Received event network-vif-deleted-d6fd1ef4-2d53-4545-a8bd-7c0fc7c603b4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:35:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.548s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:18 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Deleted allocations for instance 873a45a7-a06f-4bcd-b517-d6f0ade7e5a3
Nov 29 20:35:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1aeee835-5397-467c-ba00-2f4f1d288b94 tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "873a45a7-a06f-4bcd-b517-d6f0ade7e5a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.692s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:19 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:35:19 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Took 0.94 seconds to deallocate network for instance.
Nov 29 20:35:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:19 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:35:19 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:35:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.496s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:19 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Deleted allocations for instance ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb
Nov 29 20:35:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0fc282c8-db0f-4b6f-94e1-53ddee082c53 tempest-AttachVolumeShelveTestJSON-1538416601 tempest-AttachVolumeShelveTestJSON-1538416601-project-member] Lock "ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.396s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-68b0184f-23f8-44fc-ac25-5691b8802c8f req-4136c68e-8aa9-4c83-b95d-3ca2fd7fb4b1 service nova] [instance: ae3cf3b5-f099-4ea6-bb28-ad94cb5fe9eb] Received event network-vif-deleted-617944a3-eb1e-431e-8b2f-f3090e4947e4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:35:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:25 user nova-compute[75356]: DEBUG nova.objects.instance [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lazy-loading 'flavor' on Instance uuid 4713c9eb-4052-4d65-a4eb-23e62352185a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:35:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:25 user nova-compute[75356]: INFO nova.compute.manager [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Attaching volume 2d194517-ede0-4a0f-ad98-706ab46c67e0 to /dev/vdb
Nov 29 20:35:26 user nova-compute[75356]: DEBUG os_brick.utils [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:35:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:26 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[05acd783-7992-45f4-82dd-ab10b6559748]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:26 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c24003-340e-4983-a7ee-420f621e0385]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:26 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a9bc2c-8e45-4a0d-ab1f-c6c65aa550de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:26 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[29713002-3b71-4510-b117-d806b2e3ef91]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:35:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:35:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:35:26 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:35:26 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bec2f31-5c37-4d0b-8581-fe2a47fa5a6f]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:35:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:35:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:35:26 user nova-compute[75356]: DEBUG os_brick.utils [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:35:26 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Updating existing volume attachment record: 4e7b2c5c-370b-4838-90c8-d72a98eb8c62 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:35:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-cbc19752-081b-4f05-9ec7-b741f1522684 req-4150c6bd-1f58-40e3-a9b9-a285cfbcf0aa service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Received event network-changed-9876a163-254d-4338-b881-4513f8acffca {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:35:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-cbc19752-081b-4f05-9ec7-b741f1522684 req-4150c6bd-1f58-40e3-a9b9-a285cfbcf0aa service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Refreshing instance network info cache due to event network-changed-9876a163-254d-4338-b881-4513f8acffca. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:35:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cbc19752-081b-4f05-9ec7-b741f1522684 req-4150c6bd-1f58-40e3-a9b9-a285cfbcf0aa service nova] Acquiring lock "refresh_cache-efda3722-c523-47e1-b942-2ec2aacf6417" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:35:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cbc19752-081b-4f05-9ec7-b741f1522684 req-4150c6bd-1f58-40e3-a9b9-a285cfbcf0aa service nova] Acquired lock "refresh_cache-efda3722-c523-47e1-b942-2ec2aacf6417" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:35:27 user nova-compute[75356]: DEBUG nova.network.neutron [req-cbc19752-081b-4f05-9ec7-b741f1522684 req-4150c6bd-1f58-40e3-a9b9-a285cfbcf0aa service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Refreshing network info cache for port 9876a163-254d-4338-b881-4513f8acffca {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:35:28 user nova-compute[75356]: DEBUG nova.network.neutron [req-cbc19752-081b-4f05-9ec7-b741f1522684 req-4150c6bd-1f58-40e3-a9b9-a285cfbcf0aa service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Updated VIF entry in instance network info cache for port 9876a163-254d-4338-b881-4513f8acffca. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:35:28 user nova-compute[75356]: DEBUG nova.network.neutron [req-cbc19752-081b-4f05-9ec7-b741f1522684 req-4150c6bd-1f58-40e3-a9b9-a285cfbcf0aa service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Updating instance_info_cache with network_info: [{"id": "9876a163-254d-4338-b881-4513f8acffca", "address": "fa:16:3e:10:e7:71", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9876a163-25", "ovs_interfaceid": "9876a163-254d-4338-b881-4513f8acffca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:35:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cbc19752-081b-4f05-9ec7-b741f1522684 req-4150c6bd-1f58-40e3-a9b9-a285cfbcf0aa service nova] Releasing lock "refresh_cache-efda3722-c523-47e1-b942-2ec2aacf6417" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:35:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "efda3722-c523-47e1-b942-2ec2aacf6417" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "efda3722-c523-47e1-b942-2ec2aacf6417" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG nova.objects.instance [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lazy-loading 'flavor' on Instance uuid efda3722-c523-47e1-b942-2ec2aacf6417 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "efda3722-c523-47e1-b942-2ec2aacf6417" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "efda3722-c523-47e1-b942-2ec2aacf6417" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "efda3722-c523-47e1-b942-2ec2aacf6417" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:30 user nova-compute[75356]: INFO nova.compute.manager [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Attaching volume 890780c3-2eae-48b7-af1b-c63d9dfb78f3 to /dev/vdb
Nov 29 20:35:30 user nova-compute[75356]: DEBUG os_brick.utils [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db34ced-933b-4e08-bd4a-8f5db395a317]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cbe925-04f3-4d14-9090-87b98d0056f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e77611-b48f-4e76-b7e7-a93cff187283]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[367e29c7-e787-4843-9f14-7ba16270d0ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:35:30 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:35:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfecd0ba-7d36-4a12-8684-73967154f2a1]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG os_brick.utils [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:35:30 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Updating existing volume attachment record: f0267319-fb5d-4e46-b702-e69dd4921592 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:35:31 user nova-compute[75356]: DEBUG nova.compute.manager [req-faf29a3c-a325-4877-bdaa-a6d53d7f273b req-b7456bbb-7b98-4d52-98be-df4b5cd2be9e service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Received event network-changed-2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:35:31 user nova-compute[75356]: DEBUG nova.compute.manager [req-faf29a3c-a325-4877-bdaa-a6d53d7f273b req-b7456bbb-7b98-4d52-98be-df4b5cd2be9e service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Refreshing instance network info cache due to event network-changed-2d549e00-e710-4b20-b6b2-69deafe8ff8d. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:35:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-faf29a3c-a325-4877-bdaa-a6d53d7f273b req-b7456bbb-7b98-4d52-98be-df4b5cd2be9e service nova] Acquiring lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:35:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-faf29a3c-a325-4877-bdaa-a6d53d7f273b req-b7456bbb-7b98-4d52-98be-df4b5cd2be9e service nova] Acquired lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:35:31 user nova-compute[75356]: DEBUG nova.network.neutron [req-faf29a3c-a325-4877-bdaa-a6d53d7f273b req-b7456bbb-7b98-4d52-98be-df4b5cd2be9e service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Refreshing network info cache for port 2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:35:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Acquiring lock "9033b98b-fb6a-4702-8308-68363c60c6dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Acquiring lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:31 user nova-compute[75356]: INFO nova.compute.manager [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Terminating instance
Nov 29 20:35:31 user nova-compute[75356]: DEBUG nova.compute.manager [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:35:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:31 user nova-compute[75356]: DEBUG nova.compute.manager [req-0889b8aa-7b97-42f8-8463-796c567a7759 req-4d5aa73e-5da4-412c-9452-54c14be24c8b service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Received event network-vif-unplugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:35:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0889b8aa-7b97-42f8-8463-796c567a7759 req-4d5aa73e-5da4-412c-9452-54c14be24c8b service nova] Acquiring lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0889b8aa-7b97-42f8-8463-796c567a7759 req-4d5aa73e-5da4-412c-9452-54c14be24c8b service nova] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0889b8aa-7b97-42f8-8463-796c567a7759 req-4d5aa73e-5da4-412c-9452-54c14be24c8b service nova] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:31 user nova-compute[75356]: DEBUG nova.compute.manager [req-0889b8aa-7b97-42f8-8463-796c567a7759 req-4d5aa73e-5da4-412c-9452-54c14be24c8b service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] No waiting events found dispatching network-vif-unplugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:35:31 user nova-compute[75356]: DEBUG nova.compute.manager [req-0889b8aa-7b97-42f8-8463-796c567a7759 req-4d5aa73e-5da4-412c-9452-54c14be24c8b service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Received event network-vif-unplugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:35:31 user nova-compute[75356]: DEBUG nova.network.neutron [req-faf29a3c-a325-4877-bdaa-a6d53d7f273b req-b7456bbb-7b98-4d52-98be-df4b5cd2be9e service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Updated VIF entry in instance network info cache for port 2d549e00-e710-4b20-b6b2-69deafe8ff8d. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:35:31 user nova-compute[75356]: DEBUG nova.network.neutron [req-faf29a3c-a325-4877-bdaa-a6d53d7f273b req-b7456bbb-7b98-4d52-98be-df4b5cd2be9e service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Updating instance_info_cache with network_info: [{"id": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "address": "fa:16:3e:c3:30:66", "network": {"id": "48d05176-aee3-4bf7-a929-a2b3714e9c6e", "bridge": "br-int", "label": "tempest-TestShelveInstance-447192641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022c8a86cda4a7c90d96d60a8261cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d549e00-e7", "ovs_interfaceid": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-faf29a3c-a325-4877-bdaa-a6d53d7f273b req-b7456bbb-7b98-4d52-98be-df4b5cd2be9e service nova] Releasing lock "refresh_cache-9033b98b-fb6a-4702-8308-68363c60c6dc" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:35:32 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Instance destroyed successfully.
Nov 29 20:35:32 user nova-compute[75356]: DEBUG nova.objects.instance [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lazy-loading 'resources' on Instance uuid 9033b98b-fb6a-4702-8308-68363c60c6dc {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T20:29:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-944208577',display_name='tempest-TestShelveInstance-server-944208577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-944208577',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7rG4LPitcy3wY+Vt34PAYOYla8jNk64fkntCEF0ecMI0BzP3qHqoNeWWWjhTJA09mZl93bIwMIVOXKCBZz2ukSQkF4PU+LPW80GhWotpvwsJBnJMXD7Ngy6h16xpSt0A==',key_name='tempest-TestShelveInstance-1797487326',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:33:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b022c8a86cda4a7c90d96d60a8261cfb',ramdisk_id='',reservation_id='r-nnfyeth2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-930711373',owner_user_name='tempest-TestShelveInstance-930711373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:33:56Z,user_data=None,user_id='3f5c736b58ab4ccc913b8efbd8d4365f',uuid=9033b98b-fb6a-4702-8308-68363c60c6dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "address": "fa:16:3e:c3:30:66", "network": {"id": "48d05176-aee3-4bf7-a929-a2b3714e9c6e", "bridge": "br-int", "label": "tempest-TestShelveInstance-447192641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022c8a86cda4a7c90d96d60a8261cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d549e00-e7", "ovs_interfaceid": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Converting VIF {"id": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "address": "fa:16:3e:c3:30:66", "network": {"id": "48d05176-aee3-4bf7-a929-a2b3714e9c6e", "bridge": "br-int", "label": "tempest-TestShelveInstance-447192641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b022c8a86cda4a7c90d96d60a8261cfb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d549e00-e7", "ovs_interfaceid": "2d549e00-e710-4b20-b6b2-69deafe8ff8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:30:66,bridge_name='br-int',has_traffic_filtering=True,id=2d549e00-e710-4b20-b6b2-69deafe8ff8d,network=Network(48d05176-aee3-4bf7-a929-a2b3714e9c6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d549e00-e7') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG os_vif [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:30:66,bridge_name='br-int',has_traffic_filtering=True,id=2d549e00-e710-4b20-b6b2-69deafe8ff8d,network=Network(48d05176-aee3-4bf7-a929-a2b3714e9c6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d549e00-e7') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d549e00-e7, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62f81d06-ee4b-4ee5-ac1a-3d99e876e4ec) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:32 user nova-compute[75356]: INFO os_vif [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:30:66,bridge_name='br-int',has_traffic_filtering=True,id=2d549e00-e710-4b20-b6b2-69deafe8ff8d,network=Network(48d05176-aee3-4bf7-a929-a2b3714e9c6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d549e00-e7')
Nov 29 20:35:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFVWetKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:35:32 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:35:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2b6b22-448a-4ddb-b138-44d3500bd5a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:35:32 user nova-compute[75356]: No targets found.
Nov 29 20:35:32 user nova-compute[75356]: iSNS:
Nov 29 20:35:32 user nova-compute[75356]: No targets found.
Nov 29 20:35:32 user nova-compute[75356]: STATIC:
Nov 29 20:35:32 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c
Nov 29 20:35:32 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:35:32 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:35:32 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345
Nov 29 20:35:32 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:35:32 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:35:32 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7
Nov 29 20:35:32 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:35:32 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:35:32 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:35:32 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:35:32 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:35:32 user nova-compute[75356]: FIRMWARE:
Nov 29 20:35:32 user nova-compute[75356]: No targets found.
Nov 29 20:35:32 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:35:32 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:35:32 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91d7775-bf4d-4364-bf92-88e3d8e54b31]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f1c521-5884-41b9-8f93-0e6c2ac273a6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:35:32 user nova-compute[75356]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:35:32 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:35:32 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:35:32 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:35:32 user nova-compute[75356]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 (non-flash)
Nov 29 20:35:32 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:35:32 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:35:32 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8308315750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7'): ({'sdc'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Removing single pathed devices sdc {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[074bf67b-aa3b-43ca-861d-5b52cf3c09f9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0979f3d-5c22-4b51-86df-b7599bd05b2b]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Flushing IO for device /dev/sdc {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0609c3-1401-4c4c-a616-6788dc498ed3]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6aa33a4-cf68-4926-a24d-1be949a0c8d1]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f8ea12db', '/dev/disk/by-id/scsi-1SCST_BIOf8ea12db-3138684965b865dd', '/dev/disk/by-id/scsi-23331333836383439') {{(pid=86863) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2485e4db-c730-432c-abe7-d3900d943add]: (4, None) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc25c12-3a4f-4d4b-951b-ca5f3e125e91]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[903fd74e-c51b-4fb0-a6c5-5705e0d7a76d]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7, portal: 172.16.0.220,3260]
Nov 29 20:35:32 user nova-compute[75356]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7, portal: 172.16.0.220,3260] successful.
Nov 29 20:35:32 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f5729c-805a-49a2-9786-a052276a3c7d]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] <== disconnect_volume: return (317ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:35:32 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Deleting instance files /opt/stack/data/nova/instances/9033b98b-fb6a-4702-8308-68363c60c6dc_del
Nov 29 20:35:32 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Deletion of /opt/stack/data/nova/instances/9033b98b-fb6a-4702-8308-68363c60c6dc_del complete
Nov 29 20:35:32 user nova-compute[75356]: INFO nova.compute.manager [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 29 20:35:32 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:35:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:33 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:35:33 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Took 0.46 seconds to deallocate network for instance.
Nov 29 20:35:33 user nova-compute[75356]: DEBUG nova.compute.manager [req-52139a20-864c-45a3-8a07-e4c464ccdb4a req-124ccd82-8d56-4f26-b5ab-ce0d77593fa9 service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Received event network-vif-deleted-2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:35:33 user nova-compute[75356]: DEBUG nova.compute.manager [req-60383def-6eb7-4408-92fb-e1790e805bb2 req-0cbd1c6f-acab-45a8-84ef-32155dbfd205 service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Received event network-vif-plugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:35:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-60383def-6eb7-4408-92fb-e1790e805bb2 req-0cbd1c6f-acab-45a8-84ef-32155dbfd205 service nova] Acquiring lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-60383def-6eb7-4408-92fb-e1790e805bb2 req-0cbd1c6f-acab-45a8-84ef-32155dbfd205 service nova] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-60383def-6eb7-4408-92fb-e1790e805bb2 req-0cbd1c6f-acab-45a8-84ef-32155dbfd205 service nova] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:33 user nova-compute[75356]: DEBUG nova.compute.manager [req-60383def-6eb7-4408-92fb-e1790e805bb2 req-0cbd1c6f-acab-45a8-84ef-32155dbfd205 service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] No waiting events found dispatching network-vif-plugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:35:33 user nova-compute[75356]: WARNING nova.compute.manager [req-60383def-6eb7-4408-92fb-e1790e805bb2 req-0cbd1c6f-acab-45a8-84ef-32155dbfd205 service nova] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Received unexpected event network-vif-plugged-2d549e00-e710-4b20-b6b2-69deafe8ff8d for instance with vm_state active and task_state deleting.
Nov 29 20:35:35 user nova-compute[75356]: INFO nova.compute.manager [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Took 2.24 seconds to detach 1 volumes for instance.
Nov 29 20:35:35 user nova-compute[75356]: DEBUG nova.compute.manager [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] [instance: 9033b98b-fb6a-4702-8308-68363c60c6dc] Deleting volume: 8dc9a5f3-f754-4c38-8a68-7ebe1831e3a7 {{(pid=75356) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'isIZMGrz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:35:35 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:35:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:35:35 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:35:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:35:35 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2397cc5a-ef50-4cf0-ab2a-f0ffd7d3db75]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:35:35 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[11247a83-a952-4966-96c4-fa81df2bc3aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0] added
Nov 29 20:35:35 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.068s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[020846e8-0b87-4517-a817-16b62ffc77e1]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f7d925-a4a9-4d31-a02a-ea4e81303bf3]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v isIZMGrz {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v isIZMGrz" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[903ad3c7-7170-44e2-9302-4ac7f15e6fd4]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'isIZMGrz'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbec904-5f88-4688-ba4e-cfeae0106ea4]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9982f074-0323-43ce-abce-e619cf410dbb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:35:35 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:35:35 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:35:35 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:35:35 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:35:35 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:35:35 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[109f1f5b-3bef-4ffa-99a2-1ae3e02e5328]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0, portal: 172.16.0.220,3260]
Nov 29 20:35:35 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0, portal: 172.16.0.220,3260] successful.
Nov 29 20:35:35 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4517ef-50c7-4a15-b4eb-3e0083345134]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0d0ed6-9472-4f21-90af-98548357fede]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:35:35 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:35:35 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:35:35 user nova-compute[75356]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 (non-flash)
Nov 29 20:35:35 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:35:35 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:35:35 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:35:35 user nova-compute[75356]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 (non-flash)
Nov 29 20:35:35 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69c4f94-9543-4f18-ab96-1b6baaaa9a6f]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'isIZMGrz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:35:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:36 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Deleted allocations for instance 9033b98b-fb6a-4702-8308-68363c60c6dc
Nov 29 20:35:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6817a454-cb98-4862-9cd2-8e0bf44f7727 tempest-TestShelveInstance-930711373 tempest-TestShelveInstance-930711373-project-member] Lock "9033b98b-fb6a-4702-8308-68363c60c6dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.742s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:35:36 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '26562306631636330', 'path': '/dev/sdc'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:35:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562306631636330', 'path': '/dev/sdc'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:35:36 user nova-compute[75356]: DEBUG nova.objects.instance [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lazy-loading 'flavor' on Instance uuid 4713c9eb-4052-4d65-a4eb-23e62352185a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:35:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:35:36 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:35:36 user nova-compute[75356]:   <source dev="/dev/sdc"/>
Nov 29 20:35:36 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:35:36 user nova-compute[75356]:   <serial>2d194517-ede0-4a0f-ad98-706ab46c67e0</serial>
Nov 29 20:35:36 user nova-compute[75356]: </disk>
Nov 29 20:35:36 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:35:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:35:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:35:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] No VIF found with MAC fa:16:3e:6d:3e:e2, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:35:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7da57715-5c1d-4711-b1cd-e844bb505cd2 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.465s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:39 user nova-compute[75356]: INFO nova.compute.manager [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Detaching volume 2d194517-ede0-4a0f-ad98-706ab46c67e0
Nov 29 20:35:39 user nova-compute[75356]: INFO nova.virt.block_device [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Attempting to driver detach volume 2d194517-ede0-4a0f-ad98-706ab46c67e0 from mountpoint /dev/vdb
Nov 29 20:35:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Attempting to detach device vdb from instance 4713c9eb-4052-4d65-a4eb-23e62352185a from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:35:39 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:35:39 user nova-compute[75356]:   <source dev="/dev/sdc"/>
Nov 29 20:35:39 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:35:39 user nova-compute[75356]:   <serial>2d194517-ede0-4a0f-ad98-706ab46c67e0</serial>
Nov 29 20:35:39 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:35:39 user nova-compute[75356]: </disk>
Nov 29 20:35:39 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:35:39 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Successfully detached device vdb from instance 4713c9eb-4052-4d65-a4eb-23e62352185a from the persistent domain config.
Nov 29 20:35:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4713c9eb-4052-4d65-a4eb-23e62352185a from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:35:39 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:35:39 user nova-compute[75356]:   <source dev="/dev/sdc"/>
Nov 29 20:35:39 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:35:39 user nova-compute[75356]:   <serial>2d194517-ede0-4a0f-ad98-706ab46c67e0</serial>
Nov 29 20:35:39 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:35:39 user nova-compute[75356]: </disk>
Nov 29 20:35:39 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPoxdDyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:35:39 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:35:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:35:39 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:35:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:35:39 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c2c20a-6a82-485d-ba3e-dff7160a422c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:35:39 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e207d00-0141-4b63-b2a0-3642848e6b44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3] added
Nov 29 20:35:39 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f983ae17-01fe-4fab-9739-2729499d7bc7]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[482efb81-9394-4951-95bc-552cfa7d10a2]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UPoxdDyj {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UPoxdDyj" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac4db83-290c-4c44-951e-1ff2ca814083]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UPoxdDyj'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[462d78bd-48d4-46b9-93a3-b897ea0de143]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4cef82-9792-410d-b5f2-4a22658e8535]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:35:39 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:35:39 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:35:39 user nova-compute[75356]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 (non-flash)
Nov 29 20:35:39 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:35:39 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:35:39 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:35:39 user nova-compute[75356]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 (non-flash)
Nov 29 20:35:39 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06348b4-1750-4065-8501-2613c44f0abb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3, portal: 172.16.0.220,3260]
Nov 29 20:35:39 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3, portal: 172.16.0.220,3260] successful.
Nov 29 20:35:39 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a678ccb8-e4a3-4aaa-b2b9-87f0e0678d85]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35bb8e1-bd4a-40f9-831b-b12a3f50ba37]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:35:39 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:35:39 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:35:39 user nova-compute[75356]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 (non-flash)
Nov 29 20:35:39 user nova-compute[75356]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 (non-flash)
Nov 29 20:35:39 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:35:39 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:35:39 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:35:39 user nova-compute[75356]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 (non-flash)
Nov 29 20:35:39 user nova-compute[75356]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 (non-flash)
Nov 29 20:35:39 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] HCTL ('37', '-', '-', 0) found on session 44 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e4c325-97ad-4e73-a60d-a6d6aebb8eae]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Searching for a device in session 44 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPoxdDyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:35:39 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4713c9eb-4052-4d65-a4eb-23e62352185a {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:35:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:35:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26164653432356438', 'path': '/dev/sdf'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:35:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164653432356438', 'path': '/dev/sdf'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:35:40 user nova-compute[75356]: DEBUG nova.objects.instance [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lazy-loading 'flavor' on Instance uuid efda3722-c523-47e1-b942-2ec2aacf6417 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:35:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:35:40 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:35:40 user nova-compute[75356]:   <source dev="/dev/sdf"/>
Nov 29 20:35:40 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:35:40 user nova-compute[75356]:   <serial>890780c3-2eae-48b7-af1b-c63d9dfb78f3</serial>
Nov 29 20:35:40 user nova-compute[75356]: </disk>
Nov 29 20:35:40 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:35:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:35:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:35:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] No VIF found with MAC fa:16:3e:10:e7:71, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:35:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-1d968bff-b4bf-47ad-bef6-a16c2aafc347 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "efda3722-c523-47e1-b942-2ec2aacf6417" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.661s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:35:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "efda3722-c523-47e1-b942-2ec2aacf6417" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:35:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "efda3722-c523-47e1-b942-2ec2aacf6417" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:35:42 user nova-compute[75356]: INFO nova.compute.manager [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Detaching volume 890780c3-2eae-48b7-af1b-c63d9dfb78f3
Nov 29 20:35:42 user nova-compute[75356]: INFO nova.virt.block_device [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Attempting to driver detach volume 890780c3-2eae-48b7-af1b-c63d9dfb78f3 from mountpoint /dev/vdb
Nov 29 20:35:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Attempting to detach device vdb from instance efda3722-c523-47e1-b942-2ec2aacf6417 from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:35:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:35:42 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:35:42 user nova-compute[75356]:   <source dev="/dev/sdf"/>
Nov 29 20:35:42 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:35:42 user nova-compute[75356]:   <serial>890780c3-2eae-48b7-af1b-c63d9dfb78f3</serial>
Nov 29 20:35:42 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:35:42 user nova-compute[75356]: </disk>
Nov 29 20:35:42 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:35:42 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Successfully detached device vdb from instance efda3722-c523-47e1-b942-2ec2aacf6417 from the persistent domain config.
Nov 29 20:35:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance efda3722-c523-47e1-b942-2ec2aacf6417 from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:35:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:35:42 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:35:42 user nova-compute[75356]:   <source dev="/dev/sdf"/>
Nov 29 20:35:42 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:35:42 user nova-compute[75356]:   <serial>890780c3-2eae-48b7-af1b-c63d9dfb78f3</serial>
Nov 29 20:35:42 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:35:42 user nova-compute[75356]: </disk>
Nov 29 20:35:42 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:35:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance efda3722-c523-47e1-b942-2ec2aacf6417 {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:35:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:35:59 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4713c9eb-4052-4d65-a4eb-23e62352185a is timed out.
Nov 29 20:35:59 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Successfully detached device vdb from instance 4713c9eb-4052-4d65-a4eb-23e62352185a from the live domain config.
Nov 29 20:35:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'isIZMGrz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:35:59 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:35:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d344a1-c320-4965-b02b-a94f6645bb4c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:35:59 user nova-compute[75356]: No targets found.
Nov 29 20:35:59 user nova-compute[75356]: iSNS:
Nov 29 20:35:59 user nova-compute[75356]: No targets found.
Nov 29 20:35:59 user nova-compute[75356]: STATIC:
Nov 29 20:35:59 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c
Nov 29 20:35:59 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:35:59 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:35:59 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345
Nov 29 20:35:59 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:35:59 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:35:59 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0
Nov 29 20:35:59 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:35:59 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:35:59 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3
Nov 29 20:35:59 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:35:59 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:35:59 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:35:59 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:35:59 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:35:59 user nova-compute[75356]: FIRMWARE:
Nov 29 20:35:59 user nova-compute[75356]: No targets found.
Nov 29 20:35:59 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:35:59 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:35:59 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dc78d9-b9eb-4156-aaf1-860e65f8f463]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[34727770-799d-44e4-82b9-0eb92a2a2cc1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:35:59 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:35:59 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:35:59 user nova-compute[75356]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 (non-flash)
Nov 29 20:35:59 user nova-compute[75356]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 (non-flash)
Nov 29 20:35:59 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:35:59 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:35:59 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:35:59 user nova-compute[75356]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 (non-flash)
Nov 29 20:35:59 user nova-compute[75356]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 (non-flash)
Nov 29 20:35:59 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e41b30a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0'): ({'sdc'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Removing single pathed devices sdc {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4826dc-b43d-4ece-b34b-07c2a329a806]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[334ef02b-a064-4fc9-821a-1e52635b643f]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Flushing IO for device /dev/sdc {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3a4f51-03ce-417c-bd30-b17659055298]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ae8206-3feb-452e-8052-93220915bfc6]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb6d169-90f4-4d18-b790-d6c214b63838]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:35:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0234a381-8e42-4b34-8f68-35f6d8ce50be]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0, portal: 172.16.0.220,3260]
Nov 29 20:36:00 user nova-compute[75356]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0, portal: 172.16.0.220,3260] successful.
Nov 29 20:36:00 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:36:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d194517-ede0-4a0f-ad98-706ab46c67e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f007f546-6743-4331-b5b8-6b3e876a4c3f]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:36:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:36:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] <== disconnect_volume: return (320ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:36:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:36:00 user nova-compute[75356]: DEBUG nova.objects.instance [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lazy-loading 'flavor' on Instance uuid 4713c9eb-4052-4d65-a4eb-23e62352185a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:36:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-afd7d112-462f-4564-bf90-b22e8daa57fd tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.707s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:02 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance efda3722-c523-47e1-b942-2ec2aacf6417 is timed out.
Nov 29 20:36:02 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Successfully detached device vdb from instance efda3722-c523-47e1-b942-2ec2aacf6417 from the live domain config.
Nov 29 20:36:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UPoxdDyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:36:02 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:36:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d165a86c-2ec1-4d08-8182-2afdb1d299e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:36:02 user nova-compute[75356]: No targets found.
Nov 29 20:36:02 user nova-compute[75356]: iSNS:
Nov 29 20:36:02 user nova-compute[75356]: No targets found.
Nov 29 20:36:02 user nova-compute[75356]: STATIC:
Nov 29 20:36:02 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c
Nov 29 20:36:02 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:36:02 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:36:02 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345
Nov 29 20:36:02 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:36:02 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:36:02 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3
Nov 29 20:36:02 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:36:02 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:36:02 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:36:02 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:36:02 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:36:02 user nova-compute[75356]: FIRMWARE:
Nov 29 20:36:02 user nova-compute[75356]: No targets found.
Nov 29 20:36:02 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:36:02 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:36:02 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7271ac5-6f30-4055-92b8-020d92c1ddea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c074123-ed54-413f-b3f7-ab6ad7bd25bd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:36:02 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:36:02 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:36:02 user nova-compute[75356]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 (non-flash)
Nov 29 20:36:02 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:36:02 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:36:02 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:36:02 user nova-compute[75356]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 (non-flash)
Nov 29 20:36:02 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e4124790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3'): ({'sdf'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Removing single pathed devices sdf {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[53753675-b74b-4354-b646-55a12b43c55d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc30b707-bd5d-45eb-879c-4e549ed67287]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Flushing IO for device /dev/sdf {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce824b77-ac23-4057-a345-30ac069065af]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[360f4bb8-93c8-4be5-ade1-08cadbaf680d]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] SCSI volumes sdf have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:36:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[61eda972-4820-42b0-9780-48668de000e7]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:36:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fb265d-0ae7-46e4-ae76-799ded5dbd78]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3, portal: 172.16.0.220,3260]
Nov 29 20:36:03 user nova-compute[75356]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3, portal: 172.16.0.220,3260] successful.
Nov 29 20:36:03 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:36:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890780c3-2eae-48b7-af1b-c63d9dfb78f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35a3722-f016-4780-979f-5cb9ef939dbe]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:36:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:36:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] <== disconnect_volume: return (324ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:36:03 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:36:03 user nova-compute[75356]: DEBUG nova.objects.instance [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lazy-loading 'flavor' on Instance uuid efda3722-c523-47e1-b942-2ec2aacf6417 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:36:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fb7f9d7a-45f5-4189-a1cf-b86bf8cdba3d tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "efda3722-c523-47e1-b942-2ec2aacf6417" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.644s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:05 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:36:05 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:36:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-93183110-d2e2-4da7-ab7d-73378f5e0d42" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:36:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-93183110-d2e2-4da7-ab7d-73378f5e0d42" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:36:05 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:36:05 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Updating instance_info_cache with network_info: [{"id": "a9883307-4927-4472-932e-b7a9354d5fe8", "address": "fa:16:3e:80:43:0b", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9883307-49", "ovs_interfaceid": "a9883307-4927-4472-932e-b7a9354d5fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:36:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-93183110-d2e2-4da7-ab7d-73378f5e0d42" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:36:05 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:36:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "db0826f0-5fdc-47a8-ae36-5059844980c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "db0826f0-5fdc-47a8-ae36-5059844980c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "db0826f0-5fdc-47a8-ae36-5059844980c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "db0826f0-5fdc-47a8-ae36-5059844980c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "db0826f0-5fdc-47a8-ae36-5059844980c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:06 user nova-compute[75356]: INFO nova.compute.manager [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Terminating instance
Nov 29 20:36:06 user nova-compute[75356]: DEBUG nova.compute.manager [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:36:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-f86b36f6-31ad-4705-9001-8e2cc1b50d04 req-827aba6e-a9ad-42cc-8c95-4f6e388261a0 service nova] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Received event network-vif-unplugged-56560c36-ae98-45b9-9179-fd4dc2a689dc {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:36:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f86b36f6-31ad-4705-9001-8e2cc1b50d04 req-827aba6e-a9ad-42cc-8c95-4f6e388261a0 service nova] Acquiring lock "db0826f0-5fdc-47a8-ae36-5059844980c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f86b36f6-31ad-4705-9001-8e2cc1b50d04 req-827aba6e-a9ad-42cc-8c95-4f6e388261a0 service nova] Lock "db0826f0-5fdc-47a8-ae36-5059844980c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f86b36f6-31ad-4705-9001-8e2cc1b50d04 req-827aba6e-a9ad-42cc-8c95-4f6e388261a0 service nova] Lock "db0826f0-5fdc-47a8-ae36-5059844980c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-f86b36f6-31ad-4705-9001-8e2cc1b50d04 req-827aba6e-a9ad-42cc-8c95-4f6e388261a0 service nova] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] No waiting events found dispatching network-vif-unplugged-56560c36-ae98-45b9-9179-fd4dc2a689dc {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:36:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-f86b36f6-31ad-4705-9001-8e2cc1b50d04 req-827aba6e-a9ad-42cc-8c95-4f6e388261a0 service nova] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Received event network-vif-unplugged-56560c36-ae98-45b9-9179-fd4dc2a689dc for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:36:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:07 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Instance destroyed successfully.
Nov 29 20:36:07 user nova-compute[75356]: DEBUG nova.objects.instance [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lazy-loading 'resources' on Instance uuid db0826f0-5fdc-47a8-ae36-5059844980c9 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:36:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:21:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-403842688',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-403842688',id=19,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:22:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bed33acdfd5f48b9967d1dd68c261d78',ramdisk_id='',reservation_id='r-c9n0vkyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2041863686',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:23:57Z,user_data=None,user_id='e395b4248b794d65915edf2d23bbbeaf',uuid=db0826f0-5fdc-47a8-ae36-5059844980c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "address": "fa:16:3e:80:ff:16", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56560c36-ae", "ovs_interfaceid": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:36:07 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Converting VIF {"id": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "address": "fa:16:3e:80:ff:16", "network": {"id": "85204b46-56fd-45e3-a160-97883b349ddb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-35754494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed33acdfd5f48b9967d1dd68c261d78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56560c36-ae", "ovs_interfaceid": "56560c36-ae98-45b9-9179-fd4dc2a689dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:36:07 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:ff:16,bridge_name='br-int',has_traffic_filtering=True,id=56560c36-ae98-45b9-9179-fd4dc2a689dc,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56560c36-ae') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:36:07 user nova-compute[75356]: DEBUG os_vif [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:ff:16,bridge_name='br-int',has_traffic_filtering=True,id=56560c36-ae98-45b9-9179-fd4dc2a689dc,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56560c36-ae') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:36:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56560c36-ae, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:36:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:36:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec787d5d-2605-4d77-b864-2c9ea97f1c1d) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:36:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:36:07 user nova-compute[75356]: INFO os_vif [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:ff:16,bridge_name='br-int',has_traffic_filtering=True,id=56560c36-ae98-45b9-9179-fd4dc2a689dc,network=Network(85204b46-56fd-45e3-a160-97883b349ddb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56560c36-ae')
Nov 29 20:36:07 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Deleting instance files /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9_del
Nov 29 20:36:07 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Deletion of /opt/stack/data/nova/instances/db0826f0-5fdc-47a8-ae36-5059844980c9_del complete
Nov 29 20:36:07 user nova-compute[75356]: INFO nova.compute.manager [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 29 20:36:07 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:36:07 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:36:07 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:36:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-8520906b-2cdf-4d82-8cda-24cae14c2ebb req-1c5fa6da-85cd-4864-a64e-a73430eb915c service nova] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Received event network-changed-ee4221aa-038d-4682-841d-998caa343459 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:36:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-8520906b-2cdf-4d82-8cda-24cae14c2ebb req-1c5fa6da-85cd-4864-a64e-a73430eb915c service nova] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Refreshing instance network info cache due to event network-changed-ee4221aa-038d-4682-841d-998caa343459. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:36:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-8520906b-2cdf-4d82-8cda-24cae14c2ebb req-1c5fa6da-85cd-4864-a64e-a73430eb915c service nova] Acquiring lock "refresh_cache-6f70aee5-c3b8-4da8-8903-a305b1275552" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:36:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-8520906b-2cdf-4d82-8cda-24cae14c2ebb req-1c5fa6da-85cd-4864-a64e-a73430eb915c service nova] Acquired lock "refresh_cache-6f70aee5-c3b8-4da8-8903-a305b1275552" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:36:07 user nova-compute[75356]: DEBUG nova.network.neutron [req-8520906b-2cdf-4d82-8cda-24cae14c2ebb req-1c5fa6da-85cd-4864-a64e-a73430eb915c service nova] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Refreshing network info cache for port ee4221aa-038d-4682-841d-998caa343459 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:36:08 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:36:08 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Took 0.75 seconds to deallocate network for instance.
Nov 29 20:36:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:08 user nova-compute[75356]: DEBUG nova.network.neutron [req-8520906b-2cdf-4d82-8cda-24cae14c2ebb req-1c5fa6da-85cd-4864-a64e-a73430eb915c service nova] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Updated VIF entry in instance network info cache for port ee4221aa-038d-4682-841d-998caa343459. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:36:08 user nova-compute[75356]: DEBUG nova.network.neutron [req-8520906b-2cdf-4d82-8cda-24cae14c2ebb req-1c5fa6da-85cd-4864-a64e-a73430eb915c service nova] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Updating instance_info_cache with network_info: [{"id": "ee4221aa-038d-4682-841d-998caa343459", "address": "fa:16:3e:42:8d:f2", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee4221aa-03", "ovs_interfaceid": "ee4221aa-038d-4682-841d-998caa343459", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:36:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-8520906b-2cdf-4d82-8cda-24cae14c2ebb req-1c5fa6da-85cd-4864-a64e-a73430eb915c service nova] Releasing lock "refresh_cache-6f70aee5-c3b8-4da8-8903-a305b1275552" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:36:08 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:36:08 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:36:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:08 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Deleted allocations for instance db0826f0-5fdc-47a8-ae36-5059844980c9
Nov 29 20:36:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70831a4f-5794-4d55-ad2b-d9899d9c0f11 tempest-ServerBootFromVolumeStableRescueTest-2041863686 tempest-ServerBootFromVolumeStableRescueTest-2041863686-project-member] Lock "db0826f0-5fdc-47a8-ae36-5059844980c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.263s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-e23c2535-2b54-4435-873d-d9e6e8c37487 req-eab7c779-f22c-466a-a129-f339a12dfd5c service nova] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Received event network-vif-plugged-56560c36-ae98-45b9-9179-fd4dc2a689dc {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:36:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e23c2535-2b54-4435-873d-d9e6e8c37487 req-eab7c779-f22c-466a-a129-f339a12dfd5c service nova] Acquiring lock "db0826f0-5fdc-47a8-ae36-5059844980c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e23c2535-2b54-4435-873d-d9e6e8c37487 req-eab7c779-f22c-466a-a129-f339a12dfd5c service nova] Lock "db0826f0-5fdc-47a8-ae36-5059844980c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-e23c2535-2b54-4435-873d-d9e6e8c37487 req-eab7c779-f22c-466a-a129-f339a12dfd5c service nova] Lock "db0826f0-5fdc-47a8-ae36-5059844980c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-e23c2535-2b54-4435-873d-d9e6e8c37487 req-eab7c779-f22c-466a-a129-f339a12dfd5c service nova] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] No waiting events found dispatching network-vif-plugged-56560c36-ae98-45b9-9179-fd4dc2a689dc {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:36:08 user nova-compute[75356]: WARNING nova.compute.manager [req-e23c2535-2b54-4435-873d-d9e6e8c37487 req-eab7c779-f22c-466a-a129-f339a12dfd5c service nova] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Received unexpected event network-vif-plugged-56560c36-ae98-45b9-9179-fd4dc2a689dc for instance with vm_state deleted and task_state None.
Nov 29 20:36:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "0b59517a-c467-432a-a73a-d1460c1574e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "0b59517a-c467-432a-a73a-d1460c1574e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "0b59517a-c467-432a-a73a-d1460c1574e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "0b59517a-c467-432a-a73a-d1460c1574e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "0b59517a-c467-432a-a73a-d1460c1574e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:09 user nova-compute[75356]: INFO nova.compute.manager [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Terminating instance
Nov 29 20:36:09 user nova-compute[75356]: DEBUG nova.compute.manager [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "6f70aee5-c3b8-4da8-8903-a305b1275552" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "6f70aee5-c3b8-4da8-8903-a305b1275552" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "6f70aee5-c3b8-4da8-8903-a305b1275552-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "6f70aee5-c3b8-4da8-8903-a305b1275552-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "6f70aee5-c3b8-4da8-8903-a305b1275552-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:09 user nova-compute[75356]: INFO nova.compute.manager [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Terminating instance
Nov 29 20:36:09 user nova-compute[75356]: DEBUG nova.compute.manager [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:09 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Instance destroyed successfully.
Nov 29 20:36:09 user nova-compute[75356]: DEBUG nova.objects.instance [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lazy-loading 'resources' on Instance uuid 0b59517a-c467-432a-a73a-d1460c1574e7 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1928552552',display_name='tempest-ServerActionsTestOtherA-server-1928552552',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1928552552',id=3,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBES/hmUhRPMEp7jxGNAJkTADe+ykaGX7onK5o5CXk4BGHWdyPerc54MOJxjy4wx3hHylMSlWH2Wjk+mHShNqdbk6ZSJg34jMi+lLZfOCW4j+M+c+q1Lzq5VJUbAeMltLBQ==',key_name='tempest-keypair-777625238',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:17:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b14efb1a4d34a3db7a51bd79234b86b',ramdisk_id='',reservation_id='r-t5ejtk9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1000495362',owner_user_name='tempest-ServerActionsTestOtherA-1000495362-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:17:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc7cfc71d0c448cbbe8d42f8b617d8b',uuid=0b59517a-c467-432a-a73a-d1460c1574e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56a80963-a1f2-429e-8474-1795928fd05c", "address": "fa:16:3e:74:bd:99", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a80963-a1", "ovs_interfaceid": "56a80963-a1f2-429e-8474-1795928fd05c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converting VIF {"id": "56a80963-a1f2-429e-8474-1795928fd05c", "address": "fa:16:3e:74:bd:99", "network": {"id": "1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2079172215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b14efb1a4d34a3db7a51bd79234b86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56a80963-a1", "ovs_interfaceid": "56a80963-a1f2-429e-8474-1795928fd05c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:bd:99,bridge_name='br-int',has_traffic_filtering=True,id=56a80963-a1f2-429e-8474-1795928fd05c,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56a80963-a1') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG os_vif [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:bd:99,bridge_name='br-int',has_traffic_filtering=True,id=56a80963-a1f2-429e-8474-1795928fd05c,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56a80963-a1') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56a80963-a1, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6b97130-92d7-41a0-80d1-e76187789bdb) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:09 user nova-compute[75356]: INFO os_vif [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:bd:99,bridge_name='br-int',has_traffic_filtering=True,id=56a80963-a1f2-429e-8474-1795928fd05c,network=Network(1f0a99ba-311e-4ba3-9565-2ec41bfb3e8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56a80963-a1')
Nov 29 20:36:09 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Deleting instance files /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7_del
Nov 29 20:36:09 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Deletion of /opt/stack/data/nova/instances/0b59517a-c467-432a-a73a-d1460c1574e7_del complete
Nov 29 20:36:09 user nova-compute[75356]: DEBUG nova.compute.manager [req-0ba813e2-c5f3-4838-83c3-1745a774cdff req-4ce3ee3b-3919-4c7c-9ead-8ab3edd24309 service nova] [instance: db0826f0-5fdc-47a8-ae36-5059844980c9] Received event network-vif-deleted-56560c36-ae98-45b9-9179-fd4dc2a689dc {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:36:09 user nova-compute[75356]: DEBUG nova.compute.manager [req-0ba813e2-c5f3-4838-83c3-1745a774cdff req-4ce3ee3b-3919-4c7c-9ead-8ab3edd24309 service nova] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Received event network-vif-unplugged-ee4221aa-038d-4682-841d-998caa343459 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0ba813e2-c5f3-4838-83c3-1745a774cdff req-4ce3ee3b-3919-4c7c-9ead-8ab3edd24309 service nova] Acquiring lock "6f70aee5-c3b8-4da8-8903-a305b1275552-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0ba813e2-c5f3-4838-83c3-1745a774cdff req-4ce3ee3b-3919-4c7c-9ead-8ab3edd24309 service nova] Lock "6f70aee5-c3b8-4da8-8903-a305b1275552-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0ba813e2-c5f3-4838-83c3-1745a774cdff req-4ce3ee3b-3919-4c7c-9ead-8ab3edd24309 service nova] Lock "6f70aee5-c3b8-4da8-8903-a305b1275552-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG nova.compute.manager [req-0ba813e2-c5f3-4838-83c3-1745a774cdff req-4ce3ee3b-3919-4c7c-9ead-8ab3edd24309 service nova] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] No waiting events found dispatching network-vif-unplugged-ee4221aa-038d-4682-841d-998caa343459 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG nova.compute.manager [req-0ba813e2-c5f3-4838-83c3-1745a774cdff req-4ce3ee3b-3919-4c7c-9ead-8ab3edd24309 service nova] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Received event network-vif-unplugged-ee4221aa-038d-4682-841d-998caa343459 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:36:10 user nova-compute[75356]: INFO nova.compute.manager [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:36:10 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Instance destroyed successfully.
Nov 29 20:36:10 user nova-compute[75356]: DEBUG nova.objects.instance [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lazy-loading 'resources' on Instance uuid 6f70aee5-c3b8-4da8-8903-a305b1275552 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:34:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-586646496',display_name='tempest-TestVolumeBootPattern-server-586646496',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-586646496',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0zsffzZhgXAi/NOnOb6jr5SbjRUa5Ws+6E3ecNSbb6yR1bA/I1Lldbh3v8Eu9yysHBBgvc3puTY35+MIoawU5+qPudnUjWfeo2D4YgfUZH7hVHtowFiKG6iSLDsjXIsA==',key_name='tempest-TestVolumeBootPattern-313405727',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:34:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6791b0c999846e2a22d5735f91ea1aa',ramdisk_id='',reservation_id='r-ic6sagkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1627976633',owner_user_name='tempest-TestVolumeBootPattern-1627976633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:34:29Z,user_data=None,user_id='081b00360a204be3bd6435807283f230',uuid=6f70aee5-c3b8-4da8-8903-a305b1275552,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee4221aa-038d-4682-841d-998caa343459", "address": "fa:16:3e:42:8d:f2", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee4221aa-03", "ovs_interfaceid": "ee4221aa-038d-4682-841d-998caa343459", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converting VIF {"id": "ee4221aa-038d-4682-841d-998caa343459", "address": "fa:16:3e:42:8d:f2", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee4221aa-03", "ovs_interfaceid": "ee4221aa-038d-4682-841d-998caa343459", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:8d:f2,bridge_name='br-int',has_traffic_filtering=True,id=ee4221aa-038d-4682-841d-998caa343459,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee4221aa-03') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG os_vif [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:8d:f2,bridge_name='br-int',has_traffic_filtering=True,id=ee4221aa-038d-4682-841d-998caa343459,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee4221aa-03') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee4221aa-03, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3273cd0f-0f18-427c-b673-ec04691b82e8) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:36:10 user nova-compute[75356]: INFO os_vif [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:8d:f2,bridge_name='br-int',has_traffic_filtering=True,id=ee4221aa-038d-4682-841d-998caa343459,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee4221aa-03')
Nov 29 20:36:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVgCudKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:36:10 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:36:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43a5ad6-28ad-4844-a920-7ffa7e9748a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:36:10 user nova-compute[75356]: No targets found.
Nov 29 20:36:10 user nova-compute[75356]: iSNS:
Nov 29 20:36:10 user nova-compute[75356]: No targets found.
Nov 29 20:36:10 user nova-compute[75356]: STATIC:
Nov 29 20:36:10 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c
Nov 29 20:36:10 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:36:10 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:36:10 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345
Nov 29 20:36:10 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:36:10 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:36:10 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:36:10 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:36:10 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:36:10 user nova-compute[75356]: FIRMWARE:
Nov 29 20:36:10 user nova-compute[75356]: No targets found.
Nov 29 20:36:10 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:36:10 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:36:10 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde1657b-29cc-4fb1-b82b-b3d7be18bd7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc01209-e99a-410b-a579-4e15c3db4597]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:36:10 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:36:10 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:36:10 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:36:10 user nova-compute[75356]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:36:10 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:36:10 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830823b130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c'): ({'sdd'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Removing single pathed devices sdd {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4b63ec-32fe-48b9-9566-3ad0fa5c9424]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b186e1e-35cc-4b0a-b728-cd87686a742a]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Flushing IO for device /dev/sdd {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cb727d-1ea8-44cb-a26d-c4c2dc5cfeb9]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8386720b-d89f-44ce-a056-a21798d67bd7]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] SCSI volumes sdd have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4458167b-4575-421b-8b9b-c5602e7b5daa]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:36:10 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Took 0.71 seconds to deallocate network for instance.
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bb9189-4918-431b-b7f6-a807ddf32db9]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c, portal: 172.16.0.220,3260]
Nov 29 20:36:10 user nova-compute[75356]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c, portal: 172.16.0.220,3260] successful.
Nov 29 20:36:10 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[956e5862-48f6-4ec4-9555-77f562afae3f]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] <== disconnect_volume: return (434ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:36:10 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Deleting instance files /opt/stack/data/nova/instances/6f70aee5-c3b8-4da8-8903-a305b1275552_del
Nov 29 20:36:10 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Deletion of /opt/stack/data/nova/instances/6f70aee5-c3b8-4da8-8903-a305b1275552_del complete
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:11 user nova-compute[75356]: INFO nova.compute.manager [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Took 1.49 seconds to destroy the instance on the hypervisor.
Nov 29 20:36:11 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:36:11 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:36:11 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:36:11 user nova-compute[75356]: DEBUG nova.compute.manager [req-ec41923e-9cd1-43dc-a127-76e215b333ad req-32252ef6-1112-4ec0-84b8-735acde831a0 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Received event network-vif-unplugged-56a80963-a1f2-429e-8474-1795928fd05c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:36:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ec41923e-9cd1-43dc-a127-76e215b333ad req-32252ef6-1112-4ec0-84b8-735acde831a0 service nova] Acquiring lock "0b59517a-c467-432a-a73a-d1460c1574e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ec41923e-9cd1-43dc-a127-76e215b333ad req-32252ef6-1112-4ec0-84b8-735acde831a0 service nova] Lock "0b59517a-c467-432a-a73a-d1460c1574e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ec41923e-9cd1-43dc-a127-76e215b333ad req-32252ef6-1112-4ec0-84b8-735acde831a0 service nova] Lock "0b59517a-c467-432a-a73a-d1460c1574e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:11 user nova-compute[75356]: DEBUG nova.compute.manager [req-ec41923e-9cd1-43dc-a127-76e215b333ad req-32252ef6-1112-4ec0-84b8-735acde831a0 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] No waiting events found dispatching network-vif-unplugged-56a80963-a1f2-429e-8474-1795928fd05c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:36:11 user nova-compute[75356]: WARNING nova.compute.manager [req-ec41923e-9cd1-43dc-a127-76e215b333ad req-32252ef6-1112-4ec0-84b8-735acde831a0 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Received unexpected event network-vif-unplugged-56a80963-a1f2-429e-8474-1795928fd05c for instance with vm_state deleted and task_state None.
Nov 29 20:36:11 user nova-compute[75356]: DEBUG nova.compute.manager [req-ec41923e-9cd1-43dc-a127-76e215b333ad req-32252ef6-1112-4ec0-84b8-735acde831a0 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Received event network-vif-plugged-56a80963-a1f2-429e-8474-1795928fd05c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:36:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ec41923e-9cd1-43dc-a127-76e215b333ad req-32252ef6-1112-4ec0-84b8-735acde831a0 service nova] Acquiring lock "0b59517a-c467-432a-a73a-d1460c1574e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ec41923e-9cd1-43dc-a127-76e215b333ad req-32252ef6-1112-4ec0-84b8-735acde831a0 service nova] Lock "0b59517a-c467-432a-a73a-d1460c1574e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ec41923e-9cd1-43dc-a127-76e215b333ad req-32252ef6-1112-4ec0-84b8-735acde831a0 service nova] Lock "0b59517a-c467-432a-a73a-d1460c1574e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:11 user nova-compute[75356]: DEBUG nova.compute.manager [req-ec41923e-9cd1-43dc-a127-76e215b333ad req-32252ef6-1112-4ec0-84b8-735acde831a0 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] No waiting events found dispatching network-vif-plugged-56a80963-a1f2-429e-8474-1795928fd05c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:36:11 user nova-compute[75356]: WARNING nova.compute.manager [req-ec41923e-9cd1-43dc-a127-76e215b333ad req-32252ef6-1112-4ec0-84b8-735acde831a0 service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Received unexpected event network-vif-plugged-56a80963-a1f2-429e-8474-1795928fd05c for instance with vm_state deleted and task_state None.
Nov 29 20:36:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:11 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:36:11 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:36:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:11 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Error from libvirt while getting description of instance-00000028: [Error Code 42] Domain not found: no domain with matching uuid '6f70aee5-c3b8-4da8-8903-a305b1275552' (instance-00000028): libvirt.libvirtError: Domain not found: no domain with matching uuid '6f70aee5-c3b8-4da8-8903-a305b1275552' (instance-00000028)
Nov 29 20:36:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.545s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:11 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Deleted allocations for instance 0b59517a-c467-432a-a73a-d1460c1574e7
Nov 29 20:36:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-22b1cb41-02ea-46d1-bbe7-d2c202f1f60c tempest-ServerActionsTestOtherA-1000495362 tempest-ServerActionsTestOtherA-1000495362-project-member] Lock "0b59517a-c467-432a-a73a-d1460c1574e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.512s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:11 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:36:11 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Took 0.72 seconds to deallocate network for instance.
Nov 29 20:36:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:12 user nova-compute[75356]: DEBUG nova.compute.manager [req-b9d1f15d-d31e-4f9f-a836-d01946c57763 req-71e0ac40-e868-45a8-9eaf-815236c7c1fc service nova] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Received event network-vif-plugged-ee4221aa-038d-4682-841d-998caa343459 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:36:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b9d1f15d-d31e-4f9f-a836-d01946c57763 req-71e0ac40-e868-45a8-9eaf-815236c7c1fc service nova] Acquiring lock "6f70aee5-c3b8-4da8-8903-a305b1275552-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b9d1f15d-d31e-4f9f-a836-d01946c57763 req-71e0ac40-e868-45a8-9eaf-815236c7c1fc service nova] Lock "6f70aee5-c3b8-4da8-8903-a305b1275552-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b9d1f15d-d31e-4f9f-a836-d01946c57763 req-71e0ac40-e868-45a8-9eaf-815236c7c1fc service nova] Lock "6f70aee5-c3b8-4da8-8903-a305b1275552-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:12 user nova-compute[75356]: DEBUG nova.compute.manager [req-b9d1f15d-d31e-4f9f-a836-d01946c57763 req-71e0ac40-e868-45a8-9eaf-815236c7c1fc service nova] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] No waiting events found dispatching network-vif-plugged-ee4221aa-038d-4682-841d-998caa343459 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:36:12 user nova-compute[75356]: WARNING nova.compute.manager [req-b9d1f15d-d31e-4f9f-a836-d01946c57763 req-71e0ac40-e868-45a8-9eaf-815236c7c1fc service nova] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Received unexpected event network-vif-plugged-ee4221aa-038d-4682-841d-998caa343459 for instance with vm_state active and task_state deleting.
Nov 29 20:36:12 user nova-compute[75356]: DEBUG nova.compute.manager [req-b9d1f15d-d31e-4f9f-a836-d01946c57763 req-71e0ac40-e868-45a8-9eaf-815236c7c1fc service nova] [instance: 0b59517a-c467-432a-a73a-d1460c1574e7] Received event network-vif-deleted-56a80963-a1f2-429e-8474-1795928fd05c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:36:12 user nova-compute[75356]: DEBUG nova.compute.manager [req-b9d1f15d-d31e-4f9f-a836-d01946c57763 req-71e0ac40-e868-45a8-9eaf-815236c7c1fc service nova] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Received event network-vif-deleted-ee4221aa-038d-4682-841d-998caa343459 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:36:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:12 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:36:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:12 user nova-compute[75356]: INFO nova.compute.manager [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f70aee5-c3b8-4da8-8903-a305b1275552] Took 0.90 seconds to detach 1 volumes for instance.
Nov 29 20:36:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:12 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:36:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:12 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:36:12 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:36:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:13 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Deleted allocations for instance 6f70aee5-c3b8-4da8-8903-a305b1275552
Nov 29 20:36:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-0ea8e865-3a57-4ad1-ac22-e9ef4abd95ef tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "6f70aee5-c3b8-4da8-8903-a305b1275552" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.666s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:14 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:36:14 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:36:14 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=7824MB free_disk=24.910778045654297GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:36:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:14 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:36:14 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:36:14 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 93183110-d2e2-4da7-ab7d-73378f5e0d42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:36:14 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4713c9eb-4052-4d65-a4eb-23e62352185a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:36:14 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance bf850b0d-88b6-4ec3-b3eb-df6195be2945 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:36:14 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance efda3722-c523-47e1-b942-2ec2aacf6417 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:36:14 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ffb04928-4f5f-4461-aa24-6363d1c9b941 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:36:14 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:36:14 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:36:14 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:36:14 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:36:14 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:36:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.390s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:15 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:36:15 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:36:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "efda3722-c523-47e1-b942-2ec2aacf6417" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "efda3722-c523-47e1-b942-2ec2aacf6417" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "efda3722-c523-47e1-b942-2ec2aacf6417-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "efda3722-c523-47e1-b942-2ec2aacf6417-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "efda3722-c523-47e1-b942-2ec2aacf6417-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:32 user nova-compute[75356]: INFO nova.compute.manager [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Terminating instance
Nov 29 20:36:32 user nova-compute[75356]: DEBUG nova.compute.manager [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:36:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:32 user nova-compute[75356]: DEBUG nova.compute.manager [req-363b1acb-dfc6-485f-acd6-df771d9ea1e2 req-08aca3bc-f32a-4d77-b393-2892143dd94c service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Received event network-vif-unplugged-9876a163-254d-4338-b881-4513f8acffca {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:36:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-363b1acb-dfc6-485f-acd6-df771d9ea1e2 req-08aca3bc-f32a-4d77-b393-2892143dd94c service nova] Acquiring lock "efda3722-c523-47e1-b942-2ec2aacf6417-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-363b1acb-dfc6-485f-acd6-df771d9ea1e2 req-08aca3bc-f32a-4d77-b393-2892143dd94c service nova] Lock "efda3722-c523-47e1-b942-2ec2aacf6417-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-363b1acb-dfc6-485f-acd6-df771d9ea1e2 req-08aca3bc-f32a-4d77-b393-2892143dd94c service nova] Lock "efda3722-c523-47e1-b942-2ec2aacf6417-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:32 user nova-compute[75356]: DEBUG nova.compute.manager [req-363b1acb-dfc6-485f-acd6-df771d9ea1e2 req-08aca3bc-f32a-4d77-b393-2892143dd94c service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] No waiting events found dispatching network-vif-unplugged-9876a163-254d-4338-b881-4513f8acffca {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:36:32 user nova-compute[75356]: DEBUG nova.compute.manager [req-363b1acb-dfc6-485f-acd6-df771d9ea1e2 req-08aca3bc-f32a-4d77-b393-2892143dd94c service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Received event network-vif-unplugged-9876a163-254d-4338-b881-4513f8acffca for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:36:33 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Instance destroyed successfully.
Nov 29 20:36:33 user nova-compute[75356]: DEBUG nova.objects.instance [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lazy-loading 'resources' on Instance uuid efda3722-c523-47e1-b942-2ec2aacf6417 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:36:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1306069447',display_name='tempest-AttachVolumeNegativeTest-server-1306069447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1306069447',id=39,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfCeTRMageu0GSqkjDtfwFE3kWrXvnBjEF9r1BnT9wJIgyWgoUPh/A9I5i/W0TlDfzQJg4pKv5+X7KFGFKnId+0ctsA4vQwJHsF9sRm+rbkQX0g+tRwBZh4iHsqZ7SyEw==',key_name='tempest-keypair-1985273325',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:33:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='076539532d4847719e7fcf4165872bbe',ramdisk_id='',reservation_id='r-iz4jfudi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1182074567',owner_user_name='tempest-AttachVolumeNegativeTest-1182074567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbdba4f436df4dbb896258c4f4d6b180',uuid=efda3722-c523-47e1-b942-2ec2aacf6417,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9876a163-254d-4338-b881-4513f8acffca", "address": "fa:16:3e:10:e7:71", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9876a163-25", "ovs_interfaceid": "9876a163-254d-4338-b881-4513f8acffca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:36:33 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converting VIF {"id": "9876a163-254d-4338-b881-4513f8acffca", "address": "fa:16:3e:10:e7:71", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9876a163-25", "ovs_interfaceid": "9876a163-254d-4338-b881-4513f8acffca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:36:33 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:e7:71,bridge_name='br-int',has_traffic_filtering=True,id=9876a163-254d-4338-b881-4513f8acffca,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9876a163-25') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:36:33 user nova-compute[75356]: DEBUG os_vif [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:e7:71,bridge_name='br-int',has_traffic_filtering=True,id=9876a163-254d-4338-b881-4513f8acffca,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9876a163-25') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:36:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9876a163-25, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:36:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:36:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7395124-6076-46e8-b546-47b19f0b8aa9) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:36:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:33 user nova-compute[75356]: INFO os_vif [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:e7:71,bridge_name='br-int',has_traffic_filtering=True,id=9876a163-254d-4338-b881-4513f8acffca,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9876a163-25')
Nov 29 20:36:33 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Deleting instance files /opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417_del
Nov 29 20:36:33 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Deletion of /opt/stack/data/nova/instances/efda3722-c523-47e1-b942-2ec2aacf6417_del complete
Nov 29 20:36:33 user nova-compute[75356]: INFO nova.compute.manager [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 20:36:33 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:36:33 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:36:33 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:36:34 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:36:34 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Took 0.78 seconds to deallocate network for instance.
Nov 29 20:36:34 user nova-compute[75356]: DEBUG nova.compute.manager [req-80289bb7-752a-4c70-a60c-2648d81d4dd8 req-96fc7ed6-ca0a-4451-8b9f-8fda93c1d562 service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Received event network-vif-deleted-9876a163-254d-4338-b881-4513f8acffca {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:36:34 user nova-compute[75356]: INFO nova.compute.manager [req-80289bb7-752a-4c70-a60c-2648d81d4dd8 req-96fc7ed6-ca0a-4451-8b9f-8fda93c1d562 service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Neutron deleted interface 9876a163-254d-4338-b881-4513f8acffca; detaching it from the instance and deleting it from the info cache
Nov 29 20:36:34 user nova-compute[75356]: DEBUG nova.network.neutron [req-80289bb7-752a-4c70-a60c-2648d81d4dd8 req-96fc7ed6-ca0a-4451-8b9f-8fda93c1d562 service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:36:34 user nova-compute[75356]: DEBUG nova.compute.manager [req-80289bb7-752a-4c70-a60c-2648d81d4dd8 req-96fc7ed6-ca0a-4451-8b9f-8fda93c1d562 service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Detach interface failed, port_id=9876a163-254d-4338-b881-4513f8acffca, reason: Instance efda3722-c523-47e1-b942-2ec2aacf6417 could not be found. {{(pid=75356) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 20:36:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:34 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:36:34 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:36:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:34 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Deleted allocations for instance efda3722-c523-47e1-b942-2ec2aacf6417
Nov 29 20:36:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b6ae3fcb-2a39-4afd-af89-61e06780ba1b tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "efda3722-c523-47e1-b942-2ec2aacf6417" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.195s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:34 user nova-compute[75356]: DEBUG nova.compute.manager [req-c8b40899-ab6f-4f1c-9b5d-573b154630ed req-a32b43db-1a71-495e-b83b-ec71a4342686 service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Received event network-vif-plugged-9876a163-254d-4338-b881-4513f8acffca {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:36:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c8b40899-ab6f-4f1c-9b5d-573b154630ed req-a32b43db-1a71-495e-b83b-ec71a4342686 service nova] Acquiring lock "efda3722-c523-47e1-b942-2ec2aacf6417-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c8b40899-ab6f-4f1c-9b5d-573b154630ed req-a32b43db-1a71-495e-b83b-ec71a4342686 service nova] Lock "efda3722-c523-47e1-b942-2ec2aacf6417-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c8b40899-ab6f-4f1c-9b5d-573b154630ed req-a32b43db-1a71-495e-b83b-ec71a4342686 service nova] Lock "efda3722-c523-47e1-b942-2ec2aacf6417-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:34 user nova-compute[75356]: DEBUG nova.compute.manager [req-c8b40899-ab6f-4f1c-9b5d-573b154630ed req-a32b43db-1a71-495e-b83b-ec71a4342686 service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] No waiting events found dispatching network-vif-plugged-9876a163-254d-4338-b881-4513f8acffca {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:36:34 user nova-compute[75356]: WARNING nova.compute.manager [req-c8b40899-ab6f-4f1c-9b5d-573b154630ed req-a32b43db-1a71-495e-b83b-ec71a4342686 service nova] [instance: efda3722-c523-47e1-b942-2ec2aacf6417] Received unexpected event network-vif-plugged-9876a163-254d-4338-b881-4513f8acffca for instance with vm_state deleted and task_state None.
Nov 29 20:36:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:51 user nova-compute[75356]: INFO nova.compute.manager [None req-2e738505-4639-498f-9a3d-314da08bbb1c tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Unrescuing
Nov 29 20:36:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2e738505-4639-498f-9a3d-314da08bbb1c tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "refresh_cache-bf850b0d-88b6-4ec3-b3eb-df6195be2945" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:36:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2e738505-4639-498f-9a3d-314da08bbb1c tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquired lock "refresh_cache-bf850b0d-88b6-4ec3-b3eb-df6195be2945" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:36:51 user nova-compute[75356]: DEBUG nova.network.neutron [None req-2e738505-4639-498f-9a3d-314da08bbb1c tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:36:52 user nova-compute[75356]: DEBUG nova.network.neutron [None req-2e738505-4639-498f-9a3d-314da08bbb1c tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Updating instance_info_cache with network_info: [{"id": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "address": "fa:16:3e:57:b8:2a", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68da58a-ba", "ovs_interfaceid": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:36:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2e738505-4639-498f-9a3d-314da08bbb1c tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Releasing lock "refresh_cache-bf850b0d-88b6-4ec3-b3eb-df6195be2945" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:36:52 user nova-compute[75356]: DEBUG nova.objects.instance [None req-2e738505-4639-498f-9a3d-314da08bbb1c tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'flavor' on Instance uuid bf850b0d-88b6-4ec3-b3eb-df6195be2945 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:36:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:52 user nova-compute[75356]: DEBUG nova.compute.manager [req-9bf75268-2340-4471-a710-52ba11e31ca2 req-7a418110-ac17-4dfe-9c42-dee9b8f8de2f service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received event network-vif-unplugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:36:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9bf75268-2340-4471-a710-52ba11e31ca2 req-7a418110-ac17-4dfe-9c42-dee9b8f8de2f service nova] Acquiring lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9bf75268-2340-4471-a710-52ba11e31ca2 req-7a418110-ac17-4dfe-9c42-dee9b8f8de2f service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9bf75268-2340-4471-a710-52ba11e31ca2 req-7a418110-ac17-4dfe-9c42-dee9b8f8de2f service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:52 user nova-compute[75356]: DEBUG nova.compute.manager [req-9bf75268-2340-4471-a710-52ba11e31ca2 req-7a418110-ac17-4dfe-9c42-dee9b8f8de2f service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] No waiting events found dispatching network-vif-unplugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:36:52 user nova-compute[75356]: WARNING nova.compute.manager [req-9bf75268-2340-4471-a710-52ba11e31ca2 req-7a418110-ac17-4dfe-9c42-dee9b8f8de2f service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received unexpected event network-vif-unplugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 for instance with vm_state rescued and task_state unrescuing.
Nov 29 20:36:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:53 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Instance destroyed successfully.
Nov 29 20:36:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "ffb04928-4f5f-4461-aa24-6363d1c9b941" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG nova.objects.instance [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lazy-loading 'flavor' on Instance uuid ffb04928-4f5f-4461-aa24-6363d1c9b941 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "ffb04928-4f5f-4461-aa24-6363d1c9b941" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:53 user nova-compute[75356]: INFO nova.compute.manager [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Attaching volume 19e9ddab-dc95-48c5-bba1-32b2081a3479 to /dev/vdb
Nov 29 20:36:53 user nova-compute[75356]: DEBUG os_brick.utils [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f36904-c20a-4822-952b-3700faeac839]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec114672-0f28-4619-a440-41c0c2dc9281]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[63442d9b-2c19-444e-8862-16100068b96a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01ac0be-fe02-4c13-a9a2-9a100f8a88a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:36:53 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:36:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26a47a2-ad2e-49bf-ae69-ac2a33da5266]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG os_brick.utils [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:36:53 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Updating existing volume attachment record: 4762628f-df94-42f5-9122-966c7590fae6 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:36:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:54 user nova-compute[75356]: DEBUG nova.compute.manager [req-7704937d-7ab2-476f-9f77-3e6056ea1c79 req-0e29e982-40cc-458a-89bf-14c779279bbe service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received event network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:36:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7704937d-7ab2-476f-9f77-3e6056ea1c79 req-0e29e982-40cc-458a-89bf-14c779279bbe service nova] Acquiring lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7704937d-7ab2-476f-9f77-3e6056ea1c79 req-0e29e982-40cc-458a-89bf-14c779279bbe service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7704937d-7ab2-476f-9f77-3e6056ea1c79 req-0e29e982-40cc-458a-89bf-14c779279bbe service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:54 user nova-compute[75356]: DEBUG nova.compute.manager [req-7704937d-7ab2-476f-9f77-3e6056ea1c79 req-0e29e982-40cc-458a-89bf-14c779279bbe service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] No waiting events found dispatching network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:36:54 user nova-compute[75356]: WARNING nova.compute.manager [req-7704937d-7ab2-476f-9f77-3e6056ea1c79 req-0e29e982-40cc-458a-89bf-14c779279bbe service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received unexpected event network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 for instance with vm_state rescued and task_state unrescuing.
Nov 29 20:36:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:56 user nova-compute[75356]: DEBUG nova.compute.manager [req-53ee49b2-099b-4c0d-a184-aa2f4d0f95ce req-789bf8bd-d1c5-4ecf-afd4-a320a51969ed service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received event network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:36:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-53ee49b2-099b-4c0d-a184-aa2f4d0f95ce req-789bf8bd-d1c5-4ecf-afd4-a320a51969ed service nova] Acquiring lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-53ee49b2-099b-4c0d-a184-aa2f4d0f95ce req-789bf8bd-d1c5-4ecf-afd4-a320a51969ed service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-53ee49b2-099b-4c0d-a184-aa2f4d0f95ce req-789bf8bd-d1c5-4ecf-afd4-a320a51969ed service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:56 user nova-compute[75356]: DEBUG nova.compute.manager [req-53ee49b2-099b-4c0d-a184-aa2f4d0f95ce req-789bf8bd-d1c5-4ecf-afd4-a320a51969ed service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] No waiting events found dispatching network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:36:56 user nova-compute[75356]: WARNING nova.compute.manager [req-53ee49b2-099b-4c0d-a184-aa2f4d0f95ce req-789bf8bd-d1c5-4ecf-afd4-a320a51969ed service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received unexpected event network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 for instance with vm_state rescued and task_state unrescuing.
Nov 29 20:36:56 user nova-compute[75356]: DEBUG nova.compute.manager [req-53ee49b2-099b-4c0d-a184-aa2f4d0f95ce req-789bf8bd-d1c5-4ecf-afd4-a320a51969ed service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received event network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:36:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-53ee49b2-099b-4c0d-a184-aa2f4d0f95ce req-789bf8bd-d1c5-4ecf-afd4-a320a51969ed service nova] Acquiring lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:36:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-53ee49b2-099b-4c0d-a184-aa2f4d0f95ce req-789bf8bd-d1c5-4ecf-afd4-a320a51969ed service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:36:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-53ee49b2-099b-4c0d-a184-aa2f4d0f95ce req-789bf8bd-d1c5-4ecf-afd4-a320a51969ed service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:36:56 user nova-compute[75356]: DEBUG nova.compute.manager [req-53ee49b2-099b-4c0d-a184-aa2f4d0f95ce req-789bf8bd-d1c5-4ecf-afd4-a320a51969ed service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] No waiting events found dispatching network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:36:56 user nova-compute[75356]: WARNING nova.compute.manager [req-53ee49b2-099b-4c0d-a184-aa2f4d0f95ce req-789bf8bd-d1c5-4ecf-afd4-a320a51969ed service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received unexpected event network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 for instance with vm_state rescued and task_state unrescuing.
Nov 29 20:36:56 user nova-compute[75356]: DEBUG nova.compute.manager [None req-2e738505-4639-498f-9a3d-314da08bbb1c tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:36:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:36:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:00 user nova-compute[75356]: INFO nova.compute.manager [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Terminating instance
Nov 29 20:37:00 user nova-compute[75356]: DEBUG nova.compute.manager [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:37:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:00 user nova-compute[75356]: DEBUG nova.compute.manager [req-f9bae416-50f0-4e29-8be7-219c255d5fd1 req-78772655-ec93-45c9-9a6d-97c71de0b151 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Received event network-vif-unplugged-b010c396-b323-4964-90bc-ea781b8ee123 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:37:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f9bae416-50f0-4e29-8be7-219c255d5fd1 req-78772655-ec93-45c9-9a6d-97c71de0b151 service nova] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f9bae416-50f0-4e29-8be7-219c255d5fd1 req-78772655-ec93-45c9-9a6d-97c71de0b151 service nova] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f9bae416-50f0-4e29-8be7-219c255d5fd1 req-78772655-ec93-45c9-9a6d-97c71de0b151 service nova] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:00 user nova-compute[75356]: DEBUG nova.compute.manager [req-f9bae416-50f0-4e29-8be7-219c255d5fd1 req-78772655-ec93-45c9-9a6d-97c71de0b151 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] No waiting events found dispatching network-vif-unplugged-b010c396-b323-4964-90bc-ea781b8ee123 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:37:00 user nova-compute[75356]: DEBUG nova.compute.manager [req-f9bae416-50f0-4e29-8be7-219c255d5fd1 req-78772655-ec93-45c9-9a6d-97c71de0b151 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Received event network-vif-unplugged-b010c396-b323-4964-90bc-ea781b8ee123 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:37:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:01 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Instance destroyed successfully.
Nov 29 20:37:01 user nova-compute[75356]: DEBUG nova.objects.instance [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lazy-loading 'resources' on Instance uuid 4713c9eb-4052-4d65-a4eb-23e62352185a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:37:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:29:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-275547216',display_name='tempest-SnapshotDataIntegrityTests-server-275547216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-275547216',id=36,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZmSXNdaSBdbWl7teE6orY7DlBV5NyCG6WZs/s0mDK8k7nBbm1klkHu9ThbRF7CT4cqCK91DHv7gRq572ICk0tC48XTLf1RZ0Nt215hxt6da/zAq++fw4qpDNntBUl11g==',key_name='tempest-keypair-787639657',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:30:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7627fb78ee514bd0b0d7b5f2a1a807b4',ramdisk_id='',reservation_id='r-7a1fmk9f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2005195566',owner_user_name='tempest-SnapshotDataIntegrityTests-2005195566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:30:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94cd8cc032d5411994573f5b0c3f6d10',uuid=4713c9eb-4052-4d65-a4eb-23e62352185a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b010c396-b323-4964-90bc-ea781b8ee123", "address": "fa:16:3e:6d:3e:e2", "network": {"id": "17ebb4e8-43d7-4475-90cf-f8883b3ffe1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-50669801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7627fb78ee514bd0b0d7b5f2a1a807b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb010c396-b3", "ovs_interfaceid": "b010c396-b323-4964-90bc-ea781b8ee123", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:37:01 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Converting VIF {"id": "b010c396-b323-4964-90bc-ea781b8ee123", "address": "fa:16:3e:6d:3e:e2", "network": {"id": "17ebb4e8-43d7-4475-90cf-f8883b3ffe1a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-50669801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7627fb78ee514bd0b0d7b5f2a1a807b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb010c396-b3", "ovs_interfaceid": "b010c396-b323-4964-90bc-ea781b8ee123", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:37:01 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:3e:e2,bridge_name='br-int',has_traffic_filtering=True,id=b010c396-b323-4964-90bc-ea781b8ee123,network=Network(17ebb4e8-43d7-4475-90cf-f8883b3ffe1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb010c396-b3') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:37:01 user nova-compute[75356]: DEBUG os_vif [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:3e:e2,bridge_name='br-int',has_traffic_filtering=True,id=b010c396-b323-4964-90bc-ea781b8ee123,network=Network(17ebb4e8-43d7-4475-90cf-f8883b3ffe1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb010c396-b3') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:37:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb010c396-b3, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:37:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:37:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad3d96c0-32e9-4cfc-8214-26d9400cee49) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:37:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:37:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:01 user nova-compute[75356]: INFO os_vif [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:3e:e2,bridge_name='br-int',has_traffic_filtering=True,id=b010c396-b323-4964-90bc-ea781b8ee123,network=Network(17ebb4e8-43d7-4475-90cf-f8883b3ffe1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb010c396-b3')
Nov 29 20:37:01 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Deleting instance files /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a_del
Nov 29 20:37:01 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Deletion of /opt/stack/data/nova/instances/4713c9eb-4052-4d65-a4eb-23e62352185a_del complete
Nov 29 20:37:01 user nova-compute[75356]: INFO nova.compute.manager [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 29 20:37:01 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:37:01 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:37:01 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:37:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "27b79c6f-c024-4bca-b292-292b11d79329" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "27b79c6f-c024-4bca-b292-292b11d79329" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG nova.compute.manager [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:37:02 user nova-compute[75356]: INFO nova.compute.claims [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Claim successful on node user
Nov 29 20:37:02 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GSxqMBlI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:37:02 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:37:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:37:02 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:37:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:37:02 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa87662-3f8d-4884-85da-2da9e9b800d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:37:02 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a674e8ec-d6a3-4222-b301-94b2779804e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479] added
Nov 29 20:37:02 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7737f80-4bab-42b4-9faf-4ce7337f8c55]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.090s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1c4488-83c9-4947-b0f7-19623a9f73c4]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GSxqMBlI {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GSxqMBlI" returned: 0 in 0.037s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7ae631-0da8-4854-80d8-669c73e8b81f]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GSxqMBlI'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Received event network-vif-plugged-b010c396-b323-4964-90bc-ea781b8ee123 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] No waiting events found dispatching network-vif-plugged-b010c396-b323-4964-90bc-ea781b8ee123 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:37:02 user nova-compute[75356]: WARNING nova.compute.manager [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Received unexpected event network-vif-plugged-b010c396-b323-4964-90bc-ea781b8ee123 for instance with vm_state active and task_state deleting.
Nov 29 20:37:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Received event network-vif-plugged-b010c396-b323-4964-90bc-ea781b8ee123 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] No waiting events found dispatching network-vif-plugged-b010c396-b323-4964-90bc-ea781b8ee123 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:37:02 user nova-compute[75356]: WARNING nova.compute.manager [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Received unexpected event network-vif-plugged-b010c396-b323-4964-90bc-ea781b8ee123 for instance with vm_state active and task_state deleting.
Nov 29 20:37:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Received event network-vif-plugged-b010c396-b323-4964-90bc-ea781b8ee123 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] No waiting events found dispatching network-vif-plugged-b010c396-b323-4964-90bc-ea781b8ee123 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:37:02 user nova-compute[75356]: WARNING nova.compute.manager [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Received unexpected event network-vif-plugged-b010c396-b323-4964-90bc-ea781b8ee123 for instance with vm_state active and task_state deleting.
Nov 29 20:37:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Received event network-vif-unplugged-b010c396-b323-4964-90bc-ea781b8ee123 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] No waiting events found dispatching network-vif-unplugged-b010c396-b323-4964-90bc-ea781b8ee123 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Received event network-vif-unplugged-b010c396-b323-4964-90bc-ea781b8ee123 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Received event network-vif-plugged-b010c396-b323-4964-90bc-ea781b8ee123 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] Acquiring lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:02 user nova-compute[75356]: DEBUG nova.compute.manager [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] No waiting events found dispatching network-vif-plugged-b010c396-b323-4964-90bc-ea781b8ee123 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:37:02 user nova-compute[75356]: WARNING nova.compute.manager [req-d7450f33-fad8-4b0d-843c-acfee44d69ba req-a0ab0187-d740-4dd1-904f-6777bf7515a2 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Received unexpected event network-vif-plugged-b010c396-b323-4964-90bc-ea781b8ee123 for instance with vm_state active and task_state deleting.
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79ae1e3-46e7-4e1d-b136-5a7fd11a1d38]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fc828a-ea7f-49d3-9319-9d0b50847723]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:37:03 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:37:03 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:37:03 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:37:03 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbacb9d-04fb-415c-a96f-b64ce90355da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479, portal: 172.16.0.220,3260]
Nov 29 20:37:03 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479, portal: 172.16.0.220,3260] successful.
Nov 29 20:37:03 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69a8c10-dc08-4f2e-ba9c-c35566d8e597]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae71b36-222f-4ca6-8d76-a3821c118c6e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:37:03 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:37:03 user nova-compute[75356]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 (non-flash)
Nov 29 20:37:03 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:37:03 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:37:03 user nova-compute[75356]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 (non-flash)
Nov 29 20:37:03 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.436s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f585319c-02ec-4a40-b0c1-954ce8391a91]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG nova.compute.manager [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG nova.compute.manager [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG nova.network.neutron [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:37:03 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:37:03 user nova-compute[75356]: DEBUG nova.compute.manager [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:37:03 user nova-compute[75356]: INFO nova.virt.block_device [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Booting with volume 1832be70-b887-4daf-85a9-3769ecc4059c at /dev/vda
Nov 29 20:37:03 user nova-compute[75356]: DEBUG os_brick.utils [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG nova.policy [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '081b00360a204be3bd6435807283f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6791b0c999846e2a22d5735f91ea1aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[711b2086-8b8a-4036-bf56-cf728a21a593]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aa127d-faa2-4c34-94aa-f29491f1d223]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9ad6cf-d580-442d-bd77-9a7633266cd3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0423ae22-22b4-4497-91a8-95a51408012c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:37:03 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:37:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f6d7e8-5df1-4785-b2db-31ffcfcd247a]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG os_brick.utils [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:37:03 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Updating existing volume attachment record: 3e32d658-b1a2-44b4-81b7-a63bcd2ead69 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:37:04 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:37:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GSxqMBlI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:37:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.470s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:37:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] <== connect_volume: return (1472ms) {'type': 'block', 'scsi_wwn': '23935386635623336', 'path': '/dev/sdc'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:37:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935386635623336', 'path': '/dev/sdc'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:37:04 user nova-compute[75356]: DEBUG nova.objects.instance [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lazy-loading 'flavor' on Instance uuid ffb04928-4f5f-4461-aa24-6363d1c9b941 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:37:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:37:04 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:37:04 user nova-compute[75356]:   <source dev="/dev/sdc"/>
Nov 29 20:37:04 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:37:04 user nova-compute[75356]:   <serial>19e9ddab-dc95-48c5-bba1-32b2081a3479</serial>
Nov 29 20:37:04 user nova-compute[75356]: </disk>
Nov 29 20:37:04 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:37:04 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:37:04 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Took 3.11 seconds to deallocate network for instance.
Nov 29 20:37:04 user nova-compute[75356]: DEBUG nova.compute.manager [req-354361f0-181e-4666-be81-d34648105d48 req-91f423d3-62ff-4f44-b0d4-c7a6d620c220 service nova] [instance: 4713c9eb-4052-4d65-a4eb-23e62352185a] Received event network-vif-deleted-b010c396-b323-4964-90bc-ea781b8ee123 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:37:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:04 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:37:04 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:37:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:37:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:37:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] No VIF found with MAC fa:16:3e:83:e1:42, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:37:04 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:04 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Deleted allocations for instance 4713c9eb-4052-4d65-a4eb-23e62352185a
Nov 29 20:37:04 user nova-compute[75356]: DEBUG nova.network.neutron [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Successfully created port: 69354359-db68-4021-a266-e8486ad17fc1 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:37:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2a4efe56-f271-4d87-bff8-fe9ee229ec31 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.269s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a9225a31-d4b1-4291-8b13-365ce1a76f24 tempest-SnapshotDataIntegrityTests-2005195566 tempest-SnapshotDataIntegrityTests-2005195566-project-member] Lock "4713c9eb-4052-4d65-a4eb-23e62352185a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.799s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:05 user nova-compute[75356]: DEBUG nova.network.neutron [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Successfully updated port: 69354359-db68-4021-a266-e8486ad17fc1 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:37:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "refresh_cache-27b79c6f-c024-4bca-b292-292b11d79329" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:37:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquired lock "refresh_cache-27b79c6f-c024-4bca-b292-292b11d79329" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:37:05 user nova-compute[75356]: DEBUG nova.network.neutron [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:37:05 user nova-compute[75356]: DEBUG nova.network.neutron [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:37:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:06 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:37:06 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:37:06 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Didn't find any instances for network info cache update. {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 20:37:06 user nova-compute[75356]: DEBUG nova.network.neutron [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Updating instance_info_cache with network_info: [{"id": "69354359-db68-4021-a266-e8486ad17fc1", "address": "fa:16:3e:1c:9a:a8", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69354359-db", "ovs_interfaceid": "69354359-db68-4021-a266-e8486ad17fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:37:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Releasing lock "refresh_cache-27b79c6f-c024-4bca-b292-292b11d79329" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:37:06 user nova-compute[75356]: DEBUG nova.compute.manager [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Instance network_info: |[{"id": "69354359-db68-4021-a266-e8486ad17fc1", "address": "fa:16:3e:1c:9a:a8", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69354359-db", "ovs_interfaceid": "69354359-db68-4021-a266-e8486ad17fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:37:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-fc7b1ba2-6f30-499b-8f65-af5ccded0633 req-6809fe05-32c1-4fe5-9108-f22d7b58acbf service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Received event network-changed-69354359-db68-4021-a266-e8486ad17fc1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:37:06 user nova-compute[75356]: DEBUG nova.compute.manager [req-fc7b1ba2-6f30-499b-8f65-af5ccded0633 req-6809fe05-32c1-4fe5-9108-f22d7b58acbf service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Refreshing instance network info cache due to event network-changed-69354359-db68-4021-a266-e8486ad17fc1. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:37:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-fc7b1ba2-6f30-499b-8f65-af5ccded0633 req-6809fe05-32c1-4fe5-9108-f22d7b58acbf service nova] Acquiring lock "refresh_cache-27b79c6f-c024-4bca-b292-292b11d79329" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:37:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-fc7b1ba2-6f30-499b-8f65-af5ccded0633 req-6809fe05-32c1-4fe5-9108-f22d7b58acbf service nova] Acquired lock "refresh_cache-27b79c6f-c024-4bca-b292-292b11d79329" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:37:06 user nova-compute[75356]: DEBUG nova.network.neutron [req-fc7b1ba2-6f30-499b-8f65-af5ccded0633 req-6809fe05-32c1-4fe5-9108-f22d7b58acbf service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Refreshing network info cache for port 69354359-db68-4021-a266-e8486ad17fc1 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:37:07 user nova-compute[75356]: DEBUG nova.network.neutron [req-fc7b1ba2-6f30-499b-8f65-af5ccded0633 req-6809fe05-32c1-4fe5-9108-f22d7b58acbf service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Updated VIF entry in instance network info cache for port 69354359-db68-4021-a266-e8486ad17fc1. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:37:07 user nova-compute[75356]: DEBUG nova.network.neutron [req-fc7b1ba2-6f30-499b-8f65-af5ccded0633 req-6809fe05-32c1-4fe5-9108-f22d7b58acbf service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Updating instance_info_cache with network_info: [{"id": "69354359-db68-4021-a266-e8486ad17fc1", "address": "fa:16:3e:1c:9a:a8", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69354359-db", "ovs_interfaceid": "69354359-db68-4021-a266-e8486ad17fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:37:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-fc7b1ba2-6f30-499b-8f65-af5ccded0633 req-6809fe05-32c1-4fe5-9108-f22d7b58acbf service nova] Releasing lock "refresh_cache-27b79c6f-c024-4bca-b292-292b11d79329" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:37:07 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:37:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-948bb3d1-932d-4611-b1bc-68279adc8845 req-28172ba4-2eeb-4588-9832-453cbb9e91ed service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Received event network-changed-65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:37:08 user nova-compute[75356]: DEBUG nova.compute.manager [req-948bb3d1-932d-4611-b1bc-68279adc8845 req-28172ba4-2eeb-4588-9832-453cbb9e91ed service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Refreshing instance network info cache due to event network-changed-65c10bc1-9ed3-4330-82bf-bb977579b739. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:37:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-948bb3d1-932d-4611-b1bc-68279adc8845 req-28172ba4-2eeb-4588-9832-453cbb9e91ed service nova] Acquiring lock "refresh_cache-ffb04928-4f5f-4461-aa24-6363d1c9b941" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:37:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-948bb3d1-932d-4611-b1bc-68279adc8845 req-28172ba4-2eeb-4588-9832-453cbb9e91ed service nova] Acquired lock "refresh_cache-ffb04928-4f5f-4461-aa24-6363d1c9b941" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:37:08 user nova-compute[75356]: DEBUG nova.network.neutron [req-948bb3d1-932d-4611-b1bc-68279adc8845 req-28172ba4-2eeb-4588-9832-453cbb9e91ed service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Refreshing network info cache for port 65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:37:09 user nova-compute[75356]: DEBUG nova.network.neutron [req-948bb3d1-932d-4611-b1bc-68279adc8845 req-28172ba4-2eeb-4588-9832-453cbb9e91ed service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Updated VIF entry in instance network info cache for port 65c10bc1-9ed3-4330-82bf-bb977579b739. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:37:09 user nova-compute[75356]: DEBUG nova.network.neutron [req-948bb3d1-932d-4611-b1bc-68279adc8845 req-28172ba4-2eeb-4588-9832-453cbb9e91ed service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Updating instance_info_cache with network_info: [{"id": "65c10bc1-9ed3-4330-82bf-bb977579b739", "address": "fa:16:3e:83:e1:42", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c10bc1-9e", "ovs_interfaceid": "65c10bc1-9ed3-4330-82bf-bb977579b739", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:37:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-948bb3d1-932d-4611-b1bc-68279adc8845 req-28172ba4-2eeb-4588-9832-453cbb9e91ed service nova] Releasing lock "refresh_cache-ffb04928-4f5f-4461-aa24-6363d1c9b941" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:37:10 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:37:10 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:37:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:10 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:37:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:37:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:11 user nova-compute[75356]: DEBUG nova.compute.manager [req-b9090966-f1c3-4ec0-a185-36302bcee228 req-64cc8e4f-743f-4b84-981e-e7d8e989b458 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Received event network-changed-65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:37:11 user nova-compute[75356]: DEBUG nova.compute.manager [req-b9090966-f1c3-4ec0-a185-36302bcee228 req-64cc8e4f-743f-4b84-981e-e7d8e989b458 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Refreshing instance network info cache due to event network-changed-65c10bc1-9ed3-4330-82bf-bb977579b739. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:37:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b9090966-f1c3-4ec0-a185-36302bcee228 req-64cc8e4f-743f-4b84-981e-e7d8e989b458 service nova] Acquiring lock "refresh_cache-ffb04928-4f5f-4461-aa24-6363d1c9b941" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:37:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b9090966-f1c3-4ec0-a185-36302bcee228 req-64cc8e4f-743f-4b84-981e-e7d8e989b458 service nova] Acquired lock "refresh_cache-ffb04928-4f5f-4461-aa24-6363d1c9b941" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:37:11 user nova-compute[75356]: DEBUG nova.network.neutron [req-b9090966-f1c3-4ec0-a185-36302bcee228 req-64cc8e4f-743f-4b84-981e-e7d8e989b458 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Refreshing network info cache for port 65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:37:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:12 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:37:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:12 user nova-compute[75356]: DEBUG nova.network.neutron [req-b9090966-f1c3-4ec0-a185-36302bcee228 req-64cc8e4f-743f-4b84-981e-e7d8e989b458 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Updated VIF entry in instance network info cache for port 65c10bc1-9ed3-4330-82bf-bb977579b739. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:37:12 user nova-compute[75356]: DEBUG nova.network.neutron [req-b9090966-f1c3-4ec0-a185-36302bcee228 req-64cc8e4f-743f-4b84-981e-e7d8e989b458 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Updating instance_info_cache with network_info: [{"id": "65c10bc1-9ed3-4330-82bf-bb977579b739", "address": "fa:16:3e:83:e1:42", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c10bc1-9e", "ovs_interfaceid": "65c10bc1-9ed3-4330-82bf-bb977579b739", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:37:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b9090966-f1c3-4ec0-a185-36302bcee228 req-64cc8e4f-743f-4b84-981e-e7d8e989b458 service nova] Releasing lock "refresh_cache-ffb04928-4f5f-4461-aa24-6363d1c9b941" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:37:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f718ed15-a560-4435-9b27-8e0169331cbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "ffb04928-4f5f-4461-aa24-6363d1c9b941" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f718ed15-a560-4435-9b27-8e0169331cbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:12 user nova-compute[75356]: INFO nova.compute.manager [None req-f718ed15-a560-4435-9b27-8e0169331cbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Rebooting instance
Nov 29 20:37:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f718ed15-a560-4435-9b27-8e0169331cbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "refresh_cache-ffb04928-4f5f-4461-aa24-6363d1c9b941" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:37:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f718ed15-a560-4435-9b27-8e0169331cbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquired lock "refresh_cache-ffb04928-4f5f-4461-aa24-6363d1c9b941" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:37:12 user nova-compute[75356]: DEBUG nova.network.neutron [None req-f718ed15-a560-4435-9b27-8e0169331cbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:37:13 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:37:13 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=8210MB free_disk=24.952590942382812GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 93183110-d2e2-4da7-ab7d-73378f5e0d42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance bf850b0d-88b6-4ec3-b3eb-df6195be2945 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ffb04928-4f5f-4461-aa24-6363d1c9b941 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 27b79c6f-c024-4bca-b292-292b11d79329 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.compute.manager [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:37:13 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Creating image(s)
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Did not create local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Ensure instance console log exists: /opt/stack/data/nova/instances/27b79c6f-c024-4bca-b292-292b11d79329/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Start _get_guest_xml network_info=[{"id": "69354359-db68-4021-a266-e8486ad17fc1", "address": "fa:16:3e:1c:9a:a8", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69354359-db", "ovs_interfaceid": "69354359-db68-4021-a266-e8486ad17fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVgCudKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '27b79c6f-c024-4bca-b292-292b11d79329', 'attached_at': '', 'detached_at': '', 'volume_id': '1832be70-b887-4daf-85a9-3769ecc4059c', 'serial': '1832be70-b887-4daf-85a9-3769ecc4059c'}, 'attachment_id': '3e32d658-b1a2-44b4-81b7-a63bcd2ead69', 'volume_type': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:37:13 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:37:13 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVgCudKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:37:13 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:37:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:37:13 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:37:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:37:13 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:37:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6b0085-6020-4c99-845b-6a193535bb39]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:37:13 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece7f470-489f-423c-a31b-520e64edce47]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c] added
Nov 29 20:37:13 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:37:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00e1be2-8465-4d26-9fd4-2d508281c7e7]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[060bda7d-321d-4d5d-a54c-6e9723885fb4]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sVgCudKk {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sVgCudKk" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5282b549-7a2f-4bee-9486-615c53e876e5]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sVgCudKk'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a360a00a-d9e6-41aa-90a3-13839b0f14e5]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9dacfa-f764-40a2-8cbf-9627d2da9209]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:37:14 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:37:14 user nova-compute[75356]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 (non-flash)
Nov 29 20:37:14 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:37:14 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:37:14 user nova-compute[75356]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 (non-flash)
Nov 29 20:37:14 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG nova.network.neutron [None req-f718ed15-a560-4435-9b27-8e0169331cbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Updating instance_info_cache with network_info: [{"id": "65c10bc1-9ed3-4330-82bf-bb977579b739", "address": "fa:16:3e:83:e1:42", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c10bc1-9e", "ovs_interfaceid": "65c10bc1-9ed3-4330-82bf-bb977579b739", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f718ed15-a560-4435-9b27-8e0169331cbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Releasing lock "refresh_cache-ffb04928-4f5f-4461-aa24-6363d1c9b941" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-f718ed15-a560-4435-9b27-8e0169331cbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e3120f-4264-420e-a629-2e334ee8fb5e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c, portal: 172.16.0.220,3260]
Nov 29 20:37:14 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c, portal: 172.16.0.220,3260] successful.
Nov 29 20:37:14 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[13390c78-342d-41c7-803d-c0262b76a012]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c4879b-2bf4-403c-afeb-0e005477b551]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:37:14 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:37:14 user nova-compute[75356]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 (non-flash)
Nov 29 20:37:14 user nova-compute[75356]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:37:14 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:37:14 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:37:14 user nova-compute[75356]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 (non-flash)
Nov 29 20:37:14 user nova-compute[75356]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:37:14 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd8e97e-049d-4052-8904-d49eecd172d2]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:37:14 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: None {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVgCudKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26131633634666164', 'path': '/dev/sdd'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131633634666164', 'path': '/dev/sdd'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1269229211',display_name='tempest-TestVolumeBootPattern-server-1269229211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1269229211',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0zsffzZhgXAi/NOnOb6jr5SbjRUa5Ws+6E3ecNSbb6yR1bA/I1Lldbh3v8Eu9yysHBBgvc3puTY35+MIoawU5+qPudnUjWfeo2D4YgfUZH7hVHtowFiKG6iSLDsjXIsA==',key_name='tempest-TestVolumeBootPattern-313405727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6791b0c999846e2a22d5735f91ea1aa',ramdisk_id='',reservation_id='r-2dm1ho3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1627976633',owner_user_name='tempest-TestVolumeBootPattern-1627976633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:37:03Z,user_data=None,user_id='081b00360a204be3bd6435807283f230',uuid=27b79c6f-c024-4bca-b292-292b11d79329,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69354359-db68-4021-a266-e8486ad17fc1", "address": "fa:16:3e:1c:9a:a8", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69354359-db", "ovs_interfaceid": "69354359-db68-4021-a266-e8486ad17fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converting VIF {"id": "69354359-db68-4021-a266-e8486ad17fc1", "address": "fa:16:3e:1c:9a:a8", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69354359-db", "ovs_interfaceid": "69354359-db68-4021-a266-e8486ad17fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:9a:a8,bridge_name='br-int',has_traffic_filtering=True,id=69354359-db68-4021-a266-e8486ad17fc1,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69354359-db') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG nova.objects.instance [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lazy-loading 'pci_devices' on Instance uuid 27b79c6f-c024-4bca-b292-292b11d79329 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:37:15 user nova-compute[75356]:   <uuid>27b79c6f-c024-4bca-b292-292b11d79329</uuid>
Nov 29 20:37:15 user nova-compute[75356]:   <name>instance-0000002a</name>
Nov 29 20:37:15 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:37:15 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:37:15 user nova-compute[75356]:   <metadata>
Nov 29 20:37:15 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:37:15 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:37:15 user nova-compute[75356]:       <nova:name>tempest-TestVolumeBootPattern-server-1269229211</nova:name>
Nov 29 20:37:15 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:37:13</nova:creationTime>
Nov 29 20:37:15 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:37:15 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:37:15 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:37:15 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:37:15 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:37:15 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:37:15 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:37:15 user nova-compute[75356]:       <nova:owner>
Nov 29 20:37:15 user nova-compute[75356]:         <nova:user uuid="081b00360a204be3bd6435807283f230">tempest-TestVolumeBootPattern-1627976633-project-member</nova:user>
Nov 29 20:37:15 user nova-compute[75356]:         <nova:project uuid="f6791b0c999846e2a22d5735f91ea1aa">tempest-TestVolumeBootPattern-1627976633</nova:project>
Nov 29 20:37:15 user nova-compute[75356]:       </nova:owner>
Nov 29 20:37:15 user nova-compute[75356]:       <nova:ports>
Nov 29 20:37:15 user nova-compute[75356]:         <nova:port uuid="69354359-db68-4021-a266-e8486ad17fc1">
Nov 29 20:37:15 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 20:37:15 user nova-compute[75356]:         </nova:port>
Nov 29 20:37:15 user nova-compute[75356]:       </nova:ports>
Nov 29 20:37:15 user nova-compute[75356]:     </nova:instance>
Nov 29 20:37:15 user nova-compute[75356]:   </metadata>
Nov 29 20:37:15 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:37:15 user nova-compute[75356]:     <system>
Nov 29 20:37:15 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:37:15 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:37:15 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:37:15 user nova-compute[75356]:       <entry name="serial">27b79c6f-c024-4bca-b292-292b11d79329</entry>
Nov 29 20:37:15 user nova-compute[75356]:       <entry name="uuid">27b79c6f-c024-4bca-b292-292b11d79329</entry>
Nov 29 20:37:15 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:37:15 user nova-compute[75356]:     </system>
Nov 29 20:37:15 user nova-compute[75356]:   </sysinfo>
Nov 29 20:37:15 user nova-compute[75356]:   <os>
Nov 29 20:37:15 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:37:15 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:37:15 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:37:15 user nova-compute[75356]:   </os>
Nov 29 20:37:15 user nova-compute[75356]:   <features>
Nov 29 20:37:15 user nova-compute[75356]:     <acpi/>
Nov 29 20:37:15 user nova-compute[75356]:     <apic/>
Nov 29 20:37:15 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:37:15 user nova-compute[75356]:   </features>
Nov 29 20:37:15 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:37:15 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:37:15 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:37:15 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:37:15 user nova-compute[75356]:   </clock>
Nov 29 20:37:15 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:37:15 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:37:15 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:37:15 user nova-compute[75356]:   </cpu>
Nov 29 20:37:15 user nova-compute[75356]:   <devices>
Nov 29 20:37:15 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:37:15 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:37:15 user nova-compute[75356]:       <source dev="/dev/sdd"/>
Nov 29 20:37:15 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:37:15 user nova-compute[75356]:       <serial>1832be70-b887-4daf-85a9-3769ecc4059c</serial>
Nov 29 20:37:15 user nova-compute[75356]:     </disk>
Nov 29 20:37:15 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:37:15 user nova-compute[75356]:       <mac address="fa:16:3e:1c:9a:a8"/>
Nov 29 20:37:15 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:37:15 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:37:15 user nova-compute[75356]:       <target dev="tap69354359-db"/>
Nov 29 20:37:15 user nova-compute[75356]:     </interface>
Nov 29 20:37:15 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:37:15 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/27b79c6f-c024-4bca-b292-292b11d79329/console.log" append="off"/>
Nov 29 20:37:15 user nova-compute[75356]:     </serial>
Nov 29 20:37:15 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:37:15 user nova-compute[75356]:     <video>
Nov 29 20:37:15 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:37:15 user nova-compute[75356]:     </video>
Nov 29 20:37:15 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:37:15 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:37:15 user nova-compute[75356]:     </rng>
Nov 29 20:37:15 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:37:15 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:37:15 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:37:15 user nova-compute[75356]:     </memballoon>
Nov 29 20:37:15 user nova-compute[75356]:   </devices>
Nov 29 20:37:15 user nova-compute[75356]: </domain>
Nov 29 20:37:15 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1269229211',display_name='tempest-TestVolumeBootPattern-server-1269229211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1269229211',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0zsffzZhgXAi/NOnOb6jr5SbjRUa5Ws+6E3ecNSbb6yR1bA/I1Lldbh3v8Eu9yysHBBgvc3puTY35+MIoawU5+qPudnUjWfeo2D4YgfUZH7hVHtowFiKG6iSLDsjXIsA==',key_name='tempest-TestVolumeBootPattern-313405727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6791b0c999846e2a22d5735f91ea1aa',ramdisk_id='',reservation_id='r-2dm1ho3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1627976633',owner_user_name='tempest-TestVolumeBootPattern-1627976633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:37:03Z,user_data=None,user_id='081b00360a204be3bd6435807283f230',uuid=27b79c6f-c024-4bca-b292-292b11d79329,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69354359-db68-4021-a266-e8486ad17fc1", "address": "fa:16:3e:1c:9a:a8", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69354359-db", "ovs_interfaceid": "69354359-db68-4021-a266-e8486ad17fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converting VIF {"id": "69354359-db68-4021-a266-e8486ad17fc1", "address": "fa:16:3e:1c:9a:a8", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69354359-db", "ovs_interfaceid": "69354359-db68-4021-a266-e8486ad17fc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:9a:a8,bridge_name='br-int',has_traffic_filtering=True,id=69354359-db68-4021-a266-e8486ad17fc1,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69354359-db') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG os_vif [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:9a:a8,bridge_name='br-int',has_traffic_filtering=True,id=69354359-db68-4021-a266-e8486ad17fc1,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69354359-db') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6836e58-3a82-523e-91a8-2cd31c94f16b', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69354359-db, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69354359-db, col_values=(('qos', UUID('9c70738a-8203-4b67-9d98-b2f96466bee4')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69354359-db, col_values=(('external_ids', {'iface-id': '69354359-db68-4021-a266-e8486ad17fc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:9a:a8', 'vm-uuid': '27b79c6f-c024-4bca-b292-292b11d79329'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:15 user nova-compute[75356]: INFO os_vif [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:9a:a8,bridge_name='br-int',has_traffic_filtering=True,id=69354359-db68-4021-a266-e8486ad17fc1,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69354359-db')
Nov 29 20:37:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:37:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] No VIF found with MAC fa:16:3e:1c:9a:a8, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:37:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-5560f381-4862-4895-bd7e-506f9ed44455 req-c1ed528f-5801-404e-a4d4-b0dd2daead28 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Received event network-vif-unplugged-65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:37:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5560f381-4862-4895-bd7e-506f9ed44455 req-c1ed528f-5801-404e-a4d4-b0dd2daead28 service nova] Acquiring lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5560f381-4862-4895-bd7e-506f9ed44455 req-c1ed528f-5801-404e-a4d4-b0dd2daead28 service nova] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5560f381-4862-4895-bd7e-506f9ed44455 req-c1ed528f-5801-404e-a4d4-b0dd2daead28 service nova] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-5560f381-4862-4895-bd7e-506f9ed44455 req-c1ed528f-5801-404e-a4d4-b0dd2daead28 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] No waiting events found dispatching network-vif-unplugged-65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:37:16 user nova-compute[75356]: WARNING nova.compute.manager [req-5560f381-4862-4895-bd7e-506f9ed44455 req-c1ed528f-5801-404e-a4d4-b0dd2daead28 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Received unexpected event network-vif-unplugged-65c10bc1-9ed3-4330-82bf-bb977579b739 for instance with vm_state active and task_state reboot_started.
Nov 29 20:37:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:17 user nova-compute[75356]: DEBUG nova.compute.manager [req-65d2a49b-e378-4513-ac22-80ae048dca25 req-8d2e7adf-7ff4-4ebd-bb94-6a021da52de9 service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Received event network-vif-plugged-69354359-db68-4021-a266-e8486ad17fc1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:37:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-65d2a49b-e378-4513-ac22-80ae048dca25 req-8d2e7adf-7ff4-4ebd-bb94-6a021da52de9 service nova] Acquiring lock "27b79c6f-c024-4bca-b292-292b11d79329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-65d2a49b-e378-4513-ac22-80ae048dca25 req-8d2e7adf-7ff4-4ebd-bb94-6a021da52de9 service nova] Lock "27b79c6f-c024-4bca-b292-292b11d79329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-65d2a49b-e378-4513-ac22-80ae048dca25 req-8d2e7adf-7ff4-4ebd-bb94-6a021da52de9 service nova] Lock "27b79c6f-c024-4bca-b292-292b11d79329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:17 user nova-compute[75356]: DEBUG nova.compute.manager [req-65d2a49b-e378-4513-ac22-80ae048dca25 req-8d2e7adf-7ff4-4ebd-bb94-6a021da52de9 service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] No waiting events found dispatching network-vif-plugged-69354359-db68-4021-a266-e8486ad17fc1 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:37:17 user nova-compute[75356]: WARNING nova.compute.manager [req-65d2a49b-e378-4513-ac22-80ae048dca25 req-8d2e7adf-7ff4-4ebd-bb94-6a021da52de9 service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Received unexpected event network-vif-plugged-69354359-db68-4021-a266-e8486ad17fc1 for instance with vm_state building and task_state spawning.
Nov 29 20:37:17 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-f718ed15-a560-4435-9b27-8e0169331cbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Instance shutdown successfully.
Nov 29 20:37:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-b2e6d20f-d931-4dad-a2f7-29c507a7e4aa req-66b1744f-ac40-4a8f-b40f-9a31c432d189 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Received event network-vif-plugged-65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:37:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b2e6d20f-d931-4dad-a2f7-29c507a7e4aa req-66b1744f-ac40-4a8f-b40f-9a31c432d189 service nova] Acquiring lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b2e6d20f-d931-4dad-a2f7-29c507a7e4aa req-66b1744f-ac40-4a8f-b40f-9a31c432d189 service nova] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b2e6d20f-d931-4dad-a2f7-29c507a7e4aa req-66b1744f-ac40-4a8f-b40f-9a31c432d189 service nova] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-b2e6d20f-d931-4dad-a2f7-29c507a7e4aa req-66b1744f-ac40-4a8f-b40f-9a31c432d189 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] No waiting events found dispatching network-vif-plugged-65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:37:18 user nova-compute[75356]: WARNING nova.compute.manager [req-b2e6d20f-d931-4dad-a2f7-29c507a7e4aa req-66b1744f-ac40-4a8f-b40f-9a31c432d189 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Received unexpected event network-vif-plugged-65c10bc1-9ed3-4330-82bf-bb977579b739 for instance with vm_state active and task_state reboot_started.
Nov 29 20:37:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-52a5505a-e619-4d33-b482-9bb63ee15013 req-28b0cf7d-6711-46de-b013-86a96d7b087b service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Received event network-vif-plugged-69354359-db68-4021-a266-e8486ad17fc1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:37:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-52a5505a-e619-4d33-b482-9bb63ee15013 req-28b0cf7d-6711-46de-b013-86a96d7b087b service nova] Acquiring lock "27b79c6f-c024-4bca-b292-292b11d79329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-52a5505a-e619-4d33-b482-9bb63ee15013 req-28b0cf7d-6711-46de-b013-86a96d7b087b service nova] Lock "27b79c6f-c024-4bca-b292-292b11d79329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-52a5505a-e619-4d33-b482-9bb63ee15013 req-28b0cf7d-6711-46de-b013-86a96d7b087b service nova] Lock "27b79c6f-c024-4bca-b292-292b11d79329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-52a5505a-e619-4d33-b482-9bb63ee15013 req-28b0cf7d-6711-46de-b013-86a96d7b087b service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] No waiting events found dispatching network-vif-plugged-69354359-db68-4021-a266-e8486ad17fc1 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:37:19 user nova-compute[75356]: WARNING nova.compute.manager [req-52a5505a-e619-4d33-b482-9bb63ee15013 req-28b0cf7d-6711-46de-b013-86a96d7b087b service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Received unexpected event network-vif-plugged-69354359-db68-4021-a266-e8486ad17fc1 for instance with vm_state building and task_state spawning.
Nov 29 20:37:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:20 user nova-compute[75356]: DEBUG nova.compute.manager [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:37:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:37:20 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Instance spawned successfully.
Nov 29 20:37:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:37:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:37:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:37:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:37:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:37:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:37:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:37:20 user nova-compute[75356]: INFO nova.compute.manager [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Took 6.91 seconds to spawn the instance on the hypervisor.
Nov 29 20:37:20 user nova-compute[75356]: DEBUG nova.compute.manager [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:37:20 user nova-compute[75356]: INFO nova.compute.manager [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Took 18.18 seconds to build instance.
Nov 29 20:37:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-992b14a6-b01b-4b58-9139-0a2fdd885f4f tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "27b79c6f-c024-4bca-b292-292b11d79329" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.350s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:21 user nova-compute[75356]: DEBUG nova.compute.manager [req-4f4448c7-8c75-4579-b63c-123d2e538328 req-9cd33bd6-b0cf-45f3-9874-cadea403bc99 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Received event network-vif-plugged-65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:37:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4f4448c7-8c75-4579-b63c-123d2e538328 req-9cd33bd6-b0cf-45f3-9874-cadea403bc99 service nova] Acquiring lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4f4448c7-8c75-4579-b63c-123d2e538328 req-9cd33bd6-b0cf-45f3-9874-cadea403bc99 service nova] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4f4448c7-8c75-4579-b63c-123d2e538328 req-9cd33bd6-b0cf-45f3-9874-cadea403bc99 service nova] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:21 user nova-compute[75356]: DEBUG nova.compute.manager [req-4f4448c7-8c75-4579-b63c-123d2e538328 req-9cd33bd6-b0cf-45f3-9874-cadea403bc99 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] No waiting events found dispatching network-vif-plugged-65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:37:21 user nova-compute[75356]: WARNING nova.compute.manager [req-4f4448c7-8c75-4579-b63c-123d2e538328 req-9cd33bd6-b0cf-45f3-9874-cadea403bc99 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Received unexpected event network-vif-plugged-65c10bc1-9ed3-4330-82bf-bb977579b739 for instance with vm_state active and task_state reboot_started.
Nov 29 20:37:21 user nova-compute[75356]: DEBUG nova.compute.manager [req-4f4448c7-8c75-4579-b63c-123d2e538328 req-9cd33bd6-b0cf-45f3-9874-cadea403bc99 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Received event network-vif-plugged-65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:37:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4f4448c7-8c75-4579-b63c-123d2e538328 req-9cd33bd6-b0cf-45f3-9874-cadea403bc99 service nova] Acquiring lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4f4448c7-8c75-4579-b63c-123d2e538328 req-9cd33bd6-b0cf-45f3-9874-cadea403bc99 service nova] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-4f4448c7-8c75-4579-b63c-123d2e538328 req-9cd33bd6-b0cf-45f3-9874-cadea403bc99 service nova] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:21 user nova-compute[75356]: DEBUG nova.compute.manager [req-4f4448c7-8c75-4579-b63c-123d2e538328 req-9cd33bd6-b0cf-45f3-9874-cadea403bc99 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] No waiting events found dispatching network-vif-plugged-65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:37:21 user nova-compute[75356]: WARNING nova.compute.manager [req-4f4448c7-8c75-4579-b63c-123d2e538328 req-9cd33bd6-b0cf-45f3-9874-cadea403bc99 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Received unexpected event network-vif-plugged-65c10bc1-9ed3-4330-82bf-bb977579b739 for instance with vm_state active and task_state reboot_started.
Nov 29 20:37:21 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Instance running successfully.
Nov 29 20:37:21 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-f718ed15-a560-4435-9b27-8e0169331cbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Instance soft rebooted successfully.
Nov 29 20:37:21 user nova-compute[75356]: DEBUG nova.compute.manager [None req-f718ed15-a560-4435-9b27-8e0169331cbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:37:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f718ed15-a560-4435-9b27-8e0169331cbe tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.985s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:28 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:37:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:28 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:37:28 user nova-compute[75356]: INFO nova.compute.claims [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Claim successful on node user
Nov 29 20:37:28 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:37:28 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:37:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:28 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:37:28 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:37:28 user nova-compute[75356]: DEBUG nova.network.neutron [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:37:28 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:37:28 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:37:29 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Creating image(s)
Nov 29 20:37:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "/opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "/opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG nova.policy [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbdba4f436df4dbb896258c4f4d6b180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076539532d4847719e7fcf4165872bbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.211s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/disk 1073741824" returned: 0 in 0.066s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.210s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG nova.network.neutron [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Successfully created port: f89e75d6-fcd9-48d5-a2dd-ecc8244536bb {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Cannot resize image /opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Ensure instance console log exists: /opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.network.neutron [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Successfully updated port: f89e75d6-fcd9-48d5-a2dd-ecc8244536bb {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "refresh_cache-4c175716-be33-4d0c-8fd7-2e42ef55c8a7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquired lock "refresh_cache-4c175716-be33-4d0c-8fd7-2e42ef55c8a7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.network.neutron [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.compute.manager [req-dee4e686-f4c3-4261-b943-b8bed6725909 req-cfa62da0-5920-48e1-8bcb-f2043b43c6ed service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Received event network-changed-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.compute.manager [req-dee4e686-f4c3-4261-b943-b8bed6725909 req-cfa62da0-5920-48e1-8bcb-f2043b43c6ed service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Refreshing instance network info cache due to event network-changed-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-dee4e686-f4c3-4261-b943-b8bed6725909 req-cfa62da0-5920-48e1-8bcb-f2043b43c6ed service nova] Acquiring lock "refresh_cache-4c175716-be33-4d0c-8fd7-2e42ef55c8a7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.network.neutron [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.network.neutron [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Updating instance_info_cache with network_info: [{"id": "f89e75d6-fcd9-48d5-a2dd-ecc8244536bb", "address": "fa:16:3e:27:c5:c1", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89e75d6-fc", "ovs_interfaceid": "f89e75d6-fcd9-48d5-a2dd-ecc8244536bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Releasing lock "refresh_cache-4c175716-be33-4d0c-8fd7-2e42ef55c8a7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Instance network_info: |[{"id": "f89e75d6-fcd9-48d5-a2dd-ecc8244536bb", "address": "fa:16:3e:27:c5:c1", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89e75d6-fc", "ovs_interfaceid": "f89e75d6-fcd9-48d5-a2dd-ecc8244536bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-dee4e686-f4c3-4261-b943-b8bed6725909 req-cfa62da0-5920-48e1-8bcb-f2043b43c6ed service nova] Acquired lock "refresh_cache-4c175716-be33-4d0c-8fd7-2e42ef55c8a7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.network.neutron [req-dee4e686-f4c3-4261-b943-b8bed6725909 req-cfa62da0-5920-48e1-8bcb-f2043b43c6ed service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Refreshing network info cache for port f89e75d6-fcd9-48d5-a2dd-ecc8244536bb {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Start _get_guest_xml network_info=[{"id": "f89e75d6-fcd9-48d5-a2dd-ecc8244536bb", "address": "fa:16:3e:27:c5:c1", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89e75d6-fc", "ovs_interfaceid": "f89e75d6-fcd9-48d5-a2dd-ecc8244536bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:37:31 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:37:31 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:37:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1281466358',display_name='tempest-AttachVolumeNegativeTest-server-1281466358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1281466358',id=43,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6EhJRbRKcjYJUMyguQpZy/4Kg53vwvbjwNo38IBfsXtNqZgJ+BAV2UHN5vkHcawBtC9LypHcFHwpe2Z+SgxVhr5xBJ5d3fWt/gLjbFg+09OGvm6qxTB5o4DBZmz/3Cyw==',key_name='tempest-keypair-224054888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='076539532d4847719e7fcf4165872bbe',ramdisk_id='',reservation_id='r-5twtev4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1182074567',owner_user_name='tempest-AttachVolumeNegativeTest-1182074567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:37:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbdba4f436df4dbb896258c4f4d6b180',uuid=4c175716-be33-4d0c-8fd7-2e42ef55c8a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f89e75d6-fcd9-48d5-a2dd-ecc8244536bb", "address": "fa:16:3e:27:c5:c1", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89e75d6-fc", "ovs_interfaceid": "f89e75d6-fcd9-48d5-a2dd-ecc8244536bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converting VIF {"id": "f89e75d6-fcd9-48d5-a2dd-ecc8244536bb", "address": "fa:16:3e:27:c5:c1", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89e75d6-fc", "ovs_interfaceid": "f89e75d6-fcd9-48d5-a2dd-ecc8244536bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:c5:c1,bridge_name='br-int',has_traffic_filtering=True,id=f89e75d6-fcd9-48d5-a2dd-ecc8244536bb,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf89e75d6-fc') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.objects.instance [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c175716-be33-4d0c-8fd7-2e42ef55c8a7 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:37:31 user nova-compute[75356]:   <uuid>4c175716-be33-4d0c-8fd7-2e42ef55c8a7</uuid>
Nov 29 20:37:31 user nova-compute[75356]:   <name>instance-0000002b</name>
Nov 29 20:37:31 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:37:31 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:37:31 user nova-compute[75356]:   <metadata>
Nov 29 20:37:31 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:37:31 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:37:31 user nova-compute[75356]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1281466358</nova:name>
Nov 29 20:37:31 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:37:31</nova:creationTime>
Nov 29 20:37:31 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:37:31 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:37:31 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:37:31 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:37:31 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:37:31 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:37:31 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:37:31 user nova-compute[75356]:       <nova:owner>
Nov 29 20:37:31 user nova-compute[75356]:         <nova:user uuid="cbdba4f436df4dbb896258c4f4d6b180">tempest-AttachVolumeNegativeTest-1182074567-project-member</nova:user>
Nov 29 20:37:31 user nova-compute[75356]:         <nova:project uuid="076539532d4847719e7fcf4165872bbe">tempest-AttachVolumeNegativeTest-1182074567</nova:project>
Nov 29 20:37:31 user nova-compute[75356]:       </nova:owner>
Nov 29 20:37:31 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:37:31 user nova-compute[75356]:       <nova:ports>
Nov 29 20:37:31 user nova-compute[75356]:         <nova:port uuid="f89e75d6-fcd9-48d5-a2dd-ecc8244536bb">
Nov 29 20:37:31 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 20:37:31 user nova-compute[75356]:         </nova:port>
Nov 29 20:37:31 user nova-compute[75356]:       </nova:ports>
Nov 29 20:37:31 user nova-compute[75356]:     </nova:instance>
Nov 29 20:37:31 user nova-compute[75356]:   </metadata>
Nov 29 20:37:31 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:37:31 user nova-compute[75356]:     <system>
Nov 29 20:37:31 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:37:31 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:37:31 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:37:31 user nova-compute[75356]:       <entry name="serial">4c175716-be33-4d0c-8fd7-2e42ef55c8a7</entry>
Nov 29 20:37:31 user nova-compute[75356]:       <entry name="uuid">4c175716-be33-4d0c-8fd7-2e42ef55c8a7</entry>
Nov 29 20:37:31 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:37:31 user nova-compute[75356]:     </system>
Nov 29 20:37:31 user nova-compute[75356]:   </sysinfo>
Nov 29 20:37:31 user nova-compute[75356]:   <os>
Nov 29 20:37:31 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:37:31 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:37:31 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:37:31 user nova-compute[75356]:   </os>
Nov 29 20:37:31 user nova-compute[75356]:   <features>
Nov 29 20:37:31 user nova-compute[75356]:     <acpi/>
Nov 29 20:37:31 user nova-compute[75356]:     <apic/>
Nov 29 20:37:31 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:37:31 user nova-compute[75356]:   </features>
Nov 29 20:37:31 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:37:31 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:37:31 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:37:31 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:37:31 user nova-compute[75356]:   </clock>
Nov 29 20:37:31 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:37:31 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:37:31 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:37:31 user nova-compute[75356]:   </cpu>
Nov 29 20:37:31 user nova-compute[75356]:   <devices>
Nov 29 20:37:31 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:37:31 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:37:31 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/disk"/>
Nov 29 20:37:31 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:37:31 user nova-compute[75356]:     </disk>
Nov 29 20:37:31 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:37:31 user nova-compute[75356]:       <mac address="fa:16:3e:27:c5:c1"/>
Nov 29 20:37:31 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:37:31 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:37:31 user nova-compute[75356]:       <target dev="tapf89e75d6-fc"/>
Nov 29 20:37:31 user nova-compute[75356]:     </interface>
Nov 29 20:37:31 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:37:31 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/console.log" append="off"/>
Nov 29 20:37:31 user nova-compute[75356]:     </serial>
Nov 29 20:37:31 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:37:31 user nova-compute[75356]:     <video>
Nov 29 20:37:31 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:37:31 user nova-compute[75356]:     </video>
Nov 29 20:37:31 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:37:31 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:37:31 user nova-compute[75356]:     </rng>
Nov 29 20:37:31 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:37:31 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:37:31 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:37:31 user nova-compute[75356]:     </memballoon>
Nov 29 20:37:31 user nova-compute[75356]:   </devices>
Nov 29 20:37:31 user nova-compute[75356]: </domain>
Nov 29 20:37:31 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:37:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1281466358',display_name='tempest-AttachVolumeNegativeTest-server-1281466358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1281466358',id=43,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6EhJRbRKcjYJUMyguQpZy/4Kg53vwvbjwNo38IBfsXtNqZgJ+BAV2UHN5vkHcawBtC9LypHcFHwpe2Z+SgxVhr5xBJ5d3fWt/gLjbFg+09OGvm6qxTB5o4DBZmz/3Cyw==',key_name='tempest-keypair-224054888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='076539532d4847719e7fcf4165872bbe',ramdisk_id='',reservation_id='r-5twtev4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1182074567',owner_user_name='tempest-AttachVolumeNegativeTest-1182074567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:37:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbdba4f436df4dbb896258c4f4d6b180',uuid=4c175716-be33-4d0c-8fd7-2e42ef55c8a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f89e75d6-fcd9-48d5-a2dd-ecc8244536bb", "address": "fa:16:3e:27:c5:c1", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89e75d6-fc", "ovs_interfaceid": "f89e75d6-fcd9-48d5-a2dd-ecc8244536bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converting VIF {"id": "f89e75d6-fcd9-48d5-a2dd-ecc8244536bb", "address": "fa:16:3e:27:c5:c1", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89e75d6-fc", "ovs_interfaceid": "f89e75d6-fcd9-48d5-a2dd-ecc8244536bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:c5:c1,bridge_name='br-int',has_traffic_filtering=True,id=f89e75d6-fcd9-48d5-a2dd-ecc8244536bb,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf89e75d6-fc') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG os_vif [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:c5:c1,bridge_name='br-int',has_traffic_filtering=True,id=f89e75d6-fcd9-48d5-a2dd-ecc8244536bb,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf89e75d6-fc') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f050e388-0a8c-534e-befd-066d530b2575', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf89e75d6-fc, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf89e75d6-fc, col_values=(('qos', UUID('e0793481-bffc-42fd-b92f-408b6c797627')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf89e75d6-fc, col_values=(('external_ids', {'iface-id': 'f89e75d6-fcd9-48d5-a2dd-ecc8244536bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:c5:c1', 'vm-uuid': '4c175716-be33-4d0c-8fd7-2e42ef55c8a7'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:31 user nova-compute[75356]: INFO os_vif [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:c5:c1,bridge_name='br-int',has_traffic_filtering=True,id=f89e75d6-fcd9-48d5-a2dd-ecc8244536bb,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf89e75d6-fc')
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:37:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] No VIF found with MAC fa:16:3e:27:c5:c1, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:37:32 user nova-compute[75356]: DEBUG nova.network.neutron [req-dee4e686-f4c3-4261-b943-b8bed6725909 req-cfa62da0-5920-48e1-8bcb-f2043b43c6ed service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Updated VIF entry in instance network info cache for port f89e75d6-fcd9-48d5-a2dd-ecc8244536bb. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:37:32 user nova-compute[75356]: DEBUG nova.network.neutron [req-dee4e686-f4c3-4261-b943-b8bed6725909 req-cfa62da0-5920-48e1-8bcb-f2043b43c6ed service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Updating instance_info_cache with network_info: [{"id": "f89e75d6-fcd9-48d5-a2dd-ecc8244536bb", "address": "fa:16:3e:27:c5:c1", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89e75d6-fc", "ovs_interfaceid": "f89e75d6-fcd9-48d5-a2dd-ecc8244536bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:37:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-dee4e686-f4c3-4261-b943-b8bed6725909 req-cfa62da0-5920-48e1-8bcb-f2043b43c6ed service nova] Releasing lock "refresh_cache-4c175716-be33-4d0c-8fd7-2e42ef55c8a7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:37:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:33 user nova-compute[75356]: DEBUG nova.compute.manager [req-31c0f25e-f09a-493b-a20b-b3fdc2a94f4b req-1aaa921e-6c87-491b-bddd-fd334e1a8fb3 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Received event network-vif-plugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:37:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-31c0f25e-f09a-493b-a20b-b3fdc2a94f4b req-1aaa921e-6c87-491b-bddd-fd334e1a8fb3 service nova] Acquiring lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-31c0f25e-f09a-493b-a20b-b3fdc2a94f4b req-1aaa921e-6c87-491b-bddd-fd334e1a8fb3 service nova] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-31c0f25e-f09a-493b-a20b-b3fdc2a94f4b req-1aaa921e-6c87-491b-bddd-fd334e1a8fb3 service nova] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:33 user nova-compute[75356]: DEBUG nova.compute.manager [req-31c0f25e-f09a-493b-a20b-b3fdc2a94f4b req-1aaa921e-6c87-491b-bddd-fd334e1a8fb3 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] No waiting events found dispatching network-vif-plugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:37:33 user nova-compute[75356]: WARNING nova.compute.manager [req-31c0f25e-f09a-493b-a20b-b3fdc2a94f4b req-1aaa921e-6c87-491b-bddd-fd334e1a8fb3 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Received unexpected event network-vif-plugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb for instance with vm_state building and task_state spawning.
Nov 29 20:37:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:35 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:37:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:37:35 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Instance spawned successfully.
Nov 29 20:37:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:37:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:37:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:37:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:37:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:37:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:37:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:37:35 user nova-compute[75356]: DEBUG nova.compute.manager [req-a5929420-e97e-4e25-94dc-710717dacc8e req-ec0eb4ad-46eb-4406-83bc-897f46b4f066 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Received event network-vif-plugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:37:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a5929420-e97e-4e25-94dc-710717dacc8e req-ec0eb4ad-46eb-4406-83bc-897f46b4f066 service nova] Acquiring lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:37:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a5929420-e97e-4e25-94dc-710717dacc8e req-ec0eb4ad-46eb-4406-83bc-897f46b4f066 service nova] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:37:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a5929420-e97e-4e25-94dc-710717dacc8e req-ec0eb4ad-46eb-4406-83bc-897f46b4f066 service nova] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:35 user nova-compute[75356]: DEBUG nova.compute.manager [req-a5929420-e97e-4e25-94dc-710717dacc8e req-ec0eb4ad-46eb-4406-83bc-897f46b4f066 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] No waiting events found dispatching network-vif-plugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:37:35 user nova-compute[75356]: WARNING nova.compute.manager [req-a5929420-e97e-4e25-94dc-710717dacc8e req-ec0eb4ad-46eb-4406-83bc-897f46b4f066 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Received unexpected event network-vif-plugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb for instance with vm_state building and task_state spawning.
Nov 29 20:37:35 user nova-compute[75356]: INFO nova.compute.manager [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Took 6.76 seconds to spawn the instance on the hypervisor.
Nov 29 20:37:35 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:37:35 user nova-compute[75356]: INFO nova.compute.manager [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Took 7.72 seconds to build instance.
Nov 29 20:37:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8d682ad4-d13e-44d9-9e77-16c7f048d94c tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.856s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:37:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:37:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:38:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:38:02 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:38:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:38:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:38:07 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:38:07 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:38:07 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 20:38:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:38:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:38:07 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:38:07 user nova-compute[75356]: DEBUG nova.objects.instance [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lazy-loading 'info_cache' on Instance uuid 28f5dcc3-db77-4c65-87af-e300f99d2be5 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:38:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:38:07 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Updating instance_info_cache with network_info: [{"id": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "address": "fa:16:3e:6b:b2:4e", "network": {"id": "27a8d395-36c8-4f27-89cf-f5019ccbf9a2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45448e5cb4e84c14b1114846a6ccbdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ec4756-3f", "ovs_interfaceid": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:38:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-28f5dcc3-db77-4c65-87af-e300f99d2be5" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:38:07 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:38:10 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:38:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:38:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:38:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:38:10 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:38:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:38:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:38:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:38:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:38:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:38:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:38:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:38:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:38:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:38:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:38:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:38:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:38:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:38:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:38:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:38:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:38:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:38:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:38:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:38:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:38:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:38:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:38:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:38:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:38:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:38:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:38:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:38:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:38:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:38:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:38:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:38:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:38:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:38:13 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:38:13 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:38:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=8023MB free_disk=24.908306121826172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:38:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:38:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:38:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:38:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:38:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 93183110-d2e2-4da7-ab7d-73378f5e0d42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:38:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance bf850b0d-88b6-4ec3-b3eb-df6195be2945 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:38:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ffb04928-4f5f-4461-aa24-6363d1c9b941 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:38:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 27b79c6f-c024-4bca-b292-292b11d79329 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:38:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4c175716-be33-4d0c-8fd7-2e42ef55c8a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:38:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:38:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:38:13 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing inventories for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 20:38:13 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Updating ProviderTree inventory for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 20:38:13 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Updating inventory in ProviderTree for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 20:38:13 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing aggregate associations for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a, aggregates: None {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 20:38:13 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing trait associations for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 20:38:14 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:38:14 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:38:14 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:38:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.733s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:38:15 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:38:15 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:38:15 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:38:15 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:38:15 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:38:15 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:38:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:38:16 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:38:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:38:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:38:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:38:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:38:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:38:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:38:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:38:22 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:38:22 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Cleaning up deleted instances {{(pid=75356) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 20:38:22 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] There are 0 instances to clean {{(pid=75356) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 20:38:22 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:38:22 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75356) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 20:38:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:38:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:38:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:38:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:38:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:38:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-605bf979-09a4-4a24-b249-5df932340557 req-531cd911-c30e-4984-90ee-72db9cebcc33 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received event network-changed-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:38:43 user nova-compute[75356]: DEBUG nova.compute.manager [req-605bf979-09a4-4a24-b249-5df932340557 req-531cd911-c30e-4984-90ee-72db9cebcc33 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Refreshing instance network info cache due to event network-changed-c68da58a-baf1-4054-8d8c-d0736ec173a5. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:38:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-605bf979-09a4-4a24-b249-5df932340557 req-531cd911-c30e-4984-90ee-72db9cebcc33 service nova] Acquiring lock "refresh_cache-bf850b0d-88b6-4ec3-b3eb-df6195be2945" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:38:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-605bf979-09a4-4a24-b249-5df932340557 req-531cd911-c30e-4984-90ee-72db9cebcc33 service nova] Acquired lock "refresh_cache-bf850b0d-88b6-4ec3-b3eb-df6195be2945" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:38:43 user nova-compute[75356]: DEBUG nova.network.neutron [req-605bf979-09a4-4a24-b249-5df932340557 req-531cd911-c30e-4984-90ee-72db9cebcc33 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Refreshing network info cache for port c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:38:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:38:43 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:38:43 user nova-compute[75356]: INFO nova.compute.manager [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Detaching volume 6ff66e71-1b63-495e-b333-2d3df67f7345
Nov 29 20:38:43 user nova-compute[75356]: INFO nova.virt.block_device [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Attempting to driver detach volume 6ff66e71-1b63-495e-b333-2d3df67f7345 from mountpoint /dev/vdb
Nov 29 20:38:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Attempting to detach device vdb from instance bf850b0d-88b6-4ec3-b3eb-df6195be2945 from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:38:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:38:44 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:38:44 user nova-compute[75356]:   <source dev="/dev/sde"/>
Nov 29 20:38:44 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:38:44 user nova-compute[75356]:   <serial>6ff66e71-1b63-495e-b333-2d3df67f7345</serial>
Nov 29 20:38:44 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:38:44 user nova-compute[75356]: </disk>
Nov 29 20:38:44 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:38:44 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Successfully detached device vdb from instance bf850b0d-88b6-4ec3-b3eb-df6195be2945 from the persistent domain config.
Nov 29 20:38:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf850b0d-88b6-4ec3-b3eb-df6195be2945 from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:38:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:38:44 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:38:44 user nova-compute[75356]:   <source dev="/dev/sde"/>
Nov 29 20:38:44 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:38:44 user nova-compute[75356]:   <serial>6ff66e71-1b63-495e-b333-2d3df67f7345</serial>
Nov 29 20:38:44 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:38:44 user nova-compute[75356]: </disk>
Nov 29 20:38:44 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:38:44 user nova-compute[75356]: DEBUG nova.network.neutron [req-605bf979-09a4-4a24-b249-5df932340557 req-531cd911-c30e-4984-90ee-72db9cebcc33 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Updated VIF entry in instance network info cache for port c68da58a-baf1-4054-8d8c-d0736ec173a5. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:38:44 user nova-compute[75356]: DEBUG nova.network.neutron [req-605bf979-09a4-4a24-b249-5df932340557 req-531cd911-c30e-4984-90ee-72db9cebcc33 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Updating instance_info_cache with network_info: [{"id": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "address": "fa:16:3e:57:b8:2a", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68da58a-ba", "ovs_interfaceid": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:38:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-605bf979-09a4-4a24-b249-5df932340557 req-531cd911-c30e-4984-90ee-72db9cebcc33 service nova] Releasing lock "refresh_cache-bf850b0d-88b6-4ec3-b3eb-df6195be2945" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:38:44 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf850b0d-88b6-4ec3-b3eb-df6195be2945 {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:38:45 user nova-compute[75356]: DEBUG nova.compute.manager [req-1a9d7471-563c-4be9-9a9f-e3b452e0b8f5 req-d8a64e81-4524-4b40-b2b3-29e2f598b360 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received event network-changed-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:38:45 user nova-compute[75356]: DEBUG nova.compute.manager [req-1a9d7471-563c-4be9-9a9f-e3b452e0b8f5 req-d8a64e81-4524-4b40-b2b3-29e2f598b360 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Refreshing instance network info cache due to event network-changed-c68da58a-baf1-4054-8d8c-d0736ec173a5. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:38:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1a9d7471-563c-4be9-9a9f-e3b452e0b8f5 req-d8a64e81-4524-4b40-b2b3-29e2f598b360 service nova] Acquiring lock "refresh_cache-bf850b0d-88b6-4ec3-b3eb-df6195be2945" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:38:45 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1a9d7471-563c-4be9-9a9f-e3b452e0b8f5 req-d8a64e81-4524-4b40-b2b3-29e2f598b360 service nova] Acquired lock "refresh_cache-bf850b0d-88b6-4ec3-b3eb-df6195be2945" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:38:45 user nova-compute[75356]: DEBUG nova.network.neutron [req-1a9d7471-563c-4be9-9a9f-e3b452e0b8f5 req-d8a64e81-4524-4b40-b2b3-29e2f598b360 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Refreshing network info cache for port c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:38:46 user nova-compute[75356]: DEBUG nova.network.neutron [req-1a9d7471-563c-4be9-9a9f-e3b452e0b8f5 req-d8a64e81-4524-4b40-b2b3-29e2f598b360 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Updated VIF entry in instance network info cache for port c68da58a-baf1-4054-8d8c-d0736ec173a5. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:38:46 user nova-compute[75356]: DEBUG nova.network.neutron [req-1a9d7471-563c-4be9-9a9f-e3b452e0b8f5 req-d8a64e81-4524-4b40-b2b3-29e2f598b360 service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Updating instance_info_cache with network_info: [{"id": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "address": "fa:16:3e:57:b8:2a", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68da58a-ba", "ovs_interfaceid": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:38:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1a9d7471-563c-4be9-9a9f-e3b452e0b8f5 req-d8a64e81-4524-4b40-b2b3-29e2f598b360 service nova] Releasing lock "refresh_cache-bf850b0d-88b6-4ec3-b3eb-df6195be2945" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:38:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:38:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:38:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:38:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:38:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:38:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:38:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:38:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:38:54 user nova-compute[75356]: DEBUG nova.compute.manager [req-db095275-d24b-4780-9754-77743f7c2ac2 req-b9d7707a-500f-4ac1-a869-e75739bc5c13 service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Received event network-changed-69354359-db68-4021-a266-e8486ad17fc1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:38:54 user nova-compute[75356]: DEBUG nova.compute.manager [req-db095275-d24b-4780-9754-77743f7c2ac2 req-b9d7707a-500f-4ac1-a869-e75739bc5c13 service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Refreshing instance network info cache due to event network-changed-69354359-db68-4021-a266-e8486ad17fc1. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:38:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-db095275-d24b-4780-9754-77743f7c2ac2 req-b9d7707a-500f-4ac1-a869-e75739bc5c13 service nova] Acquiring lock "refresh_cache-27b79c6f-c024-4bca-b292-292b11d79329" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:38:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-db095275-d24b-4780-9754-77743f7c2ac2 req-b9d7707a-500f-4ac1-a869-e75739bc5c13 service nova] Acquired lock "refresh_cache-27b79c6f-c024-4bca-b292-292b11d79329" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:38:54 user nova-compute[75356]: DEBUG nova.network.neutron [req-db095275-d24b-4780-9754-77743f7c2ac2 req-b9d7707a-500f-4ac1-a869-e75739bc5c13 service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Refreshing network info cache for port 69354359-db68-4021-a266-e8486ad17fc1 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:38:54 user nova-compute[75356]: DEBUG nova.network.neutron [req-db095275-d24b-4780-9754-77743f7c2ac2 req-b9d7707a-500f-4ac1-a869-e75739bc5c13 service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Updated VIF entry in instance network info cache for port 69354359-db68-4021-a266-e8486ad17fc1. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:38:54 user nova-compute[75356]: DEBUG nova.network.neutron [req-db095275-d24b-4780-9754-77743f7c2ac2 req-b9d7707a-500f-4ac1-a869-e75739bc5c13 service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Updating instance_info_cache with network_info: [{"id": "69354359-db68-4021-a266-e8486ad17fc1", "address": "fa:16:3e:1c:9a:a8", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69354359-db", "ovs_interfaceid": "69354359-db68-4021-a266-e8486ad17fc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:38:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-db095275-d24b-4780-9754-77743f7c2ac2 req-b9d7707a-500f-4ac1-a869-e75739bc5c13 service nova] Releasing lock "refresh_cache-27b79c6f-c024-4bca-b292-292b11d79329" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:38:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:38:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "6f31e740-f4b3-41be-b004-70c3d49459ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:39:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "6f31e740-f4b3-41be-b004-70c3d49459ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:39:02 user nova-compute[75356]: DEBUG nova.compute.manager [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:39:03 user nova-compute[75356]: INFO nova.compute.claims [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Claim successful on node user
Nov 29 20:39:03 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG nova.compute.manager [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG nova.compute.manager [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG nova.network.neutron [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:39:03 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:39:03 user nova-compute[75356]: DEBUG nova.compute.manager [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:39:03 user nova-compute[75356]: INFO nova.virt.block_device [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Booting with volume 5dddc729-7896-482a-abe6-9c9d0deead79 at /dev/vda
Nov 29 20:39:03 user nova-compute[75356]: DEBUG nova.policy [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '081b00360a204be3bd6435807283f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6791b0c999846e2a22d5735f91ea1aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG os_brick.utils [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f62f435-12c6-4a35-ba72-4d672d493e7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec27952-1a40-4ba4-a30c-eab71e03c03d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2787edd5-a393-4c2f-a700-08357200c7e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[af93c7fa-d900-4ba4-9ac6-c72432c14c39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:39:03 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:39:03 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fe6c81-1bc2-4e38-bdab-a46fee75c3c7]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG os_brick.utils [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:39:03 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Updating existing volume attachment record: 1c03675a-b283-436a-bf24-311c48dbaafc {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG nova.network.neutron [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Successfully created port: b99c7a66-5c97-483e-bdaf-f5eef776fddd {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:39:04 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bf850b0d-88b6-4ec3-b3eb-df6195be2945 is timed out.
Nov 29 20:39:04 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Successfully detached device vdb from instance bf850b0d-88b6-4ec3-b3eb-df6195be2945 from the live domain config.
Nov 29 20:39:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jBDvpZQt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:39:04 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:39:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3cb640-de9c-4ede-aa14-16c508be5992]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:39:04 user nova-compute[75356]: No targets found.
Nov 29 20:39:04 user nova-compute[75356]: iSNS:
Nov 29 20:39:04 user nova-compute[75356]: No targets found.
Nov 29 20:39:04 user nova-compute[75356]: STATIC:
Nov 29 20:39:04 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c
Nov 29 20:39:04 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:39:04 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:39:04 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345
Nov 29 20:39:04 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:39:04 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:39:04 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479
Nov 29 20:39:04 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:39:04 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:39:04 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:39:04 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:39:04 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:39:04 user nova-compute[75356]: FIRMWARE:
Nov 29 20:39:04 user nova-compute[75356]: No targets found.
Nov 29 20:39:04 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:39:04 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:39:04 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53d8d69-7897-4037-accb-f40730973224]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[19503351-c01c-4102-917c-5019d11dc160]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:39:04 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:39:04 user nova-compute[75356]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 (non-flash)
Nov 29 20:39:04 user nova-compute[75356]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:39:04 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:39:04 user nova-compute[75356]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 (non-flash)
Nov 29 20:39:04 user nova-compute[75356]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 (non-flash)
Nov 29 20:39:04 user nova-compute[75356]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:39:04 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e44e0f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345'): ({'sde'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Removing single pathed devices sde {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eac6afb-7d98-4c86-8a87-17a0ec08ee97]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fd5a5a-f5ad-458f-a211-3577308e3f99]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Flushing IO for device /dev/sde {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a754553d-c0d1-4f4c-b15e-9357a5f8c807]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[abac737f-9372-4095-a7ea-a1ab3a424e35]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] SCSI volumes sde have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c589670-5adc-4cbf-9186-bf489619bd20]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec706d65-37be-4392-acfa-77d8b7157369]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345, portal: 172.16.0.220,3260]
Nov 29 20:39:04 user nova-compute[75356]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345, portal: 172.16.0.220,3260] successful.
Nov 29 20:39:04 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ff66e71-1b63-495e-b333-2d3df67f7345 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a63af0a-6286-4991-93ff-78df76e1eeae]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] <== disconnect_volume: return (341ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:39:04 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:39:05 user nova-compute[75356]: DEBUG nova.compute.manager [req-892ff780-5a75-40ef-bb21-ddc70d4251c6 req-8b6da6c7-c071-407f-bb85-431464194b2d service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Received event network-changed-65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:39:05 user nova-compute[75356]: DEBUG nova.compute.manager [req-892ff780-5a75-40ef-bb21-ddc70d4251c6 req-8b6da6c7-c071-407f-bb85-431464194b2d service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Refreshing instance network info cache due to event network-changed-65c10bc1-9ed3-4330-82bf-bb977579b739. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:39:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-892ff780-5a75-40ef-bb21-ddc70d4251c6 req-8b6da6c7-c071-407f-bb85-431464194b2d service nova] Acquiring lock "refresh_cache-ffb04928-4f5f-4461-aa24-6363d1c9b941" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:39:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-892ff780-5a75-40ef-bb21-ddc70d4251c6 req-8b6da6c7-c071-407f-bb85-431464194b2d service nova] Acquired lock "refresh_cache-ffb04928-4f5f-4461-aa24-6363d1c9b941" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:39:05 user nova-compute[75356]: DEBUG nova.network.neutron [req-892ff780-5a75-40ef-bb21-ddc70d4251c6 req-8b6da6c7-c071-407f-bb85-431464194b2d service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Refreshing network info cache for port 65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:39:05 user nova-compute[75356]: DEBUG nova.network.neutron [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Successfully updated port: b99c7a66-5c97-483e-bdaf-f5eef776fddd {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:39:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "refresh_cache-6f31e740-f4b3-41be-b004-70c3d49459ea" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:39:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquired lock "refresh_cache-6f31e740-f4b3-41be-b004-70c3d49459ea" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:39:05 user nova-compute[75356]: DEBUG nova.network.neutron [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:39:05 user nova-compute[75356]: DEBUG nova.compute.manager [req-791a3b99-eab4-4f59-b21a-5b74b778c287 req-017b6c25-3401-475b-a45e-846c1c0a7607 service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Received event network-changed-b99c7a66-5c97-483e-bdaf-f5eef776fddd {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:39:05 user nova-compute[75356]: DEBUG nova.compute.manager [req-791a3b99-eab4-4f59-b21a-5b74b778c287 req-017b6c25-3401-475b-a45e-846c1c0a7607 service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Refreshing instance network info cache due to event network-changed-b99c7a66-5c97-483e-bdaf-f5eef776fddd. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:39:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-791a3b99-eab4-4f59-b21a-5b74b778c287 req-017b6c25-3401-475b-a45e-846c1c0a7607 service nova] Acquiring lock "refresh_cache-6f31e740-f4b3-41be-b004-70c3d49459ea" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:39:05 user nova-compute[75356]: DEBUG nova.network.neutron [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:39:05 user nova-compute[75356]: DEBUG nova.network.neutron [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Updating instance_info_cache with network_info: [{"id": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "address": "fa:16:3e:ce:65:d0", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99c7a66-5c", "ovs_interfaceid": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:39:05 user nova-compute[75356]: DEBUG nova.objects.instance [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'flavor' on Instance uuid bf850b0d-88b6-4ec3-b3eb-df6195be2945 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:39:05 user nova-compute[75356]: DEBUG nova.network.neutron [req-892ff780-5a75-40ef-bb21-ddc70d4251c6 req-8b6da6c7-c071-407f-bb85-431464194b2d service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Updated VIF entry in instance network info cache for port 65c10bc1-9ed3-4330-82bf-bb977579b739. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:39:05 user nova-compute[75356]: DEBUG nova.network.neutron [req-892ff780-5a75-40ef-bb21-ddc70d4251c6 req-8b6da6c7-c071-407f-bb85-431464194b2d service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Updating instance_info_cache with network_info: [{"id": "65c10bc1-9ed3-4330-82bf-bb977579b739", "address": "fa:16:3e:83:e1:42", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c10bc1-9e", "ovs_interfaceid": "65c10bc1-9ed3-4330-82bf-bb977579b739", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:39:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-892ff780-5a75-40ef-bb21-ddc70d4251c6 req-8b6da6c7-c071-407f-bb85-431464194b2d service nova] Releasing lock "refresh_cache-ffb04928-4f5f-4461-aa24-6363d1c9b941" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:39:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Releasing lock "refresh_cache-6f31e740-f4b3-41be-b004-70c3d49459ea" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:39:05 user nova-compute[75356]: DEBUG nova.compute.manager [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Instance network_info: |[{"id": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "address": "fa:16:3e:ce:65:d0", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99c7a66-5c", "ovs_interfaceid": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:39:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-791a3b99-eab4-4f59-b21a-5b74b778c287 req-017b6c25-3401-475b-a45e-846c1c0a7607 service nova] Acquired lock "refresh_cache-6f31e740-f4b3-41be-b004-70c3d49459ea" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:39:05 user nova-compute[75356]: DEBUG nova.network.neutron [req-791a3b99-eab4-4f59-b21a-5b74b778c287 req-017b6c25-3401-475b-a45e-846c1c0a7607 service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Refreshing network info cache for port b99c7a66-5c97-483e-bdaf-f5eef776fddd {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:39:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b0a81c05-a722-4dd6-a89c-eb06b82a9f8e tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.189s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:39:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "ffb04928-4f5f-4461-aa24-6363d1c9b941" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:39:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:39:06 user nova-compute[75356]: INFO nova.compute.manager [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Detaching volume 19e9ddab-dc95-48c5-bba1-32b2081a3479
Nov 29 20:39:06 user nova-compute[75356]: INFO nova.virt.block_device [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Attempting to driver detach volume 19e9ddab-dc95-48c5-bba1-32b2081a3479 from mountpoint /dev/vdb
Nov 29 20:39:06 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Attempting to detach device vdb from instance ffb04928-4f5f-4461-aa24-6363d1c9b941 from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:39:06 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:39:06 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:39:06 user nova-compute[75356]:   <source dev="/dev/sdc"/>
Nov 29 20:39:06 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:39:06 user nova-compute[75356]:   <serial>19e9ddab-dc95-48c5-bba1-32b2081a3479</serial>
Nov 29 20:39:06 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:39:06 user nova-compute[75356]: </disk>
Nov 29 20:39:06 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:39:06 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Successfully detached device vdb from instance ffb04928-4f5f-4461-aa24-6363d1c9b941 from the persistent domain config.
Nov 29 20:39:06 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ffb04928-4f5f-4461-aa24-6363d1c9b941 from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:39:06 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:39:06 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:39:06 user nova-compute[75356]:   <source dev="/dev/sdc"/>
Nov 29 20:39:06 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:39:06 user nova-compute[75356]:   <serial>19e9ddab-dc95-48c5-bba1-32b2081a3479</serial>
Nov 29 20:39:06 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:39:06 user nova-compute[75356]: </disk>
Nov 29 20:39:06 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:39:06 user nova-compute[75356]: DEBUG nova.network.neutron [req-791a3b99-eab4-4f59-b21a-5b74b778c287 req-017b6c25-3401-475b-a45e-846c1c0a7607 service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Updated VIF entry in instance network info cache for port b99c7a66-5c97-483e-bdaf-f5eef776fddd. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:39:06 user nova-compute[75356]: DEBUG nova.network.neutron [req-791a3b99-eab4-4f59-b21a-5b74b778c287 req-017b6c25-3401-475b-a45e-846c1c0a7607 service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Updating instance_info_cache with network_info: [{"id": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "address": "fa:16:3e:ce:65:d0", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99c7a66-5c", "ovs_interfaceid": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:39:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-791a3b99-eab4-4f59-b21a-5b74b778c287 req-017b6c25-3401-475b-a45e-846c1c0a7607 service nova] Releasing lock "refresh_cache-6f31e740-f4b3-41be-b004-70c3d49459ea" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:39:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ffb04928-4f5f-4461-aa24-6363d1c9b941 {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:39:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-0f110e2d-5a3d-4536-8e11-66a1df1cd0f5 req-81aaf6e8-7651-4c1d-933e-eba1ba7b8a8f service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Received event network-changed-65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:39:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-0f110e2d-5a3d-4536-8e11-66a1df1cd0f5 req-81aaf6e8-7651-4c1d-933e-eba1ba7b8a8f service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Refreshing instance network info cache due to event network-changed-65c10bc1-9ed3-4330-82bf-bb977579b739. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:39:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0f110e2d-5a3d-4536-8e11-66a1df1cd0f5 req-81aaf6e8-7651-4c1d-933e-eba1ba7b8a8f service nova] Acquiring lock "refresh_cache-ffb04928-4f5f-4461-aa24-6363d1c9b941" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:39:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0f110e2d-5a3d-4536-8e11-66a1df1cd0f5 req-81aaf6e8-7651-4c1d-933e-eba1ba7b8a8f service nova] Acquired lock "refresh_cache-ffb04928-4f5f-4461-aa24-6363d1c9b941" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:39:07 user nova-compute[75356]: DEBUG nova.network.neutron [req-0f110e2d-5a3d-4536-8e11-66a1df1cd0f5 req-81aaf6e8-7651-4c1d-933e-eba1ba7b8a8f service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Refreshing network info cache for port 65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:39:07 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:39:07 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:39:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:39:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:39:07 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:39:07 user nova-compute[75356]: DEBUG nova.network.neutron [req-0f110e2d-5a3d-4536-8e11-66a1df1cd0f5 req-81aaf6e8-7651-4c1d-933e-eba1ba7b8a8f service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Updated VIF entry in instance network info cache for port 65c10bc1-9ed3-4330-82bf-bb977579b739. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:39:07 user nova-compute[75356]: DEBUG nova.network.neutron [req-0f110e2d-5a3d-4536-8e11-66a1df1cd0f5 req-81aaf6e8-7651-4c1d-933e-eba1ba7b8a8f service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Updating instance_info_cache with network_info: [{"id": "65c10bc1-9ed3-4330-82bf-bb977579b739", "address": "fa:16:3e:83:e1:42", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c10bc1-9e", "ovs_interfaceid": "65c10bc1-9ed3-4330-82bf-bb977579b739", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:39:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0f110e2d-5a3d-4536-8e11-66a1df1cd0f5 req-81aaf6e8-7651-4c1d-933e-eba1ba7b8a8f service nova] Releasing lock "refresh_cache-ffb04928-4f5f-4461-aa24-6363d1c9b941" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:39:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:07 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Updating instance_info_cache with network_info: [{"id": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "address": "fa:16:3e:91:30:da", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a14e591-f6", "ovs_interfaceid": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:39:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:39:07 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:39:10 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:39:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:39:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:39:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:39:10 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:39:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:39:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG nova.compute.manager [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:39:11 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Creating image(s)
Nov 29 20:39:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Did not create local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Ensure instance console log exists: /opt/stack/data/nova/instances/6f31e740-f4b3-41be-b004-70c3d49459ea/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Start _get_guest_xml network_info=[{"id": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "address": "fa:16:3e:ce:65:d0", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99c7a66-5c", "ovs_interfaceid": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eynfVgox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6f31e740-f4b3-41be-b004-70c3d49459ea', 'attached_at': '', 'detached_at': '', 'volume_id': '5dddc729-7896-482a-abe6-9c9d0deead79', 'serial': '5dddc729-7896-482a-abe6-9c9d0deead79'}, 'attachment_id': '1c03675a-b283-436a-bf24-311c48dbaafc', 'volume_type': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:39:11 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:39:11 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:39:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:39:11 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eynfVgox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:39:12 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:39:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:39:12 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:39:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:39:12 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0df538-3739-4699-a69c-c186dd0d925d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:39:12 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[145878ae-59bd-40d4-804a-821d9158e5a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79] added
Nov 29 20:39:12 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[903da93c-d920-424f-b5ab-fbbc22d7087b]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c98a18-17b0-40df-bc67-6c60f035192d]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eynfVgox {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eynfVgox" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[263f0e88-cbf1-4c4f-8319-d3e8aa9c0e35]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eynfVgox'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e104bf70-6421-42bd-ac3e-8423e046aedd]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a6ccd1-958c-4c30-b62e-9d9f4deb4d7b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:39:12 user nova-compute[75356]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 (non-flash)
Nov 29 20:39:12 user nova-compute[75356]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:39:12 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:39:12 user nova-compute[75356]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 (non-flash)
Nov 29 20:39:12 user nova-compute[75356]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:39:12 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb457e07-5771-4c64-9b35-b2693bf54a01]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79, portal: 172.16.0.220,3260]
Nov 29 20:39:12 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79, portal: 172.16.0.220,3260] successful.
Nov 29 20:39:12 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[034901dd-9e96-4182-82e6-109cbe0ed997]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d06b63-6329-4f22-9da6-833901a0f6e3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:39:12 user nova-compute[75356]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 (non-flash)
Nov 29 20:39:12 user nova-compute[75356]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:39:12 user nova-compute[75356]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 (non-flash)
Nov 29 20:39:12 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:39:12 user nova-compute[75356]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 (non-flash)
Nov 29 20:39:12 user nova-compute[75356]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:39:12 user nova-compute[75356]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 (non-flash)
Nov 29 20:39:12 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1008111-cdda-442a-b03c-6e73111c5f3f]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eynfVgox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:13 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:39:13 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=8190MB free_disk=24.895965576171875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23563316463323462', 'path': '/dev/sde'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563316463323462', 'path': '/dev/sde'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:39:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1053648815',display_name='tempest-TestVolumeBootPattern-server-1053648815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1053648815',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0zsffzZhgXAi/NOnOb6jr5SbjRUa5Ws+6E3ecNSbb6yR1bA/I1Lldbh3v8Eu9yysHBBgvc3puTY35+MIoawU5+qPudnUjWfeo2D4YgfUZH7hVHtowFiKG6iSLDsjXIsA==',key_name='tempest-TestVolumeBootPattern-313405727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6791b0c999846e2a22d5735f91ea1aa',ramdisk_id='',reservation_id='r-ou9xg66l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1627976633',owner_user_name='tempest-TestVolumeBootPattern-1627976633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:39:04Z,user_data=None,user_id='081b00360a204be3bd6435807283f230',uuid=6f31e740-f4b3-41be-b004-70c3d49459ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "address": "fa:16:3e:ce:65:d0", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99c7a66-5c", "ovs_interfaceid": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converting VIF {"id": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "address": "fa:16:3e:ce:65:d0", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99c7a66-5c", "ovs_interfaceid": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:65:d0,bridge_name='br-int',has_traffic_filtering=True,id=b99c7a66-5c97-483e-bdaf-f5eef776fddd,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99c7a66-5c') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.objects.instance [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f31e740-f4b3-41be-b004-70c3d49459ea {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:39:13 user nova-compute[75356]:   <uuid>6f31e740-f4b3-41be-b004-70c3d49459ea</uuid>
Nov 29 20:39:13 user nova-compute[75356]:   <name>instance-0000002c</name>
Nov 29 20:39:13 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:39:13 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:39:13 user nova-compute[75356]:   <metadata>
Nov 29 20:39:13 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:39:13 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:39:13 user nova-compute[75356]:       <nova:name>tempest-TestVolumeBootPattern-server-1053648815</nova:name>
Nov 29 20:39:13 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:39:11</nova:creationTime>
Nov 29 20:39:13 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:39:13 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:39:13 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:39:13 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:39:13 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:39:13 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:39:13 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:39:13 user nova-compute[75356]:       <nova:owner>
Nov 29 20:39:13 user nova-compute[75356]:         <nova:user uuid="081b00360a204be3bd6435807283f230">tempest-TestVolumeBootPattern-1627976633-project-member</nova:user>
Nov 29 20:39:13 user nova-compute[75356]:         <nova:project uuid="f6791b0c999846e2a22d5735f91ea1aa">tempest-TestVolumeBootPattern-1627976633</nova:project>
Nov 29 20:39:13 user nova-compute[75356]:       </nova:owner>
Nov 29 20:39:13 user nova-compute[75356]:       <nova:ports>
Nov 29 20:39:13 user nova-compute[75356]:         <nova:port uuid="b99c7a66-5c97-483e-bdaf-f5eef776fddd">
Nov 29 20:39:13 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 20:39:13 user nova-compute[75356]:         </nova:port>
Nov 29 20:39:13 user nova-compute[75356]:       </nova:ports>
Nov 29 20:39:13 user nova-compute[75356]:     </nova:instance>
Nov 29 20:39:13 user nova-compute[75356]:   </metadata>
Nov 29 20:39:13 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:39:13 user nova-compute[75356]:     <system>
Nov 29 20:39:13 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:39:13 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:39:13 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:39:13 user nova-compute[75356]:       <entry name="serial">6f31e740-f4b3-41be-b004-70c3d49459ea</entry>
Nov 29 20:39:13 user nova-compute[75356]:       <entry name="uuid">6f31e740-f4b3-41be-b004-70c3d49459ea</entry>
Nov 29 20:39:13 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:39:13 user nova-compute[75356]:     </system>
Nov 29 20:39:13 user nova-compute[75356]:   </sysinfo>
Nov 29 20:39:13 user nova-compute[75356]:   <os>
Nov 29 20:39:13 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:39:13 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:39:13 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:39:13 user nova-compute[75356]:   </os>
Nov 29 20:39:13 user nova-compute[75356]:   <features>
Nov 29 20:39:13 user nova-compute[75356]:     <acpi/>
Nov 29 20:39:13 user nova-compute[75356]:     <apic/>
Nov 29 20:39:13 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:39:13 user nova-compute[75356]:   </features>
Nov 29 20:39:13 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:39:13 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:39:13 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:39:13 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:39:13 user nova-compute[75356]:   </clock>
Nov 29 20:39:13 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:39:13 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:39:13 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:39:13 user nova-compute[75356]:   </cpu>
Nov 29 20:39:13 user nova-compute[75356]:   <devices>
Nov 29 20:39:13 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:39:13 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:39:13 user nova-compute[75356]:       <source dev="/dev/sde"/>
Nov 29 20:39:13 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:39:13 user nova-compute[75356]:       <serial>5dddc729-7896-482a-abe6-9c9d0deead79</serial>
Nov 29 20:39:13 user nova-compute[75356]:     </disk>
Nov 29 20:39:13 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:39:13 user nova-compute[75356]:       <mac address="fa:16:3e:ce:65:d0"/>
Nov 29 20:39:13 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:39:13 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:39:13 user nova-compute[75356]:       <target dev="tapb99c7a66-5c"/>
Nov 29 20:39:13 user nova-compute[75356]:     </interface>
Nov 29 20:39:13 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:39:13 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/6f31e740-f4b3-41be-b004-70c3d49459ea/console.log" append="off"/>
Nov 29 20:39:13 user nova-compute[75356]:     </serial>
Nov 29 20:39:13 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:39:13 user nova-compute[75356]:     <video>
Nov 29 20:39:13 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:39:13 user nova-compute[75356]:     </video>
Nov 29 20:39:13 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:39:13 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:39:13 user nova-compute[75356]:     </rng>
Nov 29 20:39:13 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:39:13 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:39:13 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:39:13 user nova-compute[75356]:     </memballoon>
Nov 29 20:39:13 user nova-compute[75356]:   </devices>
Nov 29 20:39:13 user nova-compute[75356]: </domain>
Nov 29 20:39:13 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:39:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1053648815',display_name='tempest-TestVolumeBootPattern-server-1053648815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1053648815',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0zsffzZhgXAi/NOnOb6jr5SbjRUa5Ws+6E3ecNSbb6yR1bA/I1Lldbh3v8Eu9yysHBBgvc3puTY35+MIoawU5+qPudnUjWfeo2D4YgfUZH7hVHtowFiKG6iSLDsjXIsA==',key_name='tempest-TestVolumeBootPattern-313405727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6791b0c999846e2a22d5735f91ea1aa',ramdisk_id='',reservation_id='r-ou9xg66l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1627976633',owner_user_name='tempest-TestVolumeBootPattern-1627976633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:39:04Z,user_data=None,user_id='081b00360a204be3bd6435807283f230',uuid=6f31e740-f4b3-41be-b004-70c3d49459ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "address": "fa:16:3e:ce:65:d0", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99c7a66-5c", "ovs_interfaceid": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converting VIF {"id": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "address": "fa:16:3e:ce:65:d0", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99c7a66-5c", "ovs_interfaceid": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:65:d0,bridge_name='br-int',has_traffic_filtering=True,id=b99c7a66-5c97-483e-bdaf-f5eef776fddd,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99c7a66-5c') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG os_vif [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:65:d0,bridge_name='br-int',has_traffic_filtering=True,id=b99c7a66-5c97-483e-bdaf-f5eef776fddd,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99c7a66-5c') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7935543e-3a28-5ae0-8bf6-bcb2046a6af1', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb99c7a66-5c, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb99c7a66-5c, col_values=(('qos', UUID('428a7173-0b0f-4d59-927d-6ba71893b47b')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb99c7a66-5c, col_values=(('external_ids', {'iface-id': 'b99c7a66-5c97-483e-bdaf-f5eef776fddd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:65:d0', 'vm-uuid': '6f31e740-f4b3-41be-b004-70c3d49459ea'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:13 user nova-compute[75356]: INFO os_vif [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:65:d0,bridge_name='br-int',has_traffic_filtering=True,id=b99c7a66-5c97-483e-bdaf-f5eef776fddd,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99c7a66-5c')
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 93183110-d2e2-4da7-ab7d-73378f5e0d42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance bf850b0d-88b6-4ec3-b3eb-df6195be2945 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance ffb04928-4f5f-4461-aa24-6363d1c9b941 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 27b79c6f-c024-4bca-b292-292b11d79329 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4c175716-be33-4d0c-8fd7-2e42ef55c8a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 6f31e740-f4b3-41be-b004-70c3d49459ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] No VIF found with MAC fa:16:3e:ce:65:d0, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:39:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.428s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:39:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:39:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:39:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:39:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:39:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:39:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:39:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-5398c651-d321-42b9-b56c-29384f2e9168 req-996216f5-3524-4ab5-b50d-77d7b78dddac service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Received event network-vif-plugged-b99c7a66-5c97-483e-bdaf-f5eef776fddd {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:39:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5398c651-d321-42b9-b56c-29384f2e9168 req-996216f5-3524-4ab5-b50d-77d7b78dddac service nova] Acquiring lock "6f31e740-f4b3-41be-b004-70c3d49459ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:39:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5398c651-d321-42b9-b56c-29384f2e9168 req-996216f5-3524-4ab5-b50d-77d7b78dddac service nova] Lock "6f31e740-f4b3-41be-b004-70c3d49459ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:39:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-5398c651-d321-42b9-b56c-29384f2e9168 req-996216f5-3524-4ab5-b50d-77d7b78dddac service nova] Lock "6f31e740-f4b3-41be-b004-70c3d49459ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:39:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-5398c651-d321-42b9-b56c-29384f2e9168 req-996216f5-3524-4ab5-b50d-77d7b78dddac service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] No waiting events found dispatching network-vif-plugged-b99c7a66-5c97-483e-bdaf-f5eef776fddd {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:39:15 user nova-compute[75356]: WARNING nova.compute.manager [req-5398c651-d321-42b9-b56c-29384f2e9168 req-996216f5-3524-4ab5-b50d-77d7b78dddac service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Received unexpected event network-vif-plugged-b99c7a66-5c97-483e-bdaf-f5eef776fddd for instance with vm_state building and task_state spawning.
Nov 29 20:39:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:16 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:39:16 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:39:16 user nova-compute[75356]: DEBUG nova.compute.manager [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:39:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:39:16 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Instance spawned successfully.
Nov 29 20:39:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:39:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:39:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:39:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:39:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:39:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:39:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:39:17 user nova-compute[75356]: INFO nova.compute.manager [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 29 20:39:17 user nova-compute[75356]: DEBUG nova.compute.manager [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:39:17 user nova-compute[75356]: DEBUG nova.compute.manager [req-ebab369b-877e-4e8e-9407-8e3effc6f13f req-b0986835-818b-4de0-8588-4557ce4219a5 service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Received event network-vif-plugged-b99c7a66-5c97-483e-bdaf-f5eef776fddd {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:39:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ebab369b-877e-4e8e-9407-8e3effc6f13f req-b0986835-818b-4de0-8588-4557ce4219a5 service nova] Acquiring lock "6f31e740-f4b3-41be-b004-70c3d49459ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:39:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ebab369b-877e-4e8e-9407-8e3effc6f13f req-b0986835-818b-4de0-8588-4557ce4219a5 service nova] Lock "6f31e740-f4b3-41be-b004-70c3d49459ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:39:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ebab369b-877e-4e8e-9407-8e3effc6f13f req-b0986835-818b-4de0-8588-4557ce4219a5 service nova] Lock "6f31e740-f4b3-41be-b004-70c3d49459ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:39:17 user nova-compute[75356]: DEBUG nova.compute.manager [req-ebab369b-877e-4e8e-9407-8e3effc6f13f req-b0986835-818b-4de0-8588-4557ce4219a5 service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] No waiting events found dispatching network-vif-plugged-b99c7a66-5c97-483e-bdaf-f5eef776fddd {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:39:17 user nova-compute[75356]: WARNING nova.compute.manager [req-ebab369b-877e-4e8e-9407-8e3effc6f13f req-b0986835-818b-4de0-8588-4557ce4219a5 service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Received unexpected event network-vif-plugged-b99c7a66-5c97-483e-bdaf-f5eef776fddd for instance with vm_state building and task_state spawning.
Nov 29 20:39:17 user nova-compute[75356]: INFO nova.compute.manager [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Took 14.20 seconds to build instance.
Nov 29 20:39:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-be301d1e-a0a7-49fe-989f-327b6e453329 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "6f31e740-f4b3-41be-b004-70c3d49459ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.298s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:39:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-b1521907-ae37-40d9-a96f-5c4058d040c5 req-617c0af6-1c52-463a-88f8-614f55ae9745 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Received event network-changed-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:39:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-b1521907-ae37-40d9-a96f-5c4058d040c5 req-617c0af6-1c52-463a-88f8-614f55ae9745 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Refreshing instance network info cache due to event network-changed-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:39:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b1521907-ae37-40d9-a96f-5c4058d040c5 req-617c0af6-1c52-463a-88f8-614f55ae9745 service nova] Acquiring lock "refresh_cache-4c175716-be33-4d0c-8fd7-2e42ef55c8a7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:39:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b1521907-ae37-40d9-a96f-5c4058d040c5 req-617c0af6-1c52-463a-88f8-614f55ae9745 service nova] Acquired lock "refresh_cache-4c175716-be33-4d0c-8fd7-2e42ef55c8a7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:39:19 user nova-compute[75356]: DEBUG nova.network.neutron [req-b1521907-ae37-40d9-a96f-5c4058d040c5 req-617c0af6-1c52-463a-88f8-614f55ae9745 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Refreshing network info cache for port f89e75d6-fcd9-48d5-a2dd-ecc8244536bb {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:39:19 user nova-compute[75356]: DEBUG nova.network.neutron [req-b1521907-ae37-40d9-a96f-5c4058d040c5 req-617c0af6-1c52-463a-88f8-614f55ae9745 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Updated VIF entry in instance network info cache for port f89e75d6-fcd9-48d5-a2dd-ecc8244536bb. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:39:19 user nova-compute[75356]: DEBUG nova.network.neutron [req-b1521907-ae37-40d9-a96f-5c4058d040c5 req-617c0af6-1c52-463a-88f8-614f55ae9745 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Updating instance_info_cache with network_info: [{"id": "f89e75d6-fcd9-48d5-a2dd-ecc8244536bb", "address": "fa:16:3e:27:c5:c1", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89e75d6-fc", "ovs_interfaceid": "f89e75d6-fcd9-48d5-a2dd-ecc8244536bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:39:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-b1521907-ae37-40d9-a96f-5c4058d040c5 req-617c0af6-1c52-463a-88f8-614f55ae9745 service nova] Releasing lock "refresh_cache-4c175716-be33-4d0c-8fd7-2e42ef55c8a7" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:39:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:39:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:39:21 user nova-compute[75356]: DEBUG nova.objects.instance [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lazy-loading 'flavor' on Instance uuid 4c175716-be33-4d0c-8fd7-2e42ef55c8a7 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:39:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:39:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:39:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:39:22 user nova-compute[75356]: INFO nova.compute.manager [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Attaching volume 7bd93b19-c563-4cf2-a402-98512fedf30f to /dev/vdb
Nov 29 20:39:22 user nova-compute[75356]: DEBUG os_brick.utils [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:39:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:22 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2507b98f-7bdf-4e62-97bc-0fa96a7f4cf5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:22 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f658d083-8619-4df7-a46f-cfbaa86f2914]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:22 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[80be5b0d-d4d6-4950-8a94-ef777407e1f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:22 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c60623c-a021-47a6-9bec-8b3b6278b148]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:39:22 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:39:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:22 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:39:22 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:39:22 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b39174-be2a-4c21-881e-8f926a006ae4]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:22 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:39:22 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:39:22 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:39:22 user nova-compute[75356]: DEBUG os_brick.utils [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:39:22 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Updating existing volume attachment record: a30f0623-088a-427b-becd-5eb813323346 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:39:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:27 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ffb04928-4f5f-4461-aa24-6363d1c9b941 is timed out.
Nov 29 20:39:27 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Successfully detached device vdb from instance ffb04928-4f5f-4461-aa24-6363d1c9b941 from the live domain config.
Nov 29 20:39:27 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GSxqMBlI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:39:27 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:39:27 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ea0018-1821-4e44-9578-6714e4919b6a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:750d221e-60f8-48eb-a0fe-fd3a580eb03e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:39:27 user nova-compute[75356]: No targets found.
Nov 29 20:39:27 user nova-compute[75356]: iSNS:
Nov 29 20:39:27 user nova-compute[75356]: No targets found.
Nov 29 20:39:27 user nova-compute[75356]: STATIC:
Nov 29 20:39:27 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c
Nov 29 20:39:27 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:39:27 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:39:27 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79
Nov 29 20:39:27 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:39:27 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:39:27 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479
Nov 29 20:39:27 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:39:27 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:39:27 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:750d221e-60f8-48eb-a0fe-fd3a580eb03e
Nov 29 20:39:27 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:39:27 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:39:27 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:39:27 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:39:27 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:39:27 user nova-compute[75356]: FIRMWARE:
Nov 29 20:39:27 user nova-compute[75356]: No targets found.
Nov 29 20:39:27 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:39:27 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:39:27 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef19c70-2bcb-4773-9f4a-7c55fdb32bd7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:750d221e-60f8-48eb-a0fe-fd3a580eb03e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2602af-4943-434d-8c60-424b41dce121]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750d221e-60f8-48eb-a0fe-fd3a580eb03e (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:39:27 user nova-compute[75356]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 (non-flash)
Nov 29 20:39:27 user nova-compute[75356]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:39:27 user nova-compute[75356]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 (non-flash)
Nov 29 20:39:27 user nova-compute[75356]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750d221e-60f8-48eb-a0fe-fd3a580eb03e (non-flash)
Nov 29 20:39:27 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:39:27 user nova-compute[75356]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 (non-flash)
Nov 29 20:39:27 user nova-compute[75356]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:39:27 user nova-compute[75356]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 (non-flash)
Nov 29 20:39:27 user nova-compute[75356]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750d221e-60f8-48eb-a0fe-fd3a580eb03e (non-flash)
Nov 29 20:39:27 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f83081c23b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479'): ({'sdc'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Removing single pathed devices sdc {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9a7dff-d87e-440f-bf7a-0d5a80489576]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fcb8a0-ddfb-47f5-902b-5d99afe10703]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Flushing IO for device /dev/sdc {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c613db6-134e-4890-b61b-deff7e9652c3]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b837c29b-71c2-455a-83c6-0beb611e2499]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[96308496-cedf-4ab2-9c59-0e2b9abd6240]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29fc403-2bec-4025-a6cc-0966206fe679]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479, portal: 172.16.0.220,3260]
Nov 29 20:39:27 user nova-compute[75356]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479, portal: 172.16.0.220,3260] successful.
Nov 29 20:39:27 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19e9ddab-dc95-48c5-bba1-32b2081a3479 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d503e4-b960-4df6-bf99-adc98a2339b9]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] <== disconnect_volume: return (364ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:39:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:28 user nova-compute[75356]: DEBUG nova.objects.instance [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lazy-loading 'flavor' on Instance uuid ffb04928-4f5f-4461-aa24-6363d1c9b941 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:39:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3611fa78-52b0-4190-9984-45999c9df6a0 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.827s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:39:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVQkJaZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:39:30 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:39:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:39:30 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:39:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:39:30 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[328937be-2684-40c8-a9b7-8d46b1ea25df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:39:30 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[72094bef-2550-4ae3-aadb-7a78f3379b55]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f] added
Nov 29 20:39:30 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b382f5-6887-472c-bbdc-dc3b49affbdc]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[751ab95f-3a52-4b38-9604-67e91c1f77f1]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uVQkJaZq {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uVQkJaZq" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f26613f-1410-445c-b582-f92817a693a4]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uVQkJaZq'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5027ca7b-8946-40fd-9985-dd667b50a561]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2d5ce9-6c42-42ef-9773-c886ddc6e5aa]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750d221e-60f8-48eb-a0fe-fd3a580eb03e (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d30bce1-f649-4be6-b5e6-ea220a0b2b37 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:39:30 user nova-compute[75356]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:39:30 user nova-compute[75356]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 (non-flash)
Nov 29 20:39:30 user nova-compute[75356]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750d221e-60f8-48eb-a0fe-fd3a580eb03e (non-flash)
Nov 29 20:39:30 user nova-compute[75356]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d30bce1-f649-4be6-b5e6-ea220a0b2b37 (non-flash)
Nov 29 20:39:30 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:39:30 user nova-compute[75356]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:39:30 user nova-compute[75356]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 (non-flash)
Nov 29 20:39:30 user nova-compute[75356]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750d221e-60f8-48eb-a0fe-fd3a580eb03e (non-flash)
Nov 29 20:39:30 user nova-compute[75356]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d30bce1-f649-4be6-b5e6-ea220a0b2b37 (non-flash)
Nov 29 20:39:30 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dc1892-e01f-4cd9-af67-55fa13e46cf4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f, portal: 172.16.0.220,3260]
Nov 29 20:39:30 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f, portal: 172.16.0.220,3260] successful.
Nov 29 20:39:30 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84d72e4-84c1-40ff-a2bb-fd848660cbc9]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afa85ce-53ae-4cea-bc5c-33e430ac2f86]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750d221e-60f8-48eb-a0fe-fd3a580eb03e (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d30bce1-f649-4be6-b5e6-ea220a0b2b37 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:39:30 user nova-compute[75356]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:39:30 user nova-compute[75356]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 (non-flash)
Nov 29 20:39:30 user nova-compute[75356]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750d221e-60f8-48eb-a0fe-fd3a580eb03e (non-flash)
Nov 29 20:39:30 user nova-compute[75356]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d30bce1-f649-4be6-b5e6-ea220a0b2b37 (non-flash)
Nov 29 20:39:30 user nova-compute[75356]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f (non-flash)
Nov 29 20:39:30 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:39:30 user nova-compute[75356]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:39:30 user nova-compute[75356]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 (non-flash)
Nov 29 20:39:30 user nova-compute[75356]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:750d221e-60f8-48eb-a0fe-fd3a580eb03e (non-flash)
Nov 29 20:39:30 user nova-compute[75356]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d30bce1-f649-4be6-b5e6-ea220a0b2b37 (non-flash)
Nov 29 20:39:30 user nova-compute[75356]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f (non-flash)
Nov 29 20:39:30 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] HCTL ('38', '-', '-', 0) found on session 51 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[70304c79-e2e5-48cd-9d2e-84679b4609a9]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:30 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Searching for a device in session 51 and hctl ['38', '*', '*', 0] yield: None {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:39:31 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Searching for a device in session 51 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:39:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVQkJaZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:39:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:39:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23332346264376438', 'path': '/dev/sdg'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:39:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332346264376438', 'path': '/dev/sdg'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:39:31 user nova-compute[75356]: DEBUG nova.objects.instance [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lazy-loading 'flavor' on Instance uuid 4c175716-be33-4d0c-8fd7-2e42ef55c8a7 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:39:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:39:31 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:39:31 user nova-compute[75356]:   <source dev="/dev/sdg"/>
Nov 29 20:39:31 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:39:31 user nova-compute[75356]:   <serial>7bd93b19-c563-4cf2-a402-98512fedf30f</serial>
Nov 29 20:39:31 user nova-compute[75356]: </disk>
Nov 29 20:39:31 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:39:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:39:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:39:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] No VIF found with MAC fa:16:3e:27:c5:c1, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:39:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cc842e05-1556-4548-b035-1af45ac83e87 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.263s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:39:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:39:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:39:33 user nova-compute[75356]: INFO nova.compute.manager [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Detaching volume 7bd93b19-c563-4cf2-a402-98512fedf30f
Nov 29 20:39:33 user nova-compute[75356]: INFO nova.virt.block_device [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Attempting to driver detach volume 7bd93b19-c563-4cf2-a402-98512fedf30f from mountpoint /dev/vdb
Nov 29 20:39:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Attempting to detach device vdb from instance 4c175716-be33-4d0c-8fd7-2e42ef55c8a7 from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:39:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:39:33 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:39:33 user nova-compute[75356]:   <source dev="/dev/sdg"/>
Nov 29 20:39:33 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:39:33 user nova-compute[75356]:   <serial>7bd93b19-c563-4cf2-a402-98512fedf30f</serial>
Nov 29 20:39:33 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:39:33 user nova-compute[75356]: </disk>
Nov 29 20:39:33 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:39:33 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Successfully detached device vdb from instance 4c175716-be33-4d0c-8fd7-2e42ef55c8a7 from the persistent domain config.
Nov 29 20:39:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4c175716-be33-4d0c-8fd7-2e42ef55c8a7 from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:39:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:39:33 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:39:33 user nova-compute[75356]:   <source dev="/dev/sdg"/>
Nov 29 20:39:33 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:39:33 user nova-compute[75356]:   <serial>7bd93b19-c563-4cf2-a402-98512fedf30f</serial>
Nov 29 20:39:33 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:39:33 user nova-compute[75356]: </disk>
Nov 29 20:39:33 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:39:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4c175716-be33-4d0c-8fd7-2e42ef55c8a7 {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:39:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:39:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:39:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:39:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:39:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:39:34 user nova-compute[75356]: INFO nova.compute.manager [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Terminating instance
Nov 29 20:39:34 user nova-compute[75356]: DEBUG nova.compute.manager [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:39:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:34 user nova-compute[75356]: DEBUG nova.compute.manager [req-f2fb54e3-bb0e-48ef-88bf-7195e5078b09 req-75ca6ace-9689-4ae1-9686-0e2269c46a7a service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received event network-vif-unplugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:39:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f2fb54e3-bb0e-48ef-88bf-7195e5078b09 req-75ca6ace-9689-4ae1-9686-0e2269c46a7a service nova] Acquiring lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:39:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f2fb54e3-bb0e-48ef-88bf-7195e5078b09 req-75ca6ace-9689-4ae1-9686-0e2269c46a7a service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:39:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f2fb54e3-bb0e-48ef-88bf-7195e5078b09 req-75ca6ace-9689-4ae1-9686-0e2269c46a7a service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:39:34 user nova-compute[75356]: DEBUG nova.compute.manager [req-f2fb54e3-bb0e-48ef-88bf-7195e5078b09 req-75ca6ace-9689-4ae1-9686-0e2269c46a7a service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] No waiting events found dispatching network-vif-unplugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:39:34 user nova-compute[75356]: DEBUG nova.compute.manager [req-f2fb54e3-bb0e-48ef-88bf-7195e5078b09 req-75ca6ace-9689-4ae1-9686-0e2269c46a7a service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received event network-vif-unplugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:39:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:35 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Instance destroyed successfully.
Nov 29 20:39:35 user nova-compute[75356]: DEBUG nova.objects.instance [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'resources' on Instance uuid bf850b0d-88b6-4ec3-b3eb-df6195be2945 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:39:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:32:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1279500512',display_name='tempest-ServerRescueNegativeTestJSON-server-1279500512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1279500512',id=38,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF11C4US8gSibeaQM27SECgiQU3I/sB2B86cuWv8uvblsz8cGE+2M7ux0RHT1RkjaiHOFsNsN1i6QktVOsaM1fhYGGMYME9YUYb7wz5LFi1TSv4w9oVpMrtHeAYjjVJ7wQ==',key_name='tempest-keypair-897338036',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34dff0986b1d47fdaf305c87e323d19e',ramdisk_id='',reservation_id='r-3fuhqa8w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1204717931',owner_user_name='tempest-ServerRescueNegativeTestJSON-1204717931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:36:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00cdfe6527e04f049b5e38685bc1f257',uuid=bf850b0d-88b6-4ec3-b3eb-df6195be2945,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "address": "fa:16:3e:57:b8:2a", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68da58a-ba", "ovs_interfaceid": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:39:35 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converting VIF {"id": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "address": "fa:16:3e:57:b8:2a", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc68da58a-ba", "ovs_interfaceid": "c68da58a-baf1-4054-8d8c-d0736ec173a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:39:35 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:b8:2a,bridge_name='br-int',has_traffic_filtering=True,id=c68da58a-baf1-4054-8d8c-d0736ec173a5,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc68da58a-ba') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:39:35 user nova-compute[75356]: DEBUG os_vif [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:b8:2a,bridge_name='br-int',has_traffic_filtering=True,id=c68da58a-baf1-4054-8d8c-d0736ec173a5,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc68da58a-ba') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:39:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc68da58a-ba, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:39:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:39:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4393cd68-62b5-4056-99ae-f8c3409fed99) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:39:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:39:35 user nova-compute[75356]: INFO os_vif [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:b8:2a,bridge_name='br-int',has_traffic_filtering=True,id=c68da58a-baf1-4054-8d8c-d0736ec173a5,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc68da58a-ba')
Nov 29 20:39:35 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Deleting instance files /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945_del
Nov 29 20:39:35 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Deletion of /opt/stack/data/nova/instances/bf850b0d-88b6-4ec3-b3eb-df6195be2945_del complete
Nov 29 20:39:35 user nova-compute[75356]: INFO nova.compute.manager [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 29 20:39:35 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:39:35 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:39:35 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:39:36 user nova-compute[75356]: DEBUG nova.compute.manager [req-7ce67ae7-c5e4-49a3-afa8-35ce186f5aa2 req-285401b6-1718-4138-923b-79975135205a service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received event network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:39:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7ce67ae7-c5e4-49a3-afa8-35ce186f5aa2 req-285401b6-1718-4138-923b-79975135205a service nova] Acquiring lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:39:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7ce67ae7-c5e4-49a3-afa8-35ce186f5aa2 req-285401b6-1718-4138-923b-79975135205a service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:39:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7ce67ae7-c5e4-49a3-afa8-35ce186f5aa2 req-285401b6-1718-4138-923b-79975135205a service nova] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:39:36 user nova-compute[75356]: DEBUG nova.compute.manager [req-7ce67ae7-c5e4-49a3-afa8-35ce186f5aa2 req-285401b6-1718-4138-923b-79975135205a service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] No waiting events found dispatching network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:39:36 user nova-compute[75356]: WARNING nova.compute.manager [req-7ce67ae7-c5e4-49a3-afa8-35ce186f5aa2 req-285401b6-1718-4138-923b-79975135205a service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received unexpected event network-vif-plugged-c68da58a-baf1-4054-8d8c-d0736ec173a5 for instance with vm_state active and task_state deleting.
Nov 29 20:39:36 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:39:36 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Took 1.51 seconds to deallocate network for instance.
Nov 29 20:39:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:39:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:39:37 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:39:37 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:39:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.598s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:39:37 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Deleted allocations for instance bf850b0d-88b6-4ec3-b3eb-df6195be2945
Nov 29 20:39:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-ebcbf3de-3795-4de4-bf9b-0469fda4309f tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "bf850b0d-88b6-4ec3-b3eb-df6195be2945" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.435s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:39:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:38 user nova-compute[75356]: DEBUG nova.compute.manager [req-eb022103-c903-4a23-955a-eaddb3926d0b req-5bbc2731-bc0a-4bd6-8a98-7495357aa57a service nova] [instance: bf850b0d-88b6-4ec3-b3eb-df6195be2945] Received event network-vif-deleted-c68da58a-baf1-4054-8d8c-d0736ec173a5 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:39:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:39:53 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4c175716-be33-4d0c-8fd7-2e42ef55c8a7 is timed out.
Nov 29 20:39:53 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Successfully detached device vdb from instance 4c175716-be33-4d0c-8fd7-2e42ef55c8a7 from the live domain config.
Nov 29 20:39:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVQkJaZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:39:53 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:39:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6938a80a-9495-4d3b-8b34-60cd91a89638]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:39:53 user nova-compute[75356]: No targets found.
Nov 29 20:39:53 user nova-compute[75356]: iSNS:
Nov 29 20:39:53 user nova-compute[75356]: No targets found.
Nov 29 20:39:53 user nova-compute[75356]: STATIC:
Nov 29 20:39:53 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f
Nov 29 20:39:53 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:39:53 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:39:53 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c
Nov 29 20:39:53 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:39:53 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:39:53 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79
Nov 29 20:39:53 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:39:53 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:39:53 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:39:53 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:39:53 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:39:53 user nova-compute[75356]: FIRMWARE:
Nov 29 20:39:53 user nova-compute[75356]: No targets found.
Nov 29 20:39:53 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:39:53 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:39:53 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f545a1e-edb9-4b98-ae9e-b03b83cfe71d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2183106a-a495-48a5-a6b6-b56b8223aca1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:39:53 user nova-compute[75356]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:39:53 user nova-compute[75356]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 (non-flash)
Nov 29 20:39:53 user nova-compute[75356]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f (non-flash)
Nov 29 20:39:53 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:39:53 user nova-compute[75356]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:39:53 user nova-compute[75356]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 (non-flash)
Nov 29 20:39:53 user nova-compute[75356]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f (non-flash)
Nov 29 20:39:53 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8308711870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f'): ({'sdg'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Removing single pathed devices sdg {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c033fc3-1181-42cc-814d-ae4c67063803]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ac3330-1652-4c0d-9c7a-8db2dd5980e3]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Flushing IO for device /dev/sdg {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2ad9b6-00fd-42ac-a449-74ab98d3c977]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb3491a-402c-4e49-be2f-2343d0b84d80]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] SCSI volumes sdg have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[45689571-cd99-4d26-aeb5-2bd7147ee8fd]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6092cf2c-bf29-4d97-928a-2f10cf41c15d]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f, portal: 172.16.0.220,3260]
Nov 29 20:39:53 user nova-compute[75356]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f, portal: 172.16.0.220,3260] successful.
Nov 29 20:39:53 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7bd93b19-c563-4cf2-a402-98512fedf30f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2681ed-6bbd-4e4f-8a72-e0d3a63f7d87]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] <== disconnect_volume: return (285ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:39:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:39:54 user nova-compute[75356]: DEBUG nova.objects.instance [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lazy-loading 'flavor' on Instance uuid 4c175716-be33-4d0c-8fd7-2e42ef55c8a7 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:39:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-4ebe0217-7835-4577-b623-8f11985835d8 tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.597s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:39:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "ffb04928-4f5f-4461-aa24-6363d1c9b941" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:01 user nova-compute[75356]: INFO nova.compute.manager [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Terminating instance
Nov 29 20:40:01 user nova-compute[75356]: DEBUG nova.compute.manager [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG nova.compute.manager [req-d3ef77af-4f86-4b36-9a0c-1833971c596a req-3675a914-ff9d-4304-b0bb-15b8434ddf94 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Received event network-vif-unplugged-65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d3ef77af-4f86-4b36-9a0c-1833971c596a req-3675a914-ff9d-4304-b0bb-15b8434ddf94 service nova] Acquiring lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d3ef77af-4f86-4b36-9a0c-1833971c596a req-3675a914-ff9d-4304-b0bb-15b8434ddf94 service nova] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d3ef77af-4f86-4b36-9a0c-1833971c596a req-3675a914-ff9d-4304-b0bb-15b8434ddf94 service nova] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG nova.compute.manager [req-d3ef77af-4f86-4b36-9a0c-1833971c596a req-3675a914-ff9d-4304-b0bb-15b8434ddf94 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] No waiting events found dispatching network-vif-unplugged-65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG nova.compute.manager [req-d3ef77af-4f86-4b36-9a0c-1833971c596a req-3675a914-ff9d-4304-b0bb-15b8434ddf94 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Received event network-vif-unplugged-65c10bc1-9ed3-4330-82bf-bb977579b739 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:40:01 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Instance destroyed successfully.
Nov 29 20:40:01 user nova-compute[75356]: DEBUG nova.objects.instance [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lazy-loading 'resources' on Instance uuid ffb04928-4f5f-4461-aa24-6363d1c9b941 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:34:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1231567600',display_name='tempest-TestMinimumBasicScenario-server-1231567600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1231567600',id=41,image_ref='6ee4f8ae-4cf2-4957-8248-d49911d42db6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBh2TlSBw89rfB0YmOzfQzT5wbEXRqpuSHLaV54eHLkkWwjH4CSC29qNd4qfM46vqxeJg8k40Euc1XZCyBWlQ2Aigpns1zqJF2EVhDaaoKJYdqrcJVI8YWk74Y8FzB8E4g==',key_name='tempest-TestMinimumBasicScenario-436042911',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11b97f9fbbb34b22ab013e1892dc91c1',ramdisk_id='',reservation_id='r-vxz80l0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ee4f8ae-4cf2-4957-8248-d49911d42db6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1742449158',owner_user_name='tempest-TestMinimumBasicScenario-1742449158-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:37:22Z,user_data=None,user_id='4a111049bab1401cbe074a03692b43af',uuid=ffb04928-4f5f-4461-aa24-6363d1c9b941,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65c10bc1-9ed3-4330-82bf-bb977579b739", "address": "fa:16:3e:83:e1:42", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c10bc1-9e", "ovs_interfaceid": "65c10bc1-9ed3-4330-82bf-bb977579b739", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Converting VIF {"id": "65c10bc1-9ed3-4330-82bf-bb977579b739", "address": "fa:16:3e:83:e1:42", "network": {"id": "7408e82d-2d0b-45c2-8f7d-1b4c69cc6243", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2105065641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11b97f9fbbb34b22ab013e1892dc91c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65c10bc1-9e", "ovs_interfaceid": "65c10bc1-9ed3-4330-82bf-bb977579b739", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:e1:42,bridge_name='br-int',has_traffic_filtering=True,id=65c10bc1-9ed3-4330-82bf-bb977579b739,network=Network(7408e82d-2d0b-45c2-8f7d-1b4c69cc6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65c10bc1-9e') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG os_vif [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:e1:42,bridge_name='br-int',has_traffic_filtering=True,id=65c10bc1-9ed3-4330-82bf-bb977579b739,network=Network(7408e82d-2d0b-45c2-8f7d-1b4c69cc6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65c10bc1-9e') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65c10bc1-9e, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ee92fd8-a138-40ae-985d-9a4027a6bc58) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:40:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:40:01 user nova-compute[75356]: INFO os_vif [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:e1:42,bridge_name='br-int',has_traffic_filtering=True,id=65c10bc1-9ed3-4330-82bf-bb977579b739,network=Network(7408e82d-2d0b-45c2-8f7d-1b4c69cc6243),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65c10bc1-9e')
Nov 29 20:40:01 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Deleting instance files /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941_del
Nov 29 20:40:01 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Deletion of /opt/stack/data/nova/instances/ffb04928-4f5f-4461-aa24-6363d1c9b941_del complete
Nov 29 20:40:02 user nova-compute[75356]: INFO nova.compute.manager [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 29 20:40:02 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:40:02 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:40:02 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:40:02 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:40:02 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Took 0.52 seconds to deallocate network for instance.
Nov 29 20:40:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:02 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:40:02 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:40:02 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:03 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Deleted allocations for instance ffb04928-4f5f-4461-aa24-6363d1c9b941
Nov 29 20:40:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-6f30da87-4b1e-425f-b6a8-414962accc83 tempest-TestMinimumBasicScenario-1742449158 tempest-TestMinimumBasicScenario-1742449158-project-member] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.334s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:03 user nova-compute[75356]: DEBUG nova.compute.manager [req-2c4041bf-fa28-4acc-8cf4-25d0513c21e0 req-0b558cc8-6eab-437d-953b-0254099820a5 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Received event network-vif-plugged-65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:40:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2c4041bf-fa28-4acc-8cf4-25d0513c21e0 req-0b558cc8-6eab-437d-953b-0254099820a5 service nova] Acquiring lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2c4041bf-fa28-4acc-8cf4-25d0513c21e0 req-0b558cc8-6eab-437d-953b-0254099820a5 service nova] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:03 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2c4041bf-fa28-4acc-8cf4-25d0513c21e0 req-0b558cc8-6eab-437d-953b-0254099820a5 service nova] Lock "ffb04928-4f5f-4461-aa24-6363d1c9b941-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:03 user nova-compute[75356]: DEBUG nova.compute.manager [req-2c4041bf-fa28-4acc-8cf4-25d0513c21e0 req-0b558cc8-6eab-437d-953b-0254099820a5 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] No waiting events found dispatching network-vif-plugged-65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:40:03 user nova-compute[75356]: WARNING nova.compute.manager [req-2c4041bf-fa28-4acc-8cf4-25d0513c21e0 req-0b558cc8-6eab-437d-953b-0254099820a5 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Received unexpected event network-vif-plugged-65c10bc1-9ed3-4330-82bf-bb977579b739 for instance with vm_state deleted and task_state None.
Nov 29 20:40:03 user nova-compute[75356]: DEBUG nova.compute.manager [req-2c4041bf-fa28-4acc-8cf4-25d0513c21e0 req-0b558cc8-6eab-437d-953b-0254099820a5 service nova] [instance: ffb04928-4f5f-4461-aa24-6363d1c9b941] Received event network-vif-deleted-65c10bc1-9ed3-4330-82bf-bb977579b739 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:40:05 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:40:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:08 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:40:08 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:40:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-93183110-d2e2-4da7-ab7d-73378f5e0d42" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:40:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-93183110-d2e2-4da7-ab7d-73378f5e0d42" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:40:08 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:40:08 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Updating instance_info_cache with network_info: [{"id": "a9883307-4927-4472-932e-b7a9354d5fe8", "address": "fa:16:3e:80:43:0b", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9883307-49", "ovs_interfaceid": "a9883307-4927-4472-932e-b7a9354d5fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:40:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-93183110-d2e2-4da7-ab7d-73378f5e0d42" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:40:08 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:40:10 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:40:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:10 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:40:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:40:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:40:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:40:11 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:12 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:40:12 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:40:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=8299MB free_disk=24.948684692382812GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:40:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:40:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:40:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 93183110-d2e2-4da7-ab7d-73378f5e0d42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:40:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 27b79c6f-c024-4bca-b292-292b11d79329 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:40:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4c175716-be33-4d0c-8fd7-2e42ef55c8a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:40:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 6f31e740-f4b3-41be-b004-70c3d49459ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:40:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:40:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:40:13 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:40:13 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:40:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:40:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:40:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:40:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:40:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:40:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:40:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquiring lock "28f5dcc3-db77-4c65-87af-e300f99d2be5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquiring lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:14 user nova-compute[75356]: INFO nova.compute.manager [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Terminating instance
Nov 29 20:40:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:40:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-663eff85-ee87-4448-8215-8a1ce258caaa req-9dc9b538-4abc-4e32-836d-e4a571d02396 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received event network-vif-unplugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-663eff85-ee87-4448-8215-8a1ce258caaa req-9dc9b538-4abc-4e32-836d-e4a571d02396 service nova] Acquiring lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-663eff85-ee87-4448-8215-8a1ce258caaa req-9dc9b538-4abc-4e32-836d-e4a571d02396 service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-663eff85-ee87-4448-8215-8a1ce258caaa req-9dc9b538-4abc-4e32-836d-e4a571d02396 service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-663eff85-ee87-4448-8215-8a1ce258caaa req-9dc9b538-4abc-4e32-836d-e4a571d02396 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] No waiting events found dispatching network-vif-unplugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-663eff85-ee87-4448-8215-8a1ce258caaa req-9dc9b538-4abc-4e32-836d-e4a571d02396 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received event network-vif-unplugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:15 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Instance destroyed successfully.
Nov 29 20:40:15 user nova-compute[75356]: DEBUG nova.objects.instance [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lazy-loading 'resources' on Instance uuid 28f5dcc3-db77-4c65-87af-e300f99d2be5 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:17:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-598510486',display_name='tempest-ServerStableDeviceRescueTest-server-598510486',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-598510486',id=4,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxONYR7US0Zqc+k52oEx3HULG21Vb3SacYC5A1QxASviLskRyecdFv7MixuujXnSWxHTX4y8h2pNxHKdXKC80agpyrF7M04aMiRUDOy/8e5yjPGD6zvwZDgFznjov/1Kw==',key_name='tempest-keypair-1732727552',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:21:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45448e5cb4e84c14b1114846a6ccbdce',ramdisk_id='',reservation_id='r-9t7k0w0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1008853523',owner_user_name='tempest-ServerStableDeviceRescueTest-1008853523-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd40c898d11b440ca45ab29e8e6c7721',uuid=28f5dcc3-db77-4c65-87af-e300f99d2be5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "address": "fa:16:3e:6b:b2:4e", "network": {"id": "27a8d395-36c8-4f27-89cf-f5019ccbf9a2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45448e5cb4e84c14b1114846a6ccbdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ec4756-3f", "ovs_interfaceid": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Converting VIF {"id": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "address": "fa:16:3e:6b:b2:4e", "network": {"id": "27a8d395-36c8-4f27-89cf-f5019ccbf9a2", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1360477980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45448e5cb4e84c14b1114846a6ccbdce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ec4756-3f", "ovs_interfaceid": "d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:b2:4e,bridge_name='br-int',has_traffic_filtering=True,id=d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e,network=Network(27a8d395-36c8-4f27-89cf-f5019ccbf9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ec4756-3f') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG os_vif [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:b2:4e,bridge_name='br-int',has_traffic_filtering=True,id=d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e,network=Network(27a8d395-36c8-4f27-89cf-f5019ccbf9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ec4756-3f') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6ec4756-3f, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e2cb7e4d-4521-45e1-8df9-02185e4e551c) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:40:15 user nova-compute[75356]: INFO os_vif [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:b2:4e,bridge_name='br-int',has_traffic_filtering=True,id=d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e,network=Network(27a8d395-36c8-4f27-89cf-f5019ccbf9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ec4756-3f')
Nov 29 20:40:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoKFtdDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:40:15 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:40:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbdc287-a406-4d59-b137-57977cdf0b5f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:40:15 user nova-compute[75356]: No targets found.
Nov 29 20:40:15 user nova-compute[75356]: iSNS:
Nov 29 20:40:15 user nova-compute[75356]: No targets found.
Nov 29 20:40:15 user nova-compute[75356]: STATIC:
Nov 29 20:40:15 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c
Nov 29 20:40:15 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:40:15 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:40:15 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79
Nov 29 20:40:15 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:40:15 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:40:15 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957
Nov 29 20:40:15 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:40:15 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:40:15 user nova-compute[75356]: FIRMWARE:
Nov 29 20:40:15 user nova-compute[75356]: No targets found.
Nov 29 20:40:15 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:40:15 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:40:15 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[405ca1d9-ad40-4e36-abc8-a3837d4e0928]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[56abf21f-27fc-4665-9e58-8f2dba60ac3d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:40:15 user nova-compute[75356]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:40:15 user nova-compute[75356]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 (non-flash)
Nov 29 20:40:15 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 (non-flash)
Nov 29 20:40:15 user nova-compute[75356]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:40:15 user nova-compute[75356]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 (non-flash)
Nov 29 20:40:15 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830818d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957'): ({'sdb'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Removing single pathed devices sdb {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[807f17fe-7a97-4f81-83cf-5780790b5bd0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e05c66c-c241-49c4-9dfe-1abd86ffade3]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Flushing IO for device /dev/sdb {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e574e47f-6037-411b-a3c2-bec49eec107b]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.030s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[529dfb7d-0816-4413-ae3e-916d37707139]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] SCSI volumes sdb have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62d381d-5fab-485c-abfc-53ab2f95fa45]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bdbfb2-f62d-40e3-8d71-594194ec22e0]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957, portal: 172.16.0.220,3260]
Nov 29 20:40:15 user nova-compute[75356]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957, portal: 172.16.0.220,3260] successful.
Nov 29 20:40:15 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b4bf51-31c9-4811-8217-6e19e7a97957 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e64e0df-4858-4366-9a1d-aac30d44d206]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] <== disconnect_volume: return (326ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:40:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:40:15 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Deleting instance files /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5_del
Nov 29 20:40:15 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Deletion of /opt/stack/data/nova/instances/28f5dcc3-db77-4c65-87af-e300f99d2be5_del complete
Nov 29 20:40:16 user nova-compute[75356]: INFO nova.compute.manager [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 29 20:40:16 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:40:16 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:40:16 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:40:16 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:40:16 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:40:16 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Took 0.69 seconds to deallocate network for instance.
Nov 29 20:40:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-524c44c5-171b-480b-bd74-3d2384b1f532 req-f476ef6c-a7eb-4947-b2ec-490ba2d43934 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received event network-vif-deleted-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:40:16 user nova-compute[75356]: INFO nova.compute.manager [req-524c44c5-171b-480b-bd74-3d2384b1f532 req-f476ef6c-a7eb-4947-b2ec-490ba2d43934 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Neutron deleted interface d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e; detaching it from the instance and deleting it from the info cache
Nov 29 20:40:16 user nova-compute[75356]: DEBUG nova.network.neutron [req-524c44c5-171b-480b-bd74-3d2384b1f532 req-f476ef6c-a7eb-4947-b2ec-490ba2d43934 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:40:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-524c44c5-171b-480b-bd74-3d2384b1f532 req-f476ef6c-a7eb-4947-b2ec-490ba2d43934 service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Detach interface failed, port_id=d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e, reason: Instance 28f5dcc3-db77-4c65-87af-e300f99d2be5 could not be found. {{(pid=75356) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 20:40:17 user nova-compute[75356]: DEBUG nova.compute.manager [req-c1a06a00-dcf0-4d23-8e46-339da87a384b req-75e6170e-4973-4fe5-94b8-42a05a767f5b service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received event network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:40:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c1a06a00-dcf0-4d23-8e46-339da87a384b req-75e6170e-4973-4fe5-94b8-42a05a767f5b service nova] Acquiring lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c1a06a00-dcf0-4d23-8e46-339da87a384b req-75e6170e-4973-4fe5-94b8-42a05a767f5b service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c1a06a00-dcf0-4d23-8e46-339da87a384b req-75e6170e-4973-4fe5-94b8-42a05a767f5b service nova] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:17 user nova-compute[75356]: DEBUG nova.compute.manager [req-c1a06a00-dcf0-4d23-8e46-339da87a384b req-75e6170e-4973-4fe5-94b8-42a05a767f5b service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] No waiting events found dispatching network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:40:17 user nova-compute[75356]: WARNING nova.compute.manager [req-c1a06a00-dcf0-4d23-8e46-339da87a384b req-75e6170e-4973-4fe5-94b8-42a05a767f5b service nova] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Received unexpected event network-vif-plugged-d6ec4756-3f7e-4ae2-b00b-a0141eff9b8e for instance with vm_state active and task_state deleting.
Nov 29 20:40:17 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:40:17 user nova-compute[75356]: INFO nova.compute.manager [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] [instance: 28f5dcc3-db77-4c65-87af-e300f99d2be5] Took 0.75 seconds to detach 1 volumes for instance.
Nov 29 20:40:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:17 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:40:17 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:40:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:17 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Deleted allocations for instance 28f5dcc3-db77-4c65-87af-e300f99d2be5
Nov 29 20:40:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3f2e3a19-617e-479d-a90b-0d6fcb8f11d8 tempest-ServerStableDeviceRescueTest-1008853523 tempest-ServerStableDeviceRescueTest-1008853523-project-member] Lock "28f5dcc3-db77-4c65-87af-e300f99d2be5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.111s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:23 user nova-compute[75356]: INFO nova.compute.manager [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Terminating instance
Nov 29 20:40:23 user nova-compute[75356]: DEBUG nova.compute.manager [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:40:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:23 user nova-compute[75356]: DEBUG nova.compute.manager [req-acc3a685-72df-4845-b2e6-dc36c5f474e5 req-94fe1820-a916-4514-81f3-b144555c179b service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Received event network-vif-unplugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:40:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-acc3a685-72df-4845-b2e6-dc36c5f474e5 req-94fe1820-a916-4514-81f3-b144555c179b service nova] Acquiring lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-acc3a685-72df-4845-b2e6-dc36c5f474e5 req-94fe1820-a916-4514-81f3-b144555c179b service nova] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-acc3a685-72df-4845-b2e6-dc36c5f474e5 req-94fe1820-a916-4514-81f3-b144555c179b service nova] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:23 user nova-compute[75356]: DEBUG nova.compute.manager [req-acc3a685-72df-4845-b2e6-dc36c5f474e5 req-94fe1820-a916-4514-81f3-b144555c179b service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] No waiting events found dispatching network-vif-unplugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:40:23 user nova-compute[75356]: DEBUG nova.compute.manager [req-acc3a685-72df-4845-b2e6-dc36c5f474e5 req-94fe1820-a916-4514-81f3-b144555c179b service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Received event network-vif-unplugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:24 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Instance destroyed successfully.
Nov 29 20:40:24 user nova-compute[75356]: DEBUG nova.objects.instance [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lazy-loading 'resources' on Instance uuid 4c175716-be33-4d0c-8fd7-2e42ef55c8a7 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:37:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1281466358',display_name='tempest-AttachVolumeNegativeTest-server-1281466358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1281466358',id=43,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6EhJRbRKcjYJUMyguQpZy/4Kg53vwvbjwNo38IBfsXtNqZgJ+BAV2UHN5vkHcawBtC9LypHcFHwpe2Z+SgxVhr5xBJ5d3fWt/gLjbFg+09OGvm6qxTB5o4DBZmz/3Cyw==',key_name='tempest-keypair-224054888',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:37:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='076539532d4847719e7fcf4165872bbe',ramdisk_id='',reservation_id='r-5twtev4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1182074567',owner_user_name='tempest-AttachVolumeNegativeTest-1182074567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:37:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbdba4f436df4dbb896258c4f4d6b180',uuid=4c175716-be33-4d0c-8fd7-2e42ef55c8a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f89e75d6-fcd9-48d5-a2dd-ecc8244536bb", "address": "fa:16:3e:27:c5:c1", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89e75d6-fc", "ovs_interfaceid": "f89e75d6-fcd9-48d5-a2dd-ecc8244536bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converting VIF {"id": "f89e75d6-fcd9-48d5-a2dd-ecc8244536bb", "address": "fa:16:3e:27:c5:c1", "network": {"id": "d8908ba1-d36b-4584-a61a-25bf3f4ef324", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111452375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "076539532d4847719e7fcf4165872bbe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf89e75d6-fc", "ovs_interfaceid": "f89e75d6-fcd9-48d5-a2dd-ecc8244536bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:c5:c1,bridge_name='br-int',has_traffic_filtering=True,id=f89e75d6-fcd9-48d5-a2dd-ecc8244536bb,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf89e75d6-fc') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG os_vif [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:c5:c1,bridge_name='br-int',has_traffic_filtering=True,id=f89e75d6-fcd9-48d5-a2dd-ecc8244536bb,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf89e75d6-fc') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf89e75d6-fc, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0793481-bffc-42fd-b92f-408b6c797627) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:24 user nova-compute[75356]: INFO os_vif [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:c5:c1,bridge_name='br-int',has_traffic_filtering=True,id=f89e75d6-fcd9-48d5-a2dd-ecc8244536bb,network=Network(d8908ba1-d36b-4584-a61a-25bf3f4ef324),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf89e75d6-fc')
Nov 29 20:40:24 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Deleting instance files /opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7_del
Nov 29 20:40:24 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Deletion of /opt/stack/data/nova/instances/4c175716-be33-4d0c-8fd7-2e42ef55c8a7_del complete
Nov 29 20:40:24 user nova-compute[75356]: INFO nova.compute.manager [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 29 20:40:24 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:40:25 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Took 0.75 seconds to deallocate network for instance.
Nov 29 20:40:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-a5e7339d-5149-43ee-bcd7-43f11603fac2 req-346470fb-e117-4fbc-baab-c516a3d30b75 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Received event network-vif-deleted-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:40:25 user nova-compute[75356]: INFO nova.compute.manager [req-a5e7339d-5149-43ee-bcd7-43f11603fac2 req-346470fb-e117-4fbc-baab-c516a3d30b75 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Neutron deleted interface f89e75d6-fcd9-48d5-a2dd-ecc8244536bb; detaching it from the instance and deleting it from the info cache
Nov 29 20:40:25 user nova-compute[75356]: DEBUG nova.network.neutron [req-a5e7339d-5149-43ee-bcd7-43f11603fac2 req-346470fb-e117-4fbc-baab-c516a3d30b75 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-a5e7339d-5149-43ee-bcd7-43f11603fac2 req-346470fb-e117-4fbc-baab-c516a3d30b75 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Detach interface failed, port_id=f89e75d6-fcd9-48d5-a2dd-ecc8244536bb, reason: Instance 4c175716-be33-4d0c-8fd7-2e42ef55c8a7 could not be found. {{(pid=75356) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:25 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Deleted allocations for instance 4c175716-be33-4d0c-8fd7-2e42ef55c8a7
Nov 29 20:40:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-20a84347-12f6-46d6-852d-ccd1df47ebdb tempest-AttachVolumeNegativeTest-1182074567 tempest-AttachVolumeNegativeTest-1182074567-project-member] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.041s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Received event network-vif-plugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] Acquiring lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] No waiting events found dispatching network-vif-plugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:40:25 user nova-compute[75356]: WARNING nova.compute.manager [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Received unexpected event network-vif-plugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb for instance with vm_state deleted and task_state None.
Nov 29 20:40:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Received event network-vif-plugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] Acquiring lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] No waiting events found dispatching network-vif-plugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:40:25 user nova-compute[75356]: WARNING nova.compute.manager [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Received unexpected event network-vif-plugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb for instance with vm_state deleted and task_state None.
Nov 29 20:40:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Received event network-vif-plugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] Acquiring lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] No waiting events found dispatching network-vif-plugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:40:25 user nova-compute[75356]: WARNING nova.compute.manager [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Received unexpected event network-vif-plugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb for instance with vm_state deleted and task_state None.
Nov 29 20:40:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Received event network-vif-unplugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] Acquiring lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] No waiting events found dispatching network-vif-unplugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:40:25 user nova-compute[75356]: WARNING nova.compute.manager [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Received unexpected event network-vif-unplugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb for instance with vm_state deleted and task_state None.
Nov 29 20:40:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Received event network-vif-plugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] Acquiring lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] Lock "4c175716-be33-4d0c-8fd7-2e42ef55c8a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] No waiting events found dispatching network-vif-plugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:40:25 user nova-compute[75356]: WARNING nova.compute.manager [req-1fd30ef3-37df-4951-a238-104a928806dc req-3b8b0a61-785b-48df-889e-d8a1a8239ec4 service nova] [instance: 4c175716-be33-4d0c-8fd7-2e42ef55c8a7] Received unexpected event network-vif-plugged-f89e75d6-fcd9-48d5-a2dd-ecc8244536bb for instance with vm_state deleted and task_state None.
Nov 29 20:40:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:40:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "93183110-d2e2-4da7-ab7d-73378f5e0d42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:34 user nova-compute[75356]: INFO nova.compute.manager [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Terminating instance
Nov 29 20:40:34 user nova-compute[75356]: DEBUG nova.compute.manager [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:40:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:35 user nova-compute[75356]: DEBUG nova.compute.manager [req-91e77c89-13fb-4915-bc1b-aa9fa45b8e8c req-91d95584-b45e-40d0-a9df-4a71838ee370 service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Received event network-vif-unplugged-a9883307-4927-4472-932e-b7a9354d5fe8 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:40:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-91e77c89-13fb-4915-bc1b-aa9fa45b8e8c req-91d95584-b45e-40d0-a9df-4a71838ee370 service nova] Acquiring lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-91e77c89-13fb-4915-bc1b-aa9fa45b8e8c req-91d95584-b45e-40d0-a9df-4a71838ee370 service nova] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-91e77c89-13fb-4915-bc1b-aa9fa45b8e8c req-91d95584-b45e-40d0-a9df-4a71838ee370 service nova] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:35 user nova-compute[75356]: DEBUG nova.compute.manager [req-91e77c89-13fb-4915-bc1b-aa9fa45b8e8c req-91d95584-b45e-40d0-a9df-4a71838ee370 service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] No waiting events found dispatching network-vif-unplugged-a9883307-4927-4472-932e-b7a9354d5fe8 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:40:35 user nova-compute[75356]: DEBUG nova.compute.manager [req-91e77c89-13fb-4915-bc1b-aa9fa45b8e8c req-91d95584-b45e-40d0-a9df-4a71838ee370 service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Received event network-vif-unplugged-a9883307-4927-4472-932e-b7a9354d5fe8 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:40:35 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Instance destroyed successfully.
Nov 29 20:40:35 user nova-compute[75356]: DEBUG nova.objects.instance [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'resources' on Instance uuid 93183110-d2e2-4da7-ab7d-73378f5e0d42 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:40:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:24:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-674467598',display_name='tempest-ServerRescueNegativeTestJSON-server-674467598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-674467598',id=23,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:26:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34dff0986b1d47fdaf305c87e323d19e',ramdisk_id='',reservation_id='r-ri9bq1p5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1204717931',owner_user_name='tempest-ServerRescueNegativeTestJSON-1204717931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:26:22Z,user_data=None,user_id='00cdfe6527e04f049b5e38685bc1f257',uuid=93183110-d2e2-4da7-ab7d-73378f5e0d42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "a9883307-4927-4472-932e-b7a9354d5fe8", "address": "fa:16:3e:80:43:0b", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9883307-49", "ovs_interfaceid": "a9883307-4927-4472-932e-b7a9354d5fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:40:35 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converting VIF {"id": "a9883307-4927-4472-932e-b7a9354d5fe8", "address": "fa:16:3e:80:43:0b", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9883307-49", "ovs_interfaceid": "a9883307-4927-4472-932e-b7a9354d5fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:40:35 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:43:0b,bridge_name='br-int',has_traffic_filtering=True,id=a9883307-4927-4472-932e-b7a9354d5fe8,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9883307-49') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:40:35 user nova-compute[75356]: DEBUG os_vif [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:43:0b,bridge_name='br-int',has_traffic_filtering=True,id=a9883307-4927-4472-932e-b7a9354d5fe8,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9883307-49') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:40:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9883307-49, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:40:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:40:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b14c541b-316a-4490-8fdf-b96947cad906) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:40:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:35 user nova-compute[75356]: INFO os_vif [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:43:0b,bridge_name='br-int',has_traffic_filtering=True,id=a9883307-4927-4472-932e-b7a9354d5fe8,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9883307-49')
Nov 29 20:40:35 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Deleting instance files /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42_del
Nov 29 20:40:35 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Deletion of /opt/stack/data/nova/instances/93183110-d2e2-4da7-ab7d-73378f5e0d42_del complete
Nov 29 20:40:35 user nova-compute[75356]: INFO nova.compute.manager [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 29 20:40:35 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:40:35 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:40:35 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:40:36 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:40:36 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Took 0.61 seconds to deallocate network for instance.
Nov 29 20:40:36 user nova-compute[75356]: DEBUG nova.compute.manager [req-59210e97-aa0a-48eb-865b-5d4081a3f54c req-0d68d526-ad6b-43d6-84f0-3917cb571fcd service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Received event network-vif-deleted-a9883307-4927-4472-932e-b7a9354d5fe8 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:40:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:36 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:40:36 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:40:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:36 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Deleted allocations for instance 93183110-d2e2-4da7-ab7d-73378f5e0d42
Nov 29 20:40:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-54896a8f-1db0-4666-9c56-8565a64d00a7 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.216s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:37 user nova-compute[75356]: DEBUG nova.compute.manager [req-385d7dc3-22f4-44f9-be68-cc41c5af5f01 req-57d79cd2-1e51-43a0-967e-e6e00dc798a2 service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Received event network-vif-plugged-a9883307-4927-4472-932e-b7a9354d5fe8 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:40:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-385d7dc3-22f4-44f9-be68-cc41c5af5f01 req-57d79cd2-1e51-43a0-967e-e6e00dc798a2 service nova] Acquiring lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-385d7dc3-22f4-44f9-be68-cc41c5af5f01 req-57d79cd2-1e51-43a0-967e-e6e00dc798a2 service nova] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-385d7dc3-22f4-44f9-be68-cc41c5af5f01 req-57d79cd2-1e51-43a0-967e-e6e00dc798a2 service nova] Lock "93183110-d2e2-4da7-ab7d-73378f5e0d42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:37 user nova-compute[75356]: DEBUG nova.compute.manager [req-385d7dc3-22f4-44f9-be68-cc41c5af5f01 req-57d79cd2-1e51-43a0-967e-e6e00dc798a2 service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] No waiting events found dispatching network-vif-plugged-a9883307-4927-4472-932e-b7a9354d5fe8 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:40:37 user nova-compute[75356]: WARNING nova.compute.manager [req-385d7dc3-22f4-44f9-be68-cc41c5af5f01 req-57d79cd2-1e51-43a0-967e-e6e00dc798a2 service nova] [instance: 93183110-d2e2-4da7-ab7d-73378f5e0d42] Received unexpected event network-vif-plugged-a9883307-4927-4472-932e-b7a9354d5fe8 for instance with vm_state deleted and task_state None.
Nov 29 20:40:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:40:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:40:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:54 user nova-compute[75356]: DEBUG nova.compute.manager [req-c5d39592-8624-4306-b0eb-d046a68f1eec req-5119203d-7cc1-4b1e-b118-8c653006a963 service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Received event network-changed-b99c7a66-5c97-483e-bdaf-f5eef776fddd {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:40:54 user nova-compute[75356]: DEBUG nova.compute.manager [req-c5d39592-8624-4306-b0eb-d046a68f1eec req-5119203d-7cc1-4b1e-b118-8c653006a963 service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Refreshing instance network info cache due to event network-changed-b99c7a66-5c97-483e-bdaf-f5eef776fddd. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:40:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c5d39592-8624-4306-b0eb-d046a68f1eec req-5119203d-7cc1-4b1e-b118-8c653006a963 service nova] Acquiring lock "refresh_cache-6f31e740-f4b3-41be-b004-70c3d49459ea" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:40:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c5d39592-8624-4306-b0eb-d046a68f1eec req-5119203d-7cc1-4b1e-b118-8c653006a963 service nova] Acquired lock "refresh_cache-6f31e740-f4b3-41be-b004-70c3d49459ea" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:40:54 user nova-compute[75356]: DEBUG nova.network.neutron [req-c5d39592-8624-4306-b0eb-d046a68f1eec req-5119203d-7cc1-4b1e-b118-8c653006a963 service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Refreshing network info cache for port b99c7a66-5c97-483e-bdaf-f5eef776fddd {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:40:55 user nova-compute[75356]: DEBUG nova.network.neutron [req-c5d39592-8624-4306-b0eb-d046a68f1eec req-5119203d-7cc1-4b1e-b118-8c653006a963 service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Updated VIF entry in instance network info cache for port b99c7a66-5c97-483e-bdaf-f5eef776fddd. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:40:55 user nova-compute[75356]: DEBUG nova.network.neutron [req-c5d39592-8624-4306-b0eb-d046a68f1eec req-5119203d-7cc1-4b1e-b118-8c653006a963 service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Updating instance_info_cache with network_info: [{"id": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "address": "fa:16:3e:ce:65:d0", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99c7a66-5c", "ovs_interfaceid": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:40:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c5d39592-8624-4306-b0eb-d046a68f1eec req-5119203d-7cc1-4b1e-b118-8c653006a963 service nova] Releasing lock "refresh_cache-6f31e740-f4b3-41be-b004-70c3d49459ea" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:40:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:56 user nova-compute[75356]: DEBUG nova.compute.manager [req-7e7c0d7e-58ac-4daa-9508-a11e39a66269 req-d8778af1-4ea0-41c1-b766-e8f4ad7a7e3c service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Received event network-changed-b99c7a66-5c97-483e-bdaf-f5eef776fddd {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:40:56 user nova-compute[75356]: DEBUG nova.compute.manager [req-7e7c0d7e-58ac-4daa-9508-a11e39a66269 req-d8778af1-4ea0-41c1-b766-e8f4ad7a7e3c service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Refreshing instance network info cache due to event network-changed-b99c7a66-5c97-483e-bdaf-f5eef776fddd. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:40:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7e7c0d7e-58ac-4daa-9508-a11e39a66269 req-d8778af1-4ea0-41c1-b766-e8f4ad7a7e3c service nova] Acquiring lock "refresh_cache-6f31e740-f4b3-41be-b004-70c3d49459ea" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:40:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7e7c0d7e-58ac-4daa-9508-a11e39a66269 req-d8778af1-4ea0-41c1-b766-e8f4ad7a7e3c service nova] Acquired lock "refresh_cache-6f31e740-f4b3-41be-b004-70c3d49459ea" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:40:56 user nova-compute[75356]: DEBUG nova.network.neutron [req-7e7c0d7e-58ac-4daa-9508-a11e39a66269 req-d8778af1-4ea0-41c1-b766-e8f4ad7a7e3c service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Refreshing network info cache for port b99c7a66-5c97-483e-bdaf-f5eef776fddd {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:40:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "6f31e740-f4b3-41be-b004-70c3d49459ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "6f31e740-f4b3-41be-b004-70c3d49459ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "6f31e740-f4b3-41be-b004-70c3d49459ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "6f31e740-f4b3-41be-b004-70c3d49459ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "6f31e740-f4b3-41be-b004-70c3d49459ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:56 user nova-compute[75356]: INFO nova.compute.manager [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Terminating instance
Nov 29 20:40:56 user nova-compute[75356]: DEBUG nova.compute.manager [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:40:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG nova.compute.manager [req-f5e8b3e5-42a5-4d17-b9a6-498dd7307f3b req-baec7b0a-cbfc-4c44-8ccf-25ce81df6c36 service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Received event network-vif-unplugged-b99c7a66-5c97-483e-bdaf-f5eef776fddd {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f5e8b3e5-42a5-4d17-b9a6-498dd7307f3b req-baec7b0a-cbfc-4c44-8ccf-25ce81df6c36 service nova] Acquiring lock "6f31e740-f4b3-41be-b004-70c3d49459ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f5e8b3e5-42a5-4d17-b9a6-498dd7307f3b req-baec7b0a-cbfc-4c44-8ccf-25ce81df6c36 service nova] Lock "6f31e740-f4b3-41be-b004-70c3d49459ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f5e8b3e5-42a5-4d17-b9a6-498dd7307f3b req-baec7b0a-cbfc-4c44-8ccf-25ce81df6c36 service nova] Lock "6f31e740-f4b3-41be-b004-70c3d49459ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG nova.compute.manager [req-f5e8b3e5-42a5-4d17-b9a6-498dd7307f3b req-baec7b0a-cbfc-4c44-8ccf-25ce81df6c36 service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] No waiting events found dispatching network-vif-unplugged-b99c7a66-5c97-483e-bdaf-f5eef776fddd {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG nova.compute.manager [req-f5e8b3e5-42a5-4d17-b9a6-498dd7307f3b req-baec7b0a-cbfc-4c44-8ccf-25ce81df6c36 service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Received event network-vif-unplugged-b99c7a66-5c97-483e-bdaf-f5eef776fddd for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG nova.network.neutron [req-7e7c0d7e-58ac-4daa-9508-a11e39a66269 req-d8778af1-4ea0-41c1-b766-e8f4ad7a7e3c service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Updated VIF entry in instance network info cache for port b99c7a66-5c97-483e-bdaf-f5eef776fddd. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG nova.network.neutron [req-7e7c0d7e-58ac-4daa-9508-a11e39a66269 req-d8778af1-4ea0-41c1-b766-e8f4ad7a7e3c service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Updating instance_info_cache with network_info: [{"id": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "address": "fa:16:3e:ce:65:d0", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99c7a66-5c", "ovs_interfaceid": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7e7c0d7e-58ac-4daa-9508-a11e39a66269 req-d8778af1-4ea0-41c1-b766-e8f4ad7a7e3c service nova] Releasing lock "refresh_cache-6f31e740-f4b3-41be-b004-70c3d49459ea" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:40:57 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Instance destroyed successfully.
Nov 29 20:40:57 user nova-compute[75356]: DEBUG nova.objects.instance [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lazy-loading 'resources' on Instance uuid 6f31e740-f4b3-41be-b004-70c3d49459ea {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:39:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1053648815',display_name='tempest-TestVolumeBootPattern-server-1053648815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1053648815',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0zsffzZhgXAi/NOnOb6jr5SbjRUa5Ws+6E3ecNSbb6yR1bA/I1Lldbh3v8Eu9yysHBBgvc3puTY35+MIoawU5+qPudnUjWfeo2D4YgfUZH7hVHtowFiKG6iSLDsjXIsA==',key_name='tempest-TestVolumeBootPattern-313405727',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:39:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6791b0c999846e2a22d5735f91ea1aa',ramdisk_id='',reservation_id='r-ou9xg66l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1627976633',owner_user_name='tempest-TestVolumeBootPattern-1627976633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:39:17Z,user_data=None,user_id='081b00360a204be3bd6435807283f230',uuid=6f31e740-f4b3-41be-b004-70c3d49459ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "address": "fa:16:3e:ce:65:d0", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99c7a66-5c", "ovs_interfaceid": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converting VIF {"id": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "address": "fa:16:3e:ce:65:d0", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb99c7a66-5c", "ovs_interfaceid": "b99c7a66-5c97-483e-bdaf-f5eef776fddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:65:d0,bridge_name='br-int',has_traffic_filtering=True,id=b99c7a66-5c97-483e-bdaf-f5eef776fddd,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99c7a66-5c') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG os_vif [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:65:d0,bridge_name='br-int',has_traffic_filtering=True,id=b99c7a66-5c97-483e-bdaf-f5eef776fddd,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99c7a66-5c') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb99c7a66-5c, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=428a7173-0b0f-4d59-927d-6ba71893b47b) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:40:57 user nova-compute[75356]: INFO os_vif [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:65:d0,bridge_name='br-int',has_traffic_filtering=True,id=b99c7a66-5c97-483e-bdaf-f5eef776fddd,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb99c7a66-5c')
Nov 29 20:40:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eynfVgox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:40:57 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:40:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af8dbef-1747-43d7-8bf1-043469db19a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:40:57 user nova-compute[75356]: No targets found.
Nov 29 20:40:57 user nova-compute[75356]: iSNS:
Nov 29 20:40:57 user nova-compute[75356]: No targets found.
Nov 29 20:40:57 user nova-compute[75356]: STATIC:
Nov 29 20:40:57 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c
Nov 29 20:40:57 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:40:57 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:40:57 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79
Nov 29 20:40:57 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:40:57 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:40:57 user nova-compute[75356]: FIRMWARE:
Nov 29 20:40:57 user nova-compute[75356]: No targets found.
Nov 29 20:40:57 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:40:57 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:40:57 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cef7c2f-bc51-4ec5-8cfa-8c60341c71bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33f3a50-a808-4e3e-bef6-51dff59e057c]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:40:57 user nova-compute[75356]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 (non-flash)
Nov 29 20:40:57 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:40:57 user nova-compute[75356]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 (non-flash)
Nov 29 20:40:57 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f83081c0f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79'): ({'sde'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Removing single pathed devices sde {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[38573b2b-8bfb-4e0a-b995-2d98172038eb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0d1a3e-6d3c-4345-8900-b6c3f1567511]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Flushing IO for device /dev/sde {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb65560-5b14-43cc-871d-8529008217e2]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5a3097-88a9-4f70-984f-fa46cd4ea42d]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] SCSI volumes sde have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2563cfa9-5c1dc24b917531eb', '/dev/disk/by-id/scsi-23563316463323462', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2563cfa9') {{(pid=86863) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30a676e-04d4-41e2-9a38-dc2f69237e43]: (4, None) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbc1006-ac4b-472e-acd0-b749c34d24e1]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec8b05d-f8b9-4526-8b0e-efb39b68be00]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79, portal: 172.16.0.220,3260]
Nov 29 20:40:57 user nova-compute[75356]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79, portal: 172.16.0.220,3260] successful.
Nov 29 20:40:57 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dddc729-7896-482a-abe6-9c9d0deead79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7182cb48-0e77-4d7e-a7c9-8433082386a8]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] <== disconnect_volume: return (323ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:40:57 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Deleting instance files /opt/stack/data/nova/instances/6f31e740-f4b3-41be-b004-70c3d49459ea_del
Nov 29 20:40:57 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Deletion of /opt/stack/data/nova/instances/6f31e740-f4b3-41be-b004-70c3d49459ea_del complete
Nov 29 20:40:57 user nova-compute[75356]: INFO nova.compute.manager [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 29 20:40:57 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:40:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:58 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:40:58 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Took 0.45 seconds to deallocate network for instance.
Nov 29 20:40:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:40:59 user nova-compute[75356]: INFO nova.compute.manager [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Took 0.78 seconds to detach 1 volumes for instance.
Nov 29 20:40:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-a04678c1-ac40-4e9f-a39a-6cf2b2c9de1e req-3a562b13-90bd-4066-acf0-34c68dae10ec service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Received event network-vif-plugged-b99c7a66-5c97-483e-bdaf-f5eef776fddd {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:40:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a04678c1-ac40-4e9f-a39a-6cf2b2c9de1e req-3a562b13-90bd-4066-acf0-34c68dae10ec service nova] Acquiring lock "6f31e740-f4b3-41be-b004-70c3d49459ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a04678c1-ac40-4e9f-a39a-6cf2b2c9de1e req-3a562b13-90bd-4066-acf0-34c68dae10ec service nova] Lock "6f31e740-f4b3-41be-b004-70c3d49459ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a04678c1-ac40-4e9f-a39a-6cf2b2c9de1e req-3a562b13-90bd-4066-acf0-34c68dae10ec service nova] Lock "6f31e740-f4b3-41be-b004-70c3d49459ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-a04678c1-ac40-4e9f-a39a-6cf2b2c9de1e req-3a562b13-90bd-4066-acf0-34c68dae10ec service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] No waiting events found dispatching network-vif-plugged-b99c7a66-5c97-483e-bdaf-f5eef776fddd {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:40:59 user nova-compute[75356]: WARNING nova.compute.manager [req-a04678c1-ac40-4e9f-a39a-6cf2b2c9de1e req-3a562b13-90bd-4066-acf0-34c68dae10ec service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Received unexpected event network-vif-plugged-b99c7a66-5c97-483e-bdaf-f5eef776fddd for instance with vm_state active and task_state deleting.
Nov 29 20:40:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-a04678c1-ac40-4e9f-a39a-6cf2b2c9de1e req-3a562b13-90bd-4066-acf0-34c68dae10ec service nova] [instance: 6f31e740-f4b3-41be-b004-70c3d49459ea] Received event network-vif-deleted-b99c7a66-5c97-483e-bdaf-f5eef776fddd {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:40:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:40:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:40:59 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:40:59 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:40:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:40:59 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Deleted allocations for instance 6f31e740-f4b3-41be-b004-70c3d49459ea
Nov 29 20:40:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-41ff4520-b024-41ea-8a14-0d3e3d95d451 tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "6f31e740-f4b3-41be-b004-70c3d49459ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.736s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:41:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:06 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:41:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:08 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:41:08 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:41:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-27b79c6f-c024-4bca-b292-292b11d79329" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:41:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-27b79c6f-c024-4bca-b292-292b11d79329" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:41:08 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:41:08 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Updating instance_info_cache with network_info: [{"id": "69354359-db68-4021-a266-e8486ad17fc1", "address": "fa:16:3e:1c:9a:a8", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69354359-db", "ovs_interfaceid": "69354359-db68-4021-a266-e8486ad17fc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:41:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-27b79c6f-c024-4bca-b292-292b11d79329" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:41:08 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:41:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:12 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:41:12 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:41:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:41:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:41:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:41:12 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:41:12 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:41:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:41:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:41:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:41:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:12 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:41:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:13 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:41:13 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:41:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=8790MB free_disk=25.149837493896484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:41:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:41:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:41:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:41:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 27b79c6f-c024-4bca-b292-292b11d79329 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:41:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:41:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:41:13 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:41:13 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:41:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:41:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:41:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:41:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:41:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:41:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Acquiring lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:41:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:41:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:41:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:41:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:41:14 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:41:14 user nova-compute[75356]: INFO nova.compute.claims [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Claim successful on node user
Nov 29 20:41:15 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:41:15 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:41:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.280s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:41:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:41:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:41:15 user nova-compute[75356]: DEBUG nova.network.neutron [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:41:15 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:41:15 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:41:15 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:41:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:41:15 user nova-compute[75356]: DEBUG nova.policy [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f3a34d4f6a7843e3926761cd1f752033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adafeea8f34e40728c5086c1e3f59397', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:41:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:41:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:41:15 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Creating image(s)
Nov 29 20:41:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Acquiring lock "/opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:41:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "/opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:41:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "/opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:41:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:41:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.179s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:41:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:41:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:41:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:41:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.207s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:41:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:41:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/disk 1073741824" returned: 0 in 0.057s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:41:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:41:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:41:15 user nova-compute[75356]: DEBUG nova.network.neutron [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Successfully created port: 8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.185s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Cannot resize image /opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Ensure instance console log exists: /opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.network.neutron [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Successfully updated port: 8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Acquiring lock "refresh_cache-f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Acquired lock "refresh_cache-f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.network.neutron [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-75686e8c-62ae-46e4-8800-75d1098a0c82 req-83a31a79-ee9d-46d3-b45f-316491e3f2b7 service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Received event network-changed-8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-75686e8c-62ae-46e4-8800-75d1098a0c82 req-83a31a79-ee9d-46d3-b45f-316491e3f2b7 service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Refreshing instance network info cache due to event network-changed-8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-75686e8c-62ae-46e4-8800-75d1098a0c82 req-83a31a79-ee9d-46d3-b45f-316491e3f2b7 service nova] Acquiring lock "refresh_cache-f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.network.neutron [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.network.neutron [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Updating instance_info_cache with network_info: [{"id": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "address": "fa:16:3e:99:eb:79", "network": {"id": "9f7cb915-67ff-4081-abfb-03e49aad02c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-471863428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adafeea8f34e40728c5086c1e3f59397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6152ce-bf", "ovs_interfaceid": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Releasing lock "refresh_cache-f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.compute.manager [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Instance network_info: |[{"id": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "address": "fa:16:3e:99:eb:79", "network": {"id": "9f7cb915-67ff-4081-abfb-03e49aad02c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-471863428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adafeea8f34e40728c5086c1e3f59397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6152ce-bf", "ovs_interfaceid": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-75686e8c-62ae-46e4-8800-75d1098a0c82 req-83a31a79-ee9d-46d3-b45f-316491e3f2b7 service nova] Acquired lock "refresh_cache-f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.network.neutron [req-75686e8c-62ae-46e4-8800-75d1098a0c82 req-83a31a79-ee9d-46d3-b45f-316491e3f2b7 service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Refreshing network info cache for port 8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Start _get_guest_xml network_info=[{"id": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "address": "fa:16:3e:99:eb:79", "network": {"id": "9f7cb915-67ff-4081-abfb-03e49aad02c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-471863428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adafeea8f34e40728c5086c1e3f59397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6152ce-bf", "ovs_interfaceid": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:41:16 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:41:16 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:41:16 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:41:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-78163504',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-78163504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7816350',id=45,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyj6WIucggDhKNfmFzsFMPdQEk5dAM1wGGw3BY8NmU4dmYl4rES3fNHdZyEXq5GrgZ7b3xGi2rLRCb6RRk2fNJUa9tJC9EJCwIv2quuus9RI7/IMviaPodg2XTr6DDMfQ==',key_name='tempest-keypair-1774540889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adafeea8f34e40728c5086c1e3f59397',ramdisk_id='',reservation_id='r-i3xec4n2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1850217482',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:41:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3a34d4f6a7843e3926761cd1f752033',uuid=f99c7008-ffbd-4f5c-96ef-ac50832b3f4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "address": "fa:16:3e:99:eb:79", "network": {"id": "9f7cb915-67ff-4081-abfb-03e49aad02c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-471863428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adafeea8f34e40728c5086c1e3f59397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6152ce-bf", "ovs_interfaceid": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Converting VIF {"id": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "address": "fa:16:3e:99:eb:79", "network": {"id": "9f7cb915-67ff-4081-abfb-03e49aad02c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-471863428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adafeea8f34e40728c5086c1e3f59397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6152ce-bf", "ovs_interfaceid": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:eb:79,bridge_name='br-int',has_traffic_filtering=True,id=8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4,network=Network(9f7cb915-67ff-4081-abfb-03e49aad02c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a6152ce-bf') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG nova.objects.instance [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lazy-loading 'pci_devices' on Instance uuid f99c7008-ffbd-4f5c-96ef-ac50832b3f4c {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:41:17 user nova-compute[75356]:   <uuid>f99c7008-ffbd-4f5c-96ef-ac50832b3f4c</uuid>
Nov 29 20:41:17 user nova-compute[75356]:   <name>instance-0000002d</name>
Nov 29 20:41:17 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:41:17 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:41:17 user nova-compute[75356]:   <metadata>
Nov 29 20:41:17 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:41:17 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:41:17 user nova-compute[75356]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-78163504</nova:name>
Nov 29 20:41:17 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:41:16</nova:creationTime>
Nov 29 20:41:17 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:41:17 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:41:17 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:41:17 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:41:17 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:41:17 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:41:17 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:41:17 user nova-compute[75356]:       <nova:owner>
Nov 29 20:41:17 user nova-compute[75356]:         <nova:user uuid="f3a34d4f6a7843e3926761cd1f752033">tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member</nova:user>
Nov 29 20:41:17 user nova-compute[75356]:         <nova:project uuid="adafeea8f34e40728c5086c1e3f59397">tempest-TestServerVolumeAttachScenarioOldVersion-1850217482</nova:project>
Nov 29 20:41:17 user nova-compute[75356]:       </nova:owner>
Nov 29 20:41:17 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:41:17 user nova-compute[75356]:       <nova:ports>
Nov 29 20:41:17 user nova-compute[75356]:         <nova:port uuid="8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4">
Nov 29 20:41:17 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 20:41:17 user nova-compute[75356]:         </nova:port>
Nov 29 20:41:17 user nova-compute[75356]:       </nova:ports>
Nov 29 20:41:17 user nova-compute[75356]:     </nova:instance>
Nov 29 20:41:17 user nova-compute[75356]:   </metadata>
Nov 29 20:41:17 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:41:17 user nova-compute[75356]:     <system>
Nov 29 20:41:17 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:41:17 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:41:17 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:41:17 user nova-compute[75356]:       <entry name="serial">f99c7008-ffbd-4f5c-96ef-ac50832b3f4c</entry>
Nov 29 20:41:17 user nova-compute[75356]:       <entry name="uuid">f99c7008-ffbd-4f5c-96ef-ac50832b3f4c</entry>
Nov 29 20:41:17 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:41:17 user nova-compute[75356]:     </system>
Nov 29 20:41:17 user nova-compute[75356]:   </sysinfo>
Nov 29 20:41:17 user nova-compute[75356]:   <os>
Nov 29 20:41:17 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:41:17 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:41:17 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:41:17 user nova-compute[75356]:   </os>
Nov 29 20:41:17 user nova-compute[75356]:   <features>
Nov 29 20:41:17 user nova-compute[75356]:     <acpi/>
Nov 29 20:41:17 user nova-compute[75356]:     <apic/>
Nov 29 20:41:17 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:41:17 user nova-compute[75356]:   </features>
Nov 29 20:41:17 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:41:17 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:41:17 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:41:17 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:41:17 user nova-compute[75356]:   </clock>
Nov 29 20:41:17 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:41:17 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:41:17 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:41:17 user nova-compute[75356]:   </cpu>
Nov 29 20:41:17 user nova-compute[75356]:   <devices>
Nov 29 20:41:17 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:41:17 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:41:17 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/disk"/>
Nov 29 20:41:17 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:41:17 user nova-compute[75356]:     </disk>
Nov 29 20:41:17 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:41:17 user nova-compute[75356]:       <mac address="fa:16:3e:99:eb:79"/>
Nov 29 20:41:17 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:41:17 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:41:17 user nova-compute[75356]:       <target dev="tap8a6152ce-bf"/>
Nov 29 20:41:17 user nova-compute[75356]:     </interface>
Nov 29 20:41:17 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:41:17 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/console.log" append="off"/>
Nov 29 20:41:17 user nova-compute[75356]:     </serial>
Nov 29 20:41:17 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:41:17 user nova-compute[75356]:     <video>
Nov 29 20:41:17 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:41:17 user nova-compute[75356]:     </video>
Nov 29 20:41:17 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:41:17 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:41:17 user nova-compute[75356]:     </rng>
Nov 29 20:41:17 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:41:17 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:41:17 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:41:17 user nova-compute[75356]:     </memballoon>
Nov 29 20:41:17 user nova-compute[75356]:   </devices>
Nov 29 20:41:17 user nova-compute[75356]: </domain>
Nov 29 20:41:17 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:41:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-78163504',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-78163504',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7816350',id=45,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyj6WIucggDhKNfmFzsFMPdQEk5dAM1wGGw3BY8NmU4dmYl4rES3fNHdZyEXq5GrgZ7b3xGi2rLRCb6RRk2fNJUa9tJC9EJCwIv2quuus9RI7/IMviaPodg2XTr6DDMfQ==',key_name='tempest-keypair-1774540889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='adafeea8f34e40728c5086c1e3f59397',ramdisk_id='',reservation_id='r-i3xec4n2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1850217482',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:41:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3a34d4f6a7843e3926761cd1f752033',uuid=f99c7008-ffbd-4f5c-96ef-ac50832b3f4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "address": "fa:16:3e:99:eb:79", "network": {"id": "9f7cb915-67ff-4081-abfb-03e49aad02c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-471863428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adafeea8f34e40728c5086c1e3f59397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6152ce-bf", "ovs_interfaceid": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Converting VIF {"id": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "address": "fa:16:3e:99:eb:79", "network": {"id": "9f7cb915-67ff-4081-abfb-03e49aad02c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-471863428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adafeea8f34e40728c5086c1e3f59397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6152ce-bf", "ovs_interfaceid": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:eb:79,bridge_name='br-int',has_traffic_filtering=True,id=8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4,network=Network(9f7cb915-67ff-4081-abfb-03e49aad02c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a6152ce-bf') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG os_vif [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:eb:79,bridge_name='br-int',has_traffic_filtering=True,id=8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4,network=Network(9f7cb915-67ff-4081-abfb-03e49aad02c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a6152ce-bf') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5d18788-eb1d-5a97-a60e-88d9843a787a', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a6152ce-bf, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a6152ce-bf, col_values=(('qos', UUID('def757ae-854f-423a-8767-3a082c8b5d00')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a6152ce-bf, col_values=(('external_ids', {'iface-id': '8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:eb:79', 'vm-uuid': 'f99c7008-ffbd-4f5c-96ef-ac50832b3f4c'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:17 user nova-compute[75356]: INFO os_vif [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:eb:79,bridge_name='br-int',has_traffic_filtering=True,id=8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4,network=Network(9f7cb915-67ff-4081-abfb-03e49aad02c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a6152ce-bf')
Nov 29 20:41:17 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] No VIF found with MAC fa:16:3e:99:eb:79, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG nova.network.neutron [req-75686e8c-62ae-46e4-8800-75d1098a0c82 req-83a31a79-ee9d-46d3-b45f-316491e3f2b7 service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Updated VIF entry in instance network info cache for port 8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG nova.network.neutron [req-75686e8c-62ae-46e4-8800-75d1098a0c82 req-83a31a79-ee9d-46d3-b45f-316491e3f2b7 service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Updating instance_info_cache with network_info: [{"id": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "address": "fa:16:3e:99:eb:79", "network": {"id": "9f7cb915-67ff-4081-abfb-03e49aad02c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-471863428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adafeea8f34e40728c5086c1e3f59397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6152ce-bf", "ovs_interfaceid": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-75686e8c-62ae-46e4-8800-75d1098a0c82 req-83a31a79-ee9d-46d3-b45f-316491e3f2b7 service nova] Releasing lock "refresh_cache-f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:41:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-53ad787a-41a1-4e32-9614-4f23db47398c req-8979a842-9564-415e-9665-76163f26233e service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Received event network-vif-plugged-8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:41:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-53ad787a-41a1-4e32-9614-4f23db47398c req-8979a842-9564-415e-9665-76163f26233e service nova] Acquiring lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:41:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-53ad787a-41a1-4e32-9614-4f23db47398c req-8979a842-9564-415e-9665-76163f26233e service nova] Lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:41:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-53ad787a-41a1-4e32-9614-4f23db47398c req-8979a842-9564-415e-9665-76163f26233e service nova] Lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:41:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-53ad787a-41a1-4e32-9614-4f23db47398c req-8979a842-9564-415e-9665-76163f26233e service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] No waiting events found dispatching network-vif-plugged-8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:41:18 user nova-compute[75356]: WARNING nova.compute.manager [req-53ad787a-41a1-4e32-9614-4f23db47398c req-8979a842-9564-415e-9665-76163f26233e service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Received unexpected event network-vif-plugged-8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4 for instance with vm_state building and task_state spawning.
Nov 29 20:41:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:19 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:41:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-c6fb1e0f-1fb2-45d7-8cab-fb31c2ecf101 req-02b78602-c08f-406f-b2e8-90bfe109d04a service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Received event network-vif-plugged-8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:41:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c6fb1e0f-1fb2-45d7-8cab-fb31c2ecf101 req-02b78602-c08f-406f-b2e8-90bfe109d04a service nova] Acquiring lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:41:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c6fb1e0f-1fb2-45d7-8cab-fb31c2ecf101 req-02b78602-c08f-406f-b2e8-90bfe109d04a service nova] Lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:41:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c6fb1e0f-1fb2-45d7-8cab-fb31c2ecf101 req-02b78602-c08f-406f-b2e8-90bfe109d04a service nova] Lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:41:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-c6fb1e0f-1fb2-45d7-8cab-fb31c2ecf101 req-02b78602-c08f-406f-b2e8-90bfe109d04a service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] No waiting events found dispatching network-vif-plugged-8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:41:20 user nova-compute[75356]: WARNING nova.compute.manager [req-c6fb1e0f-1fb2-45d7-8cab-fb31c2ecf101 req-02b78602-c08f-406f-b2e8-90bfe109d04a service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Received unexpected event network-vif-plugged-8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4 for instance with vm_state building and task_state spawning.
Nov 29 20:41:20 user nova-compute[75356]: DEBUG nova.compute.manager [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:41:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:41:20 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Instance spawned successfully.
Nov 29 20:41:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:41:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:41:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:41:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:41:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:41:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:41:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:41:20 user nova-compute[75356]: INFO nova.compute.manager [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Took 5.47 seconds to spawn the instance on the hypervisor.
Nov 29 20:41:20 user nova-compute[75356]: DEBUG nova.compute.manager [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:41:20 user nova-compute[75356]: INFO nova.compute.manager [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Took 6.10 seconds to build instance.
Nov 29 20:41:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-a21383f6-0ac7-4bd2-ae66-7739f0ebb9c1 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.194s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:41:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:41:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:41:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:41:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:41:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:41:25 user nova-compute[75356]: INFO nova.compute.manager [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Terminating instance
Nov 29 20:41:25 user nova-compute[75356]: DEBUG nova.compute.manager [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:41:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-cc0d89e0-d27e-4d19-9917-5c44d61b9f2a req-848c148c-8f11-4e97-aff5-40aeeff149d0 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received event network-vif-unplugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:41:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cc0d89e0-d27e-4d19-9917-5c44d61b9f2a req-848c148c-8f11-4e97-aff5-40aeeff149d0 service nova] Acquiring lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:41:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cc0d89e0-d27e-4d19-9917-5c44d61b9f2a req-848c148c-8f11-4e97-aff5-40aeeff149d0 service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:41:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cc0d89e0-d27e-4d19-9917-5c44d61b9f2a req-848c148c-8f11-4e97-aff5-40aeeff149d0 service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:41:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-cc0d89e0-d27e-4d19-9917-5c44d61b9f2a req-848c148c-8f11-4e97-aff5-40aeeff149d0 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] No waiting events found dispatching network-vif-unplugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:41:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-cc0d89e0-d27e-4d19-9917-5c44d61b9f2a req-848c148c-8f11-4e97-aff5-40aeeff149d0 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received event network-vif-unplugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:41:26 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Instance destroyed successfully.
Nov 29 20:41:26 user nova-compute[75356]: DEBUG nova.objects.instance [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lazy-loading 'resources' on Instance uuid 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:41:26 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:24:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-524234962',display_name='tempest-ServerRescueNegativeTestJSON-server-524234962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-524234962',id=22,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:29:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34dff0986b1d47fdaf305c87e323d19e',ramdisk_id='',reservation_id='r-fdzu3fqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1204717931',owner_user_name='tempest-ServerRescueNegativeTestJSON-1204717931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:31:08Z,user_data=None,user_id='00cdfe6527e04f049b5e38685bc1f257',uuid=4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "address": "fa:16:3e:91:30:da", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a14e591-f6", "ovs_interfaceid": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:41:26 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converting VIF {"id": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "address": "fa:16:3e:91:30:da", "network": {"id": "c71176e1-74ea-4088-8969-1294ac83cfae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-426843698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34dff0986b1d47fdaf305c87e323d19e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a14e591-f6", "ovs_interfaceid": "0a14e591-f6b5-4199-90fe-a7a40182e6c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:41:26 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:30:da,bridge_name='br-int',has_traffic_filtering=True,id=0a14e591-f6b5-4199-90fe-a7a40182e6c7,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a14e591-f6') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:41:26 user nova-compute[75356]: DEBUG os_vif [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:30:da,bridge_name='br-int',has_traffic_filtering=True,id=0a14e591-f6b5-4199-90fe-a7a40182e6c7,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a14e591-f6') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:41:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a14e591-f6, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:41:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95adc919-e67c-406f-92f1-ff35f32efb16) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:41:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:41:26 user nova-compute[75356]: INFO os_vif [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:30:da,bridge_name='br-int',has_traffic_filtering=True,id=0a14e591-f6b5-4199-90fe-a7a40182e6c7,network=Network(c71176e1-74ea-4088-8969-1294ac83cfae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a14e591-f6')
Nov 29 20:41:26 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Deleting instance files /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1_del
Nov 29 20:41:26 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Deletion of /opt/stack/data/nova/instances/4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1_del complete
Nov 29 20:41:26 user nova-compute[75356]: INFO nova.compute.manager [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 29 20:41:26 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:41:26 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:41:26 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:41:26 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:41:26 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Took 0.50 seconds to deallocate network for instance.
Nov 29 20:41:26 user nova-compute[75356]: DEBUG nova.compute.manager [req-3ae3afeb-e0be-466d-b7ee-968f22e9061e req-e3f22d63-30e9-43ce-81c9-b2a94f556a95 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received event network-vif-deleted-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:41:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:41:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:41:26 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:41:26 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:41:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:41:27 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Deleted allocations for instance 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1
Nov 29 20:41:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-84363d0a-c6e8-4292-98af-3f4b8335a4e5 tempest-ServerRescueNegativeTestJSON-1204717931 tempest-ServerRescueNegativeTestJSON-1204717931-project-member] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.795s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:41:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-3c74c3ae-ce9c-48b1-b279-763b7a232d95 req-3f59ce3f-8628-4976-96cf-15a2dcd94ee4 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received event network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:41:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3c74c3ae-ce9c-48b1-b279-763b7a232d95 req-3f59ce3f-8628-4976-96cf-15a2dcd94ee4 service nova] Acquiring lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:41:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3c74c3ae-ce9c-48b1-b279-763b7a232d95 req-3f59ce3f-8628-4976-96cf-15a2dcd94ee4 service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:41:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3c74c3ae-ce9c-48b1-b279-763b7a232d95 req-3f59ce3f-8628-4976-96cf-15a2dcd94ee4 service nova] Lock "4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:41:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-3c74c3ae-ce9c-48b1-b279-763b7a232d95 req-3f59ce3f-8628-4976-96cf-15a2dcd94ee4 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] No waiting events found dispatching network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:41:27 user nova-compute[75356]: WARNING nova.compute.manager [req-3c74c3ae-ce9c-48b1-b279-763b7a232d95 req-3f59ce3f-8628-4976-96cf-15a2dcd94ee4 service nova] [instance: 4c6eec9a-1b8a-497a-ba57-0f2fb50cd5f1] Received unexpected event network-vif-plugged-0a14e591-f6b5-4199-90fe-a7a40182e6c7 for instance with vm_state deleted and task_state None.
Nov 29 20:41:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:41:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:41:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:41:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:41:36 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:41 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:46 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:58 user nova-compute[75356]: DEBUG nova.compute.manager [req-1f56edc3-6417-4e7b-bed7-63d8ba7b556a req-9cefa042-30a6-49d6-b378-7022df90aaed service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Received event network-changed-69354359-db68-4021-a266-e8486ad17fc1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:41:58 user nova-compute[75356]: DEBUG nova.compute.manager [req-1f56edc3-6417-4e7b-bed7-63d8ba7b556a req-9cefa042-30a6-49d6-b378-7022df90aaed service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Refreshing instance network info cache due to event network-changed-69354359-db68-4021-a266-e8486ad17fc1. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:41:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1f56edc3-6417-4e7b-bed7-63d8ba7b556a req-9cefa042-30a6-49d6-b378-7022df90aaed service nova] Acquiring lock "refresh_cache-27b79c6f-c024-4bca-b292-292b11d79329" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:41:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1f56edc3-6417-4e7b-bed7-63d8ba7b556a req-9cefa042-30a6-49d6-b378-7022df90aaed service nova] Acquired lock "refresh_cache-27b79c6f-c024-4bca-b292-292b11d79329" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:41:58 user nova-compute[75356]: DEBUG nova.network.neutron [req-1f56edc3-6417-4e7b-bed7-63d8ba7b556a req-9cefa042-30a6-49d6-b378-7022df90aaed service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Refreshing network info cache for port 69354359-db68-4021-a266-e8486ad17fc1 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "27b79c6f-c024-4bca-b292-292b11d79329" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "27b79c6f-c024-4bca-b292-292b11d79329" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "27b79c6f-c024-4bca-b292-292b11d79329-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "27b79c6f-c024-4bca-b292-292b11d79329-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "27b79c6f-c024-4bca-b292-292b11d79329-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:41:59 user nova-compute[75356]: INFO nova.compute.manager [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Terminating instance
Nov 29 20:41:59 user nova-compute[75356]: DEBUG nova.compute.manager [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG nova.network.neutron [req-1f56edc3-6417-4e7b-bed7-63d8ba7b556a req-9cefa042-30a6-49d6-b378-7022df90aaed service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Updated VIF entry in instance network info cache for port 69354359-db68-4021-a266-e8486ad17fc1. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG nova.network.neutron [req-1f56edc3-6417-4e7b-bed7-63d8ba7b556a req-9cefa042-30a6-49d6-b378-7022df90aaed service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Updating instance_info_cache with network_info: [{"id": "69354359-db68-4021-a266-e8486ad17fc1", "address": "fa:16:3e:1c:9a:a8", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69354359-db", "ovs_interfaceid": "69354359-db68-4021-a266-e8486ad17fc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1f56edc3-6417-4e7b-bed7-63d8ba7b556a req-9cefa042-30a6-49d6-b378-7022df90aaed service nova] Releasing lock "refresh_cache-27b79c6f-c024-4bca-b292-292b11d79329" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-f9427346-5ccd-4306-8ca2-5326961c43c2 req-01cc45e2-9b48-4163-8466-e47cc68ad9ce service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Received event network-vif-unplugged-69354359-db68-4021-a266-e8486ad17fc1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f9427346-5ccd-4306-8ca2-5326961c43c2 req-01cc45e2-9b48-4163-8466-e47cc68ad9ce service nova] Acquiring lock "27b79c6f-c024-4bca-b292-292b11d79329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f9427346-5ccd-4306-8ca2-5326961c43c2 req-01cc45e2-9b48-4163-8466-e47cc68ad9ce service nova] Lock "27b79c6f-c024-4bca-b292-292b11d79329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f9427346-5ccd-4306-8ca2-5326961c43c2 req-01cc45e2-9b48-4163-8466-e47cc68ad9ce service nova] Lock "27b79c6f-c024-4bca-b292-292b11d79329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-f9427346-5ccd-4306-8ca2-5326961c43c2 req-01cc45e2-9b48-4163-8466-e47cc68ad9ce service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] No waiting events found dispatching network-vif-unplugged-69354359-db68-4021-a266-e8486ad17fc1 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-f9427346-5ccd-4306-8ca2-5326961c43c2 req-01cc45e2-9b48-4163-8466-e47cc68ad9ce service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Received event network-vif-unplugged-69354359-db68-4021-a266-e8486ad17fc1 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:41:59 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Instance destroyed successfully.
Nov 29 20:41:59 user nova-compute[75356]: DEBUG nova.objects.instance [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lazy-loading 'resources' on Instance uuid 27b79c6f-c024-4bca-b292-292b11d79329 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1269229211',display_name='tempest-TestVolumeBootPattern-server-1269229211',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1269229211',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0zsffzZhgXAi/NOnOb6jr5SbjRUa5Ws+6E3ecNSbb6yR1bA/I1Lldbh3v8Eu9yysHBBgvc3puTY35+MIoawU5+qPudnUjWfeo2D4YgfUZH7hVHtowFiKG6iSLDsjXIsA==',key_name='tempest-TestVolumeBootPattern-313405727',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:37:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6791b0c999846e2a22d5735f91ea1aa',ramdisk_id='',reservation_id='r-2dm1ho3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1627976633',owner_user_name='tempest-TestVolumeBootPattern-1627976633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:37:21Z,user_data=None,user_id='081b00360a204be3bd6435807283f230',uuid=27b79c6f-c024-4bca-b292-292b11d79329,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69354359-db68-4021-a266-e8486ad17fc1", "address": "fa:16:3e:1c:9a:a8", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69354359-db", "ovs_interfaceid": "69354359-db68-4021-a266-e8486ad17fc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converting VIF {"id": "69354359-db68-4021-a266-e8486ad17fc1", "address": "fa:16:3e:1c:9a:a8", "network": {"id": "6b9e8109-0dc5-4e76-b785-b097e2010ca9", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1377611827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6791b0c999846e2a22d5735f91ea1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69354359-db", "ovs_interfaceid": "69354359-db68-4021-a266-e8486ad17fc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:9a:a8,bridge_name='br-int',has_traffic_filtering=True,id=69354359-db68-4021-a266-e8486ad17fc1,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69354359-db') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG os_vif [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:9a:a8,bridge_name='br-int',has_traffic_filtering=True,id=69354359-db68-4021-a266-e8486ad17fc1,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69354359-db') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69354359-db, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c70738a-8203-4b67-9d98-b2f96466bee4) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:41:59 user nova-compute[75356]: INFO os_vif [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:9a:a8,bridge_name='br-int',has_traffic_filtering=True,id=69354359-db68-4021-a266-e8486ad17fc1,network=Network(6b9e8109-0dc5-4e76-b785-b097e2010ca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69354359-db')
Nov 29 20:41:59 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVgCudKk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:41:59 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:41:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c940e4-a242-4f4d-be23-ce79c7855bc5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:41:59 user nova-compute[75356]: No targets found.
Nov 29 20:41:59 user nova-compute[75356]: iSNS:
Nov 29 20:41:59 user nova-compute[75356]: No targets found.
Nov 29 20:41:59 user nova-compute[75356]: STATIC:
Nov 29 20:41:59 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c
Nov 29 20:41:59 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:41:59 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:41:59 user nova-compute[75356]: FIRMWARE:
Nov 29 20:41:59 user nova-compute[75356]: No targets found.
Nov 29 20:41:59 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:41:59 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:41:59 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[239e2ab4-0056-403f-9902-3cd08227d963]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27c8aca-1951-4750-bb78-2c80eda5e766]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:41:59 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c (non-flash)
Nov 29 20:41:59 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e443bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c'): ({'sdd'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Removing single pathed devices sdd {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e71357-cdb6-4440-bcb3-cffc95b8134c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0743bd5-b857-43e3-95ad-45949715eb08]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Flushing IO for device /dev/sdd {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:41:59 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d26878-8d7a-41f4-9ff4-389e59c5dd07]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c160bf59-33ae-40ea-aea3-a7daed5ece59]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] SCSI volumes sdd have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_33ecf327', '/dev/disk/by-id/scsi-26131633634666164', '/dev/disk/by-id/scsi-1SCST_BIO33ecf327-a1c64fad7459d17d') {{(pid=86863) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddd0f79-7156-4f7b-bfd5-afb039fdef29]: (4, None) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.057s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f94b8e2-1cdc-4d7d-9c23-d46afe9d15f8]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ebb21d-64f9-4772-a52b-5718b07e9490]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c, portal: 172.16.0.220,3260]
Nov 29 20:42:00 user nova-compute[75356]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c, portal: 172.16.0.220,3260] successful.
Nov 29 20:42:00 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1832be70-b887-4daf-85a9-3769ecc4059c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[83659626-0dc8-419e-aa81-022c4e0d22bf]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] <== disconnect_volume: return (364ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:42:00 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Deleting instance files /opt/stack/data/nova/instances/27b79c6f-c024-4bca-b292-292b11d79329_del
Nov 29 20:42:00 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Deletion of /opt/stack/data/nova/instances/27b79c6f-c024-4bca-b292-292b11d79329_del complete
Nov 29 20:42:00 user nova-compute[75356]: INFO nova.compute.manager [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 29 20:42:00 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:42:00 user nova-compute[75356]: DEBUG nova.compute.manager [req-24eab96f-99fb-4e0d-8508-e572efd4b75e req-c5a850ed-2376-4db2-8bf7-9facf7769fa4 service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Received event network-vif-deleted-69354359-db68-4021-a266-e8486ad17fc1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:42:00 user nova-compute[75356]: INFO nova.compute.manager [req-24eab96f-99fb-4e0d-8508-e572efd4b75e req-c5a850ed-2376-4db2-8bf7-9facf7769fa4 service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Neutron deleted interface 69354359-db68-4021-a266-e8486ad17fc1; detaching it from the instance and deleting it from the info cache
Nov 29 20:42:00 user nova-compute[75356]: DEBUG nova.network.neutron [req-24eab96f-99fb-4e0d-8508-e572efd4b75e req-c5a850ed-2376-4db2-8bf7-9facf7769fa4 service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:42:00 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Took 0.51 seconds to deallocate network for instance.
Nov 29 20:42:00 user nova-compute[75356]: DEBUG nova.compute.manager [req-24eab96f-99fb-4e0d-8508-e572efd4b75e req-c5a850ed-2376-4db2-8bf7-9facf7769fa4 service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Detach interface failed, port_id=69354359-db68-4021-a266-e8486ad17fc1, reason: Instance 27b79c6f-c024-4bca-b292-292b11d79329 could not be found. {{(pid=75356) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 20:42:01 user nova-compute[75356]: DEBUG nova.compute.manager [req-de88021d-5e67-410d-9d03-def998bf7ce1 req-73856add-061a-4545-b904-08e5b1c06dd6 service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Received event network-vif-plugged-69354359-db68-4021-a266-e8486ad17fc1 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:42:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-de88021d-5e67-410d-9d03-def998bf7ce1 req-73856add-061a-4545-b904-08e5b1c06dd6 service nova] Acquiring lock "27b79c6f-c024-4bca-b292-292b11d79329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-de88021d-5e67-410d-9d03-def998bf7ce1 req-73856add-061a-4545-b904-08e5b1c06dd6 service nova] Lock "27b79c6f-c024-4bca-b292-292b11d79329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:01 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-de88021d-5e67-410d-9d03-def998bf7ce1 req-73856add-061a-4545-b904-08e5b1c06dd6 service nova] Lock "27b79c6f-c024-4bca-b292-292b11d79329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:01 user nova-compute[75356]: DEBUG nova.compute.manager [req-de88021d-5e67-410d-9d03-def998bf7ce1 req-73856add-061a-4545-b904-08e5b1c06dd6 service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] No waiting events found dispatching network-vif-plugged-69354359-db68-4021-a266-e8486ad17fc1 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:42:01 user nova-compute[75356]: WARNING nova.compute.manager [req-de88021d-5e67-410d-9d03-def998bf7ce1 req-73856add-061a-4545-b904-08e5b1c06dd6 service nova] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Received unexpected event network-vif-plugged-69354359-db68-4021-a266-e8486ad17fc1 for instance with vm_state active and task_state deleting.
Nov 29 20:42:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:06 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:42:07 user nova-compute[75356]: INFO nova.compute.manager [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] [instance: 27b79c6f-c024-4bca-b292-292b11d79329] Took 6.52 seconds to detach 1 volumes for instance.
Nov 29 20:42:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:07 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:42:07 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:42:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:07 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Deleted allocations for instance 27b79c6f-c024-4bca-b292-292b11d79329
Nov 29 20:42:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-e29756ad-355d-4d99-8c7b-cc1cfacc5a1e tempest-TestVolumeBootPattern-1627976633 tempest-TestVolumeBootPattern-1627976633-project-member] Lock "27b79c6f-c024-4bca-b292-292b11d79329" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.621s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:09 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:42:09 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:42:09 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Didn't find any instances for network info cache update. {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 20:42:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:42:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:42:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:42:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:42:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:13 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:42:13 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:42:13 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:42:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:13 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:42:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:42:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:42:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:42:13 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:42:14 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:42:14 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:42:14 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=8821MB free_disk=25.136417388916016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:42:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:14 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance f99c7008-ffbd-4f5c-96ef-ac50832b3f4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:42:14 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:42:14 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:42:14 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:42:14 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:42:14 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:42:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:17 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:42:17 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:42:17 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:42:17 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:42:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:20 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:42:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "7b0f5aad-e45c-4637-825c-cb295e98603a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:28 user nova-compute[75356]: DEBUG nova.compute.manager [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:42:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:29 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:42:29 user nova-compute[75356]: INFO nova.compute.claims [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Claim successful on node user
Nov 29 20:42:29 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:42:29 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:42:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:29 user nova-compute[75356]: DEBUG nova.compute.manager [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:42:29 user nova-compute[75356]: DEBUG nova.compute.manager [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:42:29 user nova-compute[75356]: DEBUG nova.network.neutron [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:42:29 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:42:29 user nova-compute[75356]: DEBUG nova.compute.manager [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:42:29 user nova-compute[75356]: DEBUG nova.compute.manager [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:42:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:42:29 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Creating image(s)
Nov 29 20:42:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "/opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "/opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:42:29 user nova-compute[75356]: DEBUG nova.policy [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43ecf2b8c0f04d90a1ad6a780894fefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b8a1f1c6f4c24bb1ca7faafb49226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:42:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.211s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:42:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:42:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.177s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:42:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:42:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk 1073741824" returned: 0 in 0.053s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:42:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:42:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.201s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:42:30 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:42:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:42:30 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:42:30 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Cannot resize image /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:42:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:42:30 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Ensure instance console log exists: /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:42:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:30 user nova-compute[75356]: DEBUG nova.network.neutron [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Successfully created port: ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.network.neutron [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Successfully updated port: ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquired lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.network.neutron [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.network.neutron [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.compute.manager [req-9dd4b41c-7d85-40f7-94e8-fd5be6c57ecf req-ae1a137d-67e4-41f5-aea9-7c8cf1617c9c service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received event network-changed-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.compute.manager [req-9dd4b41c-7d85-40f7-94e8-fd5be6c57ecf req-ae1a137d-67e4-41f5-aea9-7c8cf1617c9c service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Refreshing instance network info cache due to event network-changed-ddf386ac-899d-4106-88a9-ec3916a51b7c. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9dd4b41c-7d85-40f7-94e8-fd5be6c57ecf req-ae1a137d-67e4-41f5-aea9-7c8cf1617c9c service nova] Acquiring lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.network.neutron [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Updating instance_info_cache with network_info: [{"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Releasing lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.compute.manager [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Instance network_info: |[{"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9dd4b41c-7d85-40f7-94e8-fd5be6c57ecf req-ae1a137d-67e4-41f5-aea9-7c8cf1617c9c service nova] Acquired lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.network.neutron [req-9dd4b41c-7d85-40f7-94e8-fd5be6c57ecf req-ae1a137d-67e4-41f5-aea9-7c8cf1617c9c service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Refreshing network info cache for port ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Start _get_guest_xml network_info=[{"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:42:31 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:42:31 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2030304790',display_name='tempest-AttachVolumeTestJSON-server-2030304790',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2030304790',id=46,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKJDjh0oQT6q6eYOe6FVZPoIq0B87siUqrQL2lCAPFszfSPQfbW6SrRyyUbxMDfAEyss1bZglpIevHc2gR0WGMrHpVbgzZpOeBJ4a3Y1yQFHxnZ6St4LQDIVjP1b8kKlA==',key_name='tempest-keypair-2102929947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a1b8a1f1c6f4c24bb1ca7faafb49226',ramdisk_id='',reservation_id='r-ptrcc6aq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1837009022',owner_user_name='tempest-AttachVolumeTestJSON-1837009022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:42:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43ecf2b8c0f04d90a1ad6a780894fefc',uuid=7b0f5aad-e45c-4637-825c-cb295e98603a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converting VIF {"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f0:8d,bridge_name='br-int',has_traffic_filtering=True,id=ddf386ac-899d-4106-88a9-ec3916a51b7c,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf386ac-89') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.objects.instance [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:42:31 user nova-compute[75356]:   <uuid>7b0f5aad-e45c-4637-825c-cb295e98603a</uuid>
Nov 29 20:42:31 user nova-compute[75356]:   <name>instance-0000002e</name>
Nov 29 20:42:31 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:42:31 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:42:31 user nova-compute[75356]:   <metadata>
Nov 29 20:42:31 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:42:31 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:42:31 user nova-compute[75356]:       <nova:name>tempest-AttachVolumeTestJSON-server-2030304790</nova:name>
Nov 29 20:42:31 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:42:31</nova:creationTime>
Nov 29 20:42:31 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:42:31 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:42:31 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:42:31 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:42:31 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:42:31 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:42:31 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:42:31 user nova-compute[75356]:       <nova:owner>
Nov 29 20:42:31 user nova-compute[75356]:         <nova:user uuid="43ecf2b8c0f04d90a1ad6a780894fefc">tempest-AttachVolumeTestJSON-1837009022-project-member</nova:user>
Nov 29 20:42:31 user nova-compute[75356]:         <nova:project uuid="5a1b8a1f1c6f4c24bb1ca7faafb49226">tempest-AttachVolumeTestJSON-1837009022</nova:project>
Nov 29 20:42:31 user nova-compute[75356]:       </nova:owner>
Nov 29 20:42:31 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:42:31 user nova-compute[75356]:       <nova:ports>
Nov 29 20:42:31 user nova-compute[75356]:         <nova:port uuid="ddf386ac-899d-4106-88a9-ec3916a51b7c">
Nov 29 20:42:31 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 20:42:31 user nova-compute[75356]:         </nova:port>
Nov 29 20:42:31 user nova-compute[75356]:       </nova:ports>
Nov 29 20:42:31 user nova-compute[75356]:     </nova:instance>
Nov 29 20:42:31 user nova-compute[75356]:   </metadata>
Nov 29 20:42:31 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:42:31 user nova-compute[75356]:     <system>
Nov 29 20:42:31 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:42:31 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:42:31 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:42:31 user nova-compute[75356]:       <entry name="serial">7b0f5aad-e45c-4637-825c-cb295e98603a</entry>
Nov 29 20:42:31 user nova-compute[75356]:       <entry name="uuid">7b0f5aad-e45c-4637-825c-cb295e98603a</entry>
Nov 29 20:42:31 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:42:31 user nova-compute[75356]:     </system>
Nov 29 20:42:31 user nova-compute[75356]:   </sysinfo>
Nov 29 20:42:31 user nova-compute[75356]:   <os>
Nov 29 20:42:31 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:42:31 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:42:31 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:42:31 user nova-compute[75356]:   </os>
Nov 29 20:42:31 user nova-compute[75356]:   <features>
Nov 29 20:42:31 user nova-compute[75356]:     <acpi/>
Nov 29 20:42:31 user nova-compute[75356]:     <apic/>
Nov 29 20:42:31 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:42:31 user nova-compute[75356]:   </features>
Nov 29 20:42:31 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:42:31 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:42:31 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:42:31 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:42:31 user nova-compute[75356]:   </clock>
Nov 29 20:42:31 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:42:31 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:42:31 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:42:31 user nova-compute[75356]:   </cpu>
Nov 29 20:42:31 user nova-compute[75356]:   <devices>
Nov 29 20:42:31 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:42:31 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:42:31 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk"/>
Nov 29 20:42:31 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:42:31 user nova-compute[75356]:     </disk>
Nov 29 20:42:31 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:42:31 user nova-compute[75356]:       <mac address="fa:16:3e:8b:f0:8d"/>
Nov 29 20:42:31 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:42:31 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:42:31 user nova-compute[75356]:       <target dev="tapddf386ac-89"/>
Nov 29 20:42:31 user nova-compute[75356]:     </interface>
Nov 29 20:42:31 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:42:31 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/console.log" append="off"/>
Nov 29 20:42:31 user nova-compute[75356]:     </serial>
Nov 29 20:42:31 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:42:31 user nova-compute[75356]:     <video>
Nov 29 20:42:31 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:42:31 user nova-compute[75356]:     </video>
Nov 29 20:42:31 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:42:31 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:42:31 user nova-compute[75356]:     </rng>
Nov 29 20:42:31 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:42:31 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:42:31 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:42:31 user nova-compute[75356]:     </memballoon>
Nov 29 20:42:31 user nova-compute[75356]:   </devices>
Nov 29 20:42:31 user nova-compute[75356]: </domain>
Nov 29 20:42:31 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2030304790',display_name='tempest-AttachVolumeTestJSON-server-2030304790',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2030304790',id=46,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKJDjh0oQT6q6eYOe6FVZPoIq0B87siUqrQL2lCAPFszfSPQfbW6SrRyyUbxMDfAEyss1bZglpIevHc2gR0WGMrHpVbgzZpOeBJ4a3Y1yQFHxnZ6St4LQDIVjP1b8kKlA==',key_name='tempest-keypair-2102929947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a1b8a1f1c6f4c24bb1ca7faafb49226',ramdisk_id='',reservation_id='r-ptrcc6aq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1837009022',owner_user_name='tempest-AttachVolumeTestJSON-1837009022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:42:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43ecf2b8c0f04d90a1ad6a780894fefc',uuid=7b0f5aad-e45c-4637-825c-cb295e98603a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converting VIF {"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f0:8d,bridge_name='br-int',has_traffic_filtering=True,id=ddf386ac-899d-4106-88a9-ec3916a51b7c,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf386ac-89') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG os_vif [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f0:8d,bridge_name='br-int',has_traffic_filtering=True,id=ddf386ac-899d-4106-88a9-ec3916a51b7c,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf386ac-89') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c3cd329-ea94-5b5b-8008-4a4199dd44a1', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddf386ac-89, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapddf386ac-89, col_values=(('qos', UUID('1b786f44-d4af-4aef-9f36-53bbcda430f7')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapddf386ac-89, col_values=(('external_ids', {'iface-id': 'ddf386ac-899d-4106-88a9-ec3916a51b7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:f0:8d', 'vm-uuid': '7b0f5aad-e45c-4637-825c-cb295e98603a'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:42:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:31 user nova-compute[75356]: INFO os_vif [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f0:8d,bridge_name='br-int',has_traffic_filtering=True,id=ddf386ac-899d-4106-88a9-ec3916a51b7c,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf386ac-89')
Nov 29 20:42:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:42:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] No VIF found with MAC fa:16:3e:8b:f0:8d, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:42:32 user nova-compute[75356]: DEBUG nova.network.neutron [req-9dd4b41c-7d85-40f7-94e8-fd5be6c57ecf req-ae1a137d-67e4-41f5-aea9-7c8cf1617c9c service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Updated VIF entry in instance network info cache for port ddf386ac-899d-4106-88a9-ec3916a51b7c. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:42:32 user nova-compute[75356]: DEBUG nova.network.neutron [req-9dd4b41c-7d85-40f7-94e8-fd5be6c57ecf req-ae1a137d-67e4-41f5-aea9-7c8cf1617c9c service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Updating instance_info_cache with network_info: [{"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:42:32 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9dd4b41c-7d85-40f7-94e8-fd5be6c57ecf req-ae1a137d-67e4-41f5-aea9-7c8cf1617c9c service nova] Releasing lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:42:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:33 user nova-compute[75356]: DEBUG nova.compute.manager [req-d451d066-18f7-49c3-92e9-1158654fe97f req-6b5f10ee-2296-4db0-9e36-0aec2ed71fe8 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received event network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:42:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d451d066-18f7-49c3-92e9-1158654fe97f req-6b5f10ee-2296-4db0-9e36-0aec2ed71fe8 service nova] Acquiring lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d451d066-18f7-49c3-92e9-1158654fe97f req-6b5f10ee-2296-4db0-9e36-0aec2ed71fe8 service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d451d066-18f7-49c3-92e9-1158654fe97f req-6b5f10ee-2296-4db0-9e36-0aec2ed71fe8 service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:33 user nova-compute[75356]: DEBUG nova.compute.manager [req-d451d066-18f7-49c3-92e9-1158654fe97f req-6b5f10ee-2296-4db0-9e36-0aec2ed71fe8 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] No waiting events found dispatching network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:42:33 user nova-compute[75356]: WARNING nova.compute.manager [req-d451d066-18f7-49c3-92e9-1158654fe97f req-6b5f10ee-2296-4db0-9e36-0aec2ed71fe8 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received unexpected event network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c for instance with vm_state building and task_state spawning.
Nov 29 20:42:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Acquiring lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:34 user nova-compute[75356]: DEBUG nova.compute.manager [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:42:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:34 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:42:34 user nova-compute[75356]: INFO nova.compute.claims [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Claim successful on node user
Nov 29 20:42:34 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:42:34 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:42:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:34 user nova-compute[75356]: DEBUG nova.compute.manager [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:42:34 user nova-compute[75356]: DEBUG nova.compute.manager [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:42:34 user nova-compute[75356]: DEBUG nova.network.neutron [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:42:34 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:42:34 user nova-compute[75356]: DEBUG nova.compute.manager [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:42:34 user nova-compute[75356]: DEBUG nova.policy [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cae1d8859ca742f99d90f205658e2760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a7b959735c4cf29119e47e9fe8f8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:42:34 user nova-compute[75356]: DEBUG nova.compute.manager [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:42:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:42:34 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Creating image(s)
Nov 29 20:42:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Acquiring lock "/opt/stack/data/nova/instances/81bda2d1-46e5-4ede-8d8c-0aacd0775357/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "/opt/stack/data/nova/instances/81bda2d1-46e5-4ede-8d8c-0aacd0775357/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "/opt/stack/data/nova/instances/81bda2d1-46e5-4ede-8d8c-0aacd0775357/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:34 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.185s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.296s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/81bda2d1-46e5-4ede-8d8c-0aacd0775357/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/81bda2d1-46e5-4ede-8d8c-0aacd0775357/disk 1073741824" returned: 0 in 0.058s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.361s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG nova.compute.manager [req-c4d9dd7e-6b88-4e5c-ae75-1ec47d0a8132 req-a0606057-ff10-40c5-a446-b38efb5b36fe service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received event network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c4d9dd7e-6b88-4e5c-ae75-1ec47d0a8132 req-a0606057-ff10-40c5-a446-b38efb5b36fe service nova] Acquiring lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c4d9dd7e-6b88-4e5c-ae75-1ec47d0a8132 req-a0606057-ff10-40c5-a446-b38efb5b36fe service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c4d9dd7e-6b88-4e5c-ae75-1ec47d0a8132 req-a0606057-ff10-40c5-a446-b38efb5b36fe service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG nova.compute.manager [req-c4d9dd7e-6b88-4e5c-ae75-1ec47d0a8132 req-a0606057-ff10-40c5-a446-b38efb5b36fe service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] No waiting events found dispatching network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:42:35 user nova-compute[75356]: WARNING nova.compute.manager [req-c4d9dd7e-6b88-4e5c-ae75-1ec47d0a8132 req-a0606057-ff10-40c5-a446-b38efb5b36fe service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received unexpected event network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c for instance with vm_state building and task_state spawning.
Nov 29 20:42:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.203s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81bda2d1-46e5-4ede-8d8c-0aacd0775357/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bda2d1-46e5-4ede-8d8c-0aacd0775357/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG nova.network.neutron [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Successfully created port: 913732fd-3fa1-4474-a7d6-bc45be8c6494 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG nova.compute.manager [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:42:35 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Instance spawned successfully.
Nov 29 20:42:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bda2d1-46e5-4ede-8d8c-0aacd0775357/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Cannot resize image /opt/stack/data/nova/instances/81bda2d1-46e5-4ede-8d8c-0aacd0775357/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Ensure instance console log exists: /opt/stack/data/nova/instances/81bda2d1-46e5-4ede-8d8c-0aacd0775357/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:35 user nova-compute[75356]: INFO nova.compute.manager [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Took 6.35 seconds to spawn the instance on the hypervisor.
Nov 29 20:42:35 user nova-compute[75356]: DEBUG nova.compute.manager [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:42:35 user nova-compute[75356]: INFO nova.compute.manager [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Took 6.99 seconds to build instance.
Nov 29 20:42:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3e56251c-99ad-437b-9b61-14e56245ded4 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.087s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.network.neutron [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Successfully updated port: 913732fd-3fa1-4474-a7d6-bc45be8c6494 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Acquiring lock "refresh_cache-81bda2d1-46e5-4ede-8d8c-0aacd0775357" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Acquired lock "refresh_cache-81bda2d1-46e5-4ede-8d8c-0aacd0775357" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.network.neutron [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.compute.manager [req-1094b03e-6ac4-42dd-bae3-8ebec3a1558f req-e0757244-fc56-4d4e-8090-d38199ae358e service nova] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Received event network-changed-913732fd-3fa1-4474-a7d6-bc45be8c6494 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.compute.manager [req-1094b03e-6ac4-42dd-bae3-8ebec3a1558f req-e0757244-fc56-4d4e-8090-d38199ae358e service nova] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Refreshing instance network info cache due to event network-changed-913732fd-3fa1-4474-a7d6-bc45be8c6494. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1094b03e-6ac4-42dd-bae3-8ebec3a1558f req-e0757244-fc56-4d4e-8090-d38199ae358e service nova] Acquiring lock "refresh_cache-81bda2d1-46e5-4ede-8d8c-0aacd0775357" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.network.neutron [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.network.neutron [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Updating instance_info_cache with network_info: [{"id": "913732fd-3fa1-4474-a7d6-bc45be8c6494", "address": "fa:16:3e:06:4f:ea", "network": {"id": "3c2575ba-8eac-478b-be1a-cbaf757e68da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647638728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a7b959735c4cf29119e47e9fe8f8bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap913732fd-3f", "ovs_interfaceid": "913732fd-3fa1-4474-a7d6-bc45be8c6494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Releasing lock "refresh_cache-81bda2d1-46e5-4ede-8d8c-0aacd0775357" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.compute.manager [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Instance network_info: |[{"id": "913732fd-3fa1-4474-a7d6-bc45be8c6494", "address": "fa:16:3e:06:4f:ea", "network": {"id": "3c2575ba-8eac-478b-be1a-cbaf757e68da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647638728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a7b959735c4cf29119e47e9fe8f8bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap913732fd-3f", "ovs_interfaceid": "913732fd-3fa1-4474-a7d6-bc45be8c6494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1094b03e-6ac4-42dd-bae3-8ebec3a1558f req-e0757244-fc56-4d4e-8090-d38199ae358e service nova] Acquired lock "refresh_cache-81bda2d1-46e5-4ede-8d8c-0aacd0775357" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.network.neutron [req-1094b03e-6ac4-42dd-bae3-8ebec3a1558f req-e0757244-fc56-4d4e-8090-d38199ae358e service nova] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Refreshing network info cache for port 913732fd-3fa1-4474-a7d6-bc45be8c6494 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Start _get_guest_xml network_info=[{"id": "913732fd-3fa1-4474-a7d6-bc45be8c6494", "address": "fa:16:3e:06:4f:ea", "network": {"id": "3c2575ba-8eac-478b-be1a-cbaf757e68da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647638728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a7b959735c4cf29119e47e9fe8f8bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap913732fd-3f", "ovs_interfaceid": "913732fd-3fa1-4474-a7d6-bc45be8c6494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:42:36 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:42:36 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:42:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-300901372',display_name='tempest-VolumesActionsTest-instance-300901372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-300901372',id=47,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04a7b959735c4cf29119e47e9fe8f8bb',ramdisk_id='',reservation_id='r-a2ykto9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1193759144',owner_user_name='tempest-VolumesActionsTest-1193759144-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:42:35Z,user_data=None,user_id='cae1d8859ca742f99d90f205658e2760',uuid=81bda2d1-46e5-4ede-8d8c-0aacd0775357,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "913732fd-3fa1-4474-a7d6-bc45be8c6494", "address": "fa:16:3e:06:4f:ea", "network": {"id": "3c2575ba-8eac-478b-be1a-cbaf757e68da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647638728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a7b959735c4cf29119e47e9fe8f8bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap913732fd-3f", "ovs_interfaceid": "913732fd-3fa1-4474-a7d6-bc45be8c6494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Converting VIF {"id": "913732fd-3fa1-4474-a7d6-bc45be8c6494", "address": "fa:16:3e:06:4f:ea", "network": {"id": "3c2575ba-8eac-478b-be1a-cbaf757e68da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647638728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a7b959735c4cf29119e47e9fe8f8bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap913732fd-3f", "ovs_interfaceid": "913732fd-3fa1-4474-a7d6-bc45be8c6494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:4f:ea,bridge_name='br-int',has_traffic_filtering=True,id=913732fd-3fa1-4474-a7d6-bc45be8c6494,network=Network(3c2575ba-8eac-478b-be1a-cbaf757e68da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap913732fd-3f') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:42:36 user nova-compute[75356]: DEBUG nova.objects.instance [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lazy-loading 'pci_devices' on Instance uuid 81bda2d1-46e5-4ede-8d8c-0aacd0775357 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:42:37 user nova-compute[75356]:   <uuid>81bda2d1-46e5-4ede-8d8c-0aacd0775357</uuid>
Nov 29 20:42:37 user nova-compute[75356]:   <name>instance-0000002f</name>
Nov 29 20:42:37 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:42:37 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:42:37 user nova-compute[75356]:   <metadata>
Nov 29 20:42:37 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:42:37 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:42:37 user nova-compute[75356]:       <nova:name>tempest-VolumesActionsTest-instance-300901372</nova:name>
Nov 29 20:42:37 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:42:36</nova:creationTime>
Nov 29 20:42:37 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:42:37 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:42:37 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:42:37 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:42:37 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:42:37 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:42:37 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:42:37 user nova-compute[75356]:       <nova:owner>
Nov 29 20:42:37 user nova-compute[75356]:         <nova:user uuid="cae1d8859ca742f99d90f205658e2760">tempest-VolumesActionsTest-1193759144-project-member</nova:user>
Nov 29 20:42:37 user nova-compute[75356]:         <nova:project uuid="04a7b959735c4cf29119e47e9fe8f8bb">tempest-VolumesActionsTest-1193759144</nova:project>
Nov 29 20:42:37 user nova-compute[75356]:       </nova:owner>
Nov 29 20:42:37 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:42:37 user nova-compute[75356]:       <nova:ports>
Nov 29 20:42:37 user nova-compute[75356]:         <nova:port uuid="913732fd-3fa1-4474-a7d6-bc45be8c6494">
Nov 29 20:42:37 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 20:42:37 user nova-compute[75356]:         </nova:port>
Nov 29 20:42:37 user nova-compute[75356]:       </nova:ports>
Nov 29 20:42:37 user nova-compute[75356]:     </nova:instance>
Nov 29 20:42:37 user nova-compute[75356]:   </metadata>
Nov 29 20:42:37 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:42:37 user nova-compute[75356]:     <system>
Nov 29 20:42:37 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:42:37 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:42:37 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:42:37 user nova-compute[75356]:       <entry name="serial">81bda2d1-46e5-4ede-8d8c-0aacd0775357</entry>
Nov 29 20:42:37 user nova-compute[75356]:       <entry name="uuid">81bda2d1-46e5-4ede-8d8c-0aacd0775357</entry>
Nov 29 20:42:37 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:42:37 user nova-compute[75356]:     </system>
Nov 29 20:42:37 user nova-compute[75356]:   </sysinfo>
Nov 29 20:42:37 user nova-compute[75356]:   <os>
Nov 29 20:42:37 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:42:37 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:42:37 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:42:37 user nova-compute[75356]:   </os>
Nov 29 20:42:37 user nova-compute[75356]:   <features>
Nov 29 20:42:37 user nova-compute[75356]:     <acpi/>
Nov 29 20:42:37 user nova-compute[75356]:     <apic/>
Nov 29 20:42:37 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:42:37 user nova-compute[75356]:   </features>
Nov 29 20:42:37 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:42:37 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:42:37 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:42:37 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:42:37 user nova-compute[75356]:   </clock>
Nov 29 20:42:37 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:42:37 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:42:37 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:42:37 user nova-compute[75356]:   </cpu>
Nov 29 20:42:37 user nova-compute[75356]:   <devices>
Nov 29 20:42:37 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:42:37 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:42:37 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/81bda2d1-46e5-4ede-8d8c-0aacd0775357/disk"/>
Nov 29 20:42:37 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:42:37 user nova-compute[75356]:     </disk>
Nov 29 20:42:37 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:42:37 user nova-compute[75356]:       <mac address="fa:16:3e:06:4f:ea"/>
Nov 29 20:42:37 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:42:37 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:42:37 user nova-compute[75356]:       <target dev="tap913732fd-3f"/>
Nov 29 20:42:37 user nova-compute[75356]:     </interface>
Nov 29 20:42:37 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:42:37 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/81bda2d1-46e5-4ede-8d8c-0aacd0775357/console.log" append="off"/>
Nov 29 20:42:37 user nova-compute[75356]:     </serial>
Nov 29 20:42:37 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:42:37 user nova-compute[75356]:     <video>
Nov 29 20:42:37 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:42:37 user nova-compute[75356]:     </video>
Nov 29 20:42:37 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:42:37 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:42:37 user nova-compute[75356]:     </rng>
Nov 29 20:42:37 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:42:37 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:42:37 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:42:37 user nova-compute[75356]:     </memballoon>
Nov 29 20:42:37 user nova-compute[75356]:   </devices>
Nov 29 20:42:37 user nova-compute[75356]: </domain>
Nov 29 20:42:37 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:42:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-300901372',display_name='tempest-VolumesActionsTest-instance-300901372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-300901372',id=47,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04a7b959735c4cf29119e47e9fe8f8bb',ramdisk_id='',reservation_id='r-a2ykto9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1193759144',owner_user_name='tempest-VolumesActionsTest-1193759144-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:42:35Z,user_data=None,user_id='cae1d8859ca742f99d90f205658e2760',uuid=81bda2d1-46e5-4ede-8d8c-0aacd0775357,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "913732fd-3fa1-4474-a7d6-bc45be8c6494", "address": "fa:16:3e:06:4f:ea", "network": {"id": "3c2575ba-8eac-478b-be1a-cbaf757e68da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647638728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a7b959735c4cf29119e47e9fe8f8bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap913732fd-3f", "ovs_interfaceid": "913732fd-3fa1-4474-a7d6-bc45be8c6494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Converting VIF {"id": "913732fd-3fa1-4474-a7d6-bc45be8c6494", "address": "fa:16:3e:06:4f:ea", "network": {"id": "3c2575ba-8eac-478b-be1a-cbaf757e68da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647638728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a7b959735c4cf29119e47e9fe8f8bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap913732fd-3f", "ovs_interfaceid": "913732fd-3fa1-4474-a7d6-bc45be8c6494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:4f:ea,bridge_name='br-int',has_traffic_filtering=True,id=913732fd-3fa1-4474-a7d6-bc45be8c6494,network=Network(3c2575ba-8eac-478b-be1a-cbaf757e68da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap913732fd-3f') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG os_vif [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:4f:ea,bridge_name='br-int',has_traffic_filtering=True,id=913732fd-3fa1-4474-a7d6-bc45be8c6494,network=Network(3c2575ba-8eac-478b-be1a-cbaf757e68da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap913732fd-3f') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '433f5666-4b55-59c3-85bf-80d430f3d38d', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap913732fd-3f, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap913732fd-3f, col_values=(('qos', UUID('a4b75d09-64ad-4185-81f4-73ddc4700c30')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap913732fd-3f, col_values=(('external_ids', {'iface-id': '913732fd-3fa1-4474-a7d6-bc45be8c6494', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:4f:ea', 'vm-uuid': '81bda2d1-46e5-4ede-8d8c-0aacd0775357'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:37 user nova-compute[75356]: INFO os_vif [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:4f:ea,bridge_name='br-int',has_traffic_filtering=True,id=913732fd-3fa1-4474-a7d6-bc45be8c6494,network=Network(3c2575ba-8eac-478b-be1a-cbaf757e68da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap913732fd-3f')
Nov 29 20:42:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] No VIF found with MAC fa:16:3e:06:4f:ea, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG nova.network.neutron [req-1094b03e-6ac4-42dd-bae3-8ebec3a1558f req-e0757244-fc56-4d4e-8090-d38199ae358e service nova] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Updated VIF entry in instance network info cache for port 913732fd-3fa1-4474-a7d6-bc45be8c6494. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:42:37 user nova-compute[75356]: DEBUG nova.network.neutron [req-1094b03e-6ac4-42dd-bae3-8ebec3a1558f req-e0757244-fc56-4d4e-8090-d38199ae358e service nova] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Updating instance_info_cache with network_info: [{"id": "913732fd-3fa1-4474-a7d6-bc45be8c6494", "address": "fa:16:3e:06:4f:ea", "network": {"id": "3c2575ba-8eac-478b-be1a-cbaf757e68da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647638728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a7b959735c4cf29119e47e9fe8f8bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap913732fd-3f", "ovs_interfaceid": "913732fd-3fa1-4474-a7d6-bc45be8c6494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:42:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1094b03e-6ac4-42dd-bae3-8ebec3a1558f req-e0757244-fc56-4d4e-8090-d38199ae358e service nova] Releasing lock "refresh_cache-81bda2d1-46e5-4ede-8d8c-0aacd0775357" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:42:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:38 user nova-compute[75356]: DEBUG nova.compute.manager [req-91b2656d-871f-4c5d-8fbe-53a81172cfc4 req-0344fd88-e8f8-4198-baf8-edda6e1105be service nova] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Received event network-vif-plugged-913732fd-3fa1-4474-a7d6-bc45be8c6494 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:42:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-91b2656d-871f-4c5d-8fbe-53a81172cfc4 req-0344fd88-e8f8-4198-baf8-edda6e1105be service nova] Acquiring lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-91b2656d-871f-4c5d-8fbe-53a81172cfc4 req-0344fd88-e8f8-4198-baf8-edda6e1105be service nova] Lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-91b2656d-871f-4c5d-8fbe-53a81172cfc4 req-0344fd88-e8f8-4198-baf8-edda6e1105be service nova] Lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:38 user nova-compute[75356]: DEBUG nova.compute.manager [req-91b2656d-871f-4c5d-8fbe-53a81172cfc4 req-0344fd88-e8f8-4198-baf8-edda6e1105be service nova] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] No waiting events found dispatching network-vif-plugged-913732fd-3fa1-4474-a7d6-bc45be8c6494 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:42:38 user nova-compute[75356]: WARNING nova.compute.manager [req-91b2656d-871f-4c5d-8fbe-53a81172cfc4 req-0344fd88-e8f8-4198-baf8-edda6e1105be service nova] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Received unexpected event network-vif-plugged-913732fd-3fa1-4474-a7d6-bc45be8c6494 for instance with vm_state building and task_state spawning.
Nov 29 20:42:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:41 user nova-compute[75356]: DEBUG nova.compute.manager [req-d0f9ce39-2c14-4e1b-9023-ca717e7f9898 req-958ac6aa-a53f-40b1-95e1-9efdc419b227 service nova] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Received event network-vif-plugged-913732fd-3fa1-4474-a7d6-bc45be8c6494 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:42:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d0f9ce39-2c14-4e1b-9023-ca717e7f9898 req-958ac6aa-a53f-40b1-95e1-9efdc419b227 service nova] Acquiring lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d0f9ce39-2c14-4e1b-9023-ca717e7f9898 req-958ac6aa-a53f-40b1-95e1-9efdc419b227 service nova] Lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d0f9ce39-2c14-4e1b-9023-ca717e7f9898 req-958ac6aa-a53f-40b1-95e1-9efdc419b227 service nova] Lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:41 user nova-compute[75356]: DEBUG nova.compute.manager [req-d0f9ce39-2c14-4e1b-9023-ca717e7f9898 req-958ac6aa-a53f-40b1-95e1-9efdc419b227 service nova] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] No waiting events found dispatching network-vif-plugged-913732fd-3fa1-4474-a7d6-bc45be8c6494 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:42:41 user nova-compute[75356]: WARNING nova.compute.manager [req-d0f9ce39-2c14-4e1b-9023-ca717e7f9898 req-958ac6aa-a53f-40b1-95e1-9efdc419b227 service nova] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Received unexpected event network-vif-plugged-913732fd-3fa1-4474-a7d6-bc45be8c6494 for instance with vm_state building and task_state spawning.
Nov 29 20:42:41 user nova-compute[75356]: DEBUG nova.compute.manager [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:42:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:42:41 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Instance spawned successfully.
Nov 29 20:42:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:42:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:42:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:42:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:42:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:42:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:42:41 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:42:41 user nova-compute[75356]: INFO nova.compute.manager [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Took 6.34 seconds to spawn the instance on the hypervisor.
Nov 29 20:42:41 user nova-compute[75356]: DEBUG nova.compute.manager [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:42:41 user nova-compute[75356]: INFO nova.compute.manager [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Took 6.94 seconds to build instance.
Nov 29 20:42:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-61dbe597-347e-4b34-9c34-59ef412875ca tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.036s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:51 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Acquiring lock "0e877523-8409-4827-88cb-5c04c1f9604f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Lock "0e877523-8409-4827-88cb-5c04c1f9604f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:42:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:52 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:42:52 user nova-compute[75356]: INFO nova.compute.claims [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Claim successful on node user
Nov 29 20:42:52 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:42:52 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:42:52 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.276s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:42:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:42:52 user nova-compute[75356]: DEBUG nova.network.neutron [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:42:52 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:42:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:42:52 user nova-compute[75356]: DEBUG nova.policy [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f54c7bea442c4c50886ffef8f2cb2dcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821217e86dd74fcbbfd4c4b667495abc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:42:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:42:52 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:42:52 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Creating image(s)
Nov 29 20:42:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e877523-8409-4827-88cb-5c04c1f9604f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Lock "/opt/stack/data/nova/instances/0e877523-8409-4827-88cb-5c04c1f9604f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Lock "/opt/stack/data/nova/instances/0e877523-8409-4827-88cb-5c04c1f9604f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:42:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.177s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:42:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:42:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:42:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/0e877523-8409-4827-88cb-5c04c1f9604f/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:42:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/0e877523-8409-4827-88cb-5c04c1f9604f/disk 1073741824" returned: 0 in 0.055s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:42:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:42:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.191s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:42:53 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e877523-8409-4827-88cb-5c04c1f9604f/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:42:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e877523-8409-4827-88cb-5c04c1f9604f/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:42:53 user nova-compute[75356]: DEBUG nova.network.neutron [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Successfully created port: fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:42:53 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e877523-8409-4827-88cb-5c04c1f9604f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:42:53 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Cannot resize image /opt/stack/data/nova/instances/0e877523-8409-4827-88cb-5c04c1f9604f/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:42:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:42:53 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Ensure instance console log exists: /opt/stack/data/nova/instances/0e877523-8409-4827-88cb-5c04c1f9604f/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:42:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:53 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.network.neutron [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Successfully updated port: fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Acquiring lock "refresh_cache-0e877523-8409-4827-88cb-5c04c1f9604f" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Acquired lock "refresh_cache-0e877523-8409-4827-88cb-5c04c1f9604f" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.network.neutron [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.compute.manager [req-a88c61da-7848-44ea-b2a6-b9fc0ab5c3ef req-234c83d5-9963-414a-9b3b-286b273aa37a service nova] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Received event network-changed-fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.compute.manager [req-a88c61da-7848-44ea-b2a6-b9fc0ab5c3ef req-234c83d5-9963-414a-9b3b-286b273aa37a service nova] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Refreshing instance network info cache due to event network-changed-fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a88c61da-7848-44ea-b2a6-b9fc0ab5c3ef req-234c83d5-9963-414a-9b3b-286b273aa37a service nova] Acquiring lock "refresh_cache-0e877523-8409-4827-88cb-5c04c1f9604f" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.network.neutron [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.network.neutron [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Updating instance_info_cache with network_info: [{"id": "fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd", "address": "fa:16:3e:b3:b2:a3", "network": {"id": "0c22d5d3-b93e-46b4-80d3-31d3ed402dd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005055289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "821217e86dd74fcbbfd4c4b667495abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb0fc0c9-e1", "ovs_interfaceid": "fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Releasing lock "refresh_cache-0e877523-8409-4827-88cb-5c04c1f9604f" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.compute.manager [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Instance network_info: |[{"id": "fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd", "address": "fa:16:3e:b3:b2:a3", "network": {"id": "0c22d5d3-b93e-46b4-80d3-31d3ed402dd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005055289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "821217e86dd74fcbbfd4c4b667495abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb0fc0c9-e1", "ovs_interfaceid": "fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a88c61da-7848-44ea-b2a6-b9fc0ab5c3ef req-234c83d5-9963-414a-9b3b-286b273aa37a service nova] Acquired lock "refresh_cache-0e877523-8409-4827-88cb-5c04c1f9604f" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.network.neutron [req-a88c61da-7848-44ea-b2a6-b9fc0ab5c3ef req-234c83d5-9963-414a-9b3b-286b273aa37a service nova] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Refreshing network info cache for port fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Start _get_guest_xml network_info=[{"id": "fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd", "address": "fa:16:3e:b3:b2:a3", "network": {"id": "0c22d5d3-b93e-46b4-80d3-31d3ed402dd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005055289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "821217e86dd74fcbbfd4c4b667495abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb0fc0c9-e1", "ovs_interfaceid": "fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:42:54 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:42:54 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-846488318',display_name='tempest-VolumesActionsTest-instance-846488318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-846488318',id=48,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='821217e86dd74fcbbfd4c4b667495abc',ramdisk_id='',reservation_id='r-qrr6thtq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1384750743',owner_user_name='tempest-VolumesActionsTest-1384750743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:42:53Z,user_data=None,user_id='f54c7bea442c4c50886ffef8f2cb2dcf',uuid=0e877523-8409-4827-88cb-5c04c1f9604f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd", "address": "fa:16:3e:b3:b2:a3", "network": {"id": "0c22d5d3-b93e-46b4-80d3-31d3ed402dd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005055289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "821217e86dd74fcbbfd4c4b667495abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb0fc0c9-e1", "ovs_interfaceid": "fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Converting VIF {"id": "fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd", "address": "fa:16:3e:b3:b2:a3", "network": {"id": "0c22d5d3-b93e-46b4-80d3-31d3ed402dd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005055289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "821217e86dd74fcbbfd4c4b667495abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb0fc0c9-e1", "ovs_interfaceid": "fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:b2:a3,bridge_name='br-int',has_traffic_filtering=True,id=fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd,network=Network(0c22d5d3-b93e-46b4-80d3-31d3ed402dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb0fc0c9-e1') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.objects.instance [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e877523-8409-4827-88cb-5c04c1f9604f {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:42:54 user nova-compute[75356]:   <uuid>0e877523-8409-4827-88cb-5c04c1f9604f</uuid>
Nov 29 20:42:54 user nova-compute[75356]:   <name>instance-00000030</name>
Nov 29 20:42:54 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:42:54 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:42:54 user nova-compute[75356]:   <metadata>
Nov 29 20:42:54 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:42:54 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:42:54 user nova-compute[75356]:       <nova:name>tempest-VolumesActionsTest-instance-846488318</nova:name>
Nov 29 20:42:54 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:42:54</nova:creationTime>
Nov 29 20:42:54 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:42:54 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:42:54 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:42:54 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:42:54 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:42:54 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:42:54 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:42:54 user nova-compute[75356]:       <nova:owner>
Nov 29 20:42:54 user nova-compute[75356]:         <nova:user uuid="f54c7bea442c4c50886ffef8f2cb2dcf">tempest-VolumesActionsTest-1384750743-project-member</nova:user>
Nov 29 20:42:54 user nova-compute[75356]:         <nova:project uuid="821217e86dd74fcbbfd4c4b667495abc">tempest-VolumesActionsTest-1384750743</nova:project>
Nov 29 20:42:54 user nova-compute[75356]:       </nova:owner>
Nov 29 20:42:54 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:42:54 user nova-compute[75356]:       <nova:ports>
Nov 29 20:42:54 user nova-compute[75356]:         <nova:port uuid="fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd">
Nov 29 20:42:54 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 20:42:54 user nova-compute[75356]:         </nova:port>
Nov 29 20:42:54 user nova-compute[75356]:       </nova:ports>
Nov 29 20:42:54 user nova-compute[75356]:     </nova:instance>
Nov 29 20:42:54 user nova-compute[75356]:   </metadata>
Nov 29 20:42:54 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:42:54 user nova-compute[75356]:     <system>
Nov 29 20:42:54 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:42:54 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:42:54 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:42:54 user nova-compute[75356]:       <entry name="serial">0e877523-8409-4827-88cb-5c04c1f9604f</entry>
Nov 29 20:42:54 user nova-compute[75356]:       <entry name="uuid">0e877523-8409-4827-88cb-5c04c1f9604f</entry>
Nov 29 20:42:54 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:42:54 user nova-compute[75356]:     </system>
Nov 29 20:42:54 user nova-compute[75356]:   </sysinfo>
Nov 29 20:42:54 user nova-compute[75356]:   <os>
Nov 29 20:42:54 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:42:54 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:42:54 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:42:54 user nova-compute[75356]:   </os>
Nov 29 20:42:54 user nova-compute[75356]:   <features>
Nov 29 20:42:54 user nova-compute[75356]:     <acpi/>
Nov 29 20:42:54 user nova-compute[75356]:     <apic/>
Nov 29 20:42:54 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:42:54 user nova-compute[75356]:   </features>
Nov 29 20:42:54 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:42:54 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:42:54 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:42:54 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:42:54 user nova-compute[75356]:   </clock>
Nov 29 20:42:54 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:42:54 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:42:54 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:42:54 user nova-compute[75356]:   </cpu>
Nov 29 20:42:54 user nova-compute[75356]:   <devices>
Nov 29 20:42:54 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:42:54 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:42:54 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/0e877523-8409-4827-88cb-5c04c1f9604f/disk"/>
Nov 29 20:42:54 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:42:54 user nova-compute[75356]:     </disk>
Nov 29 20:42:54 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:42:54 user nova-compute[75356]:       <mac address="fa:16:3e:b3:b2:a3"/>
Nov 29 20:42:54 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:42:54 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:42:54 user nova-compute[75356]:       <target dev="tapfb0fc0c9-e1"/>
Nov 29 20:42:54 user nova-compute[75356]:     </interface>
Nov 29 20:42:54 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:42:54 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/0e877523-8409-4827-88cb-5c04c1f9604f/console.log" append="off"/>
Nov 29 20:42:54 user nova-compute[75356]:     </serial>
Nov 29 20:42:54 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:42:54 user nova-compute[75356]:     <video>
Nov 29 20:42:54 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:42:54 user nova-compute[75356]:     </video>
Nov 29 20:42:54 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:42:54 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:42:54 user nova-compute[75356]:     </rng>
Nov 29 20:42:54 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:42:54 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:42:54 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:42:54 user nova-compute[75356]:     </memballoon>
Nov 29 20:42:54 user nova-compute[75356]:   </devices>
Nov 29 20:42:54 user nova-compute[75356]: </domain>
Nov 29 20:42:54 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-846488318',display_name='tempest-VolumesActionsTest-instance-846488318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-846488318',id=48,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='821217e86dd74fcbbfd4c4b667495abc',ramdisk_id='',reservation_id='r-qrr6thtq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1384750743',owner_user_name='tempest-VolumesActionsTest-1384750743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:42:53Z,user_data=None,user_id='f54c7bea442c4c50886ffef8f2cb2dcf',uuid=0e877523-8409-4827-88cb-5c04c1f9604f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd", "address": "fa:16:3e:b3:b2:a3", "network": {"id": "0c22d5d3-b93e-46b4-80d3-31d3ed402dd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005055289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "821217e86dd74fcbbfd4c4b667495abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb0fc0c9-e1", "ovs_interfaceid": "fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Converting VIF {"id": "fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd", "address": "fa:16:3e:b3:b2:a3", "network": {"id": "0c22d5d3-b93e-46b4-80d3-31d3ed402dd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005055289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "821217e86dd74fcbbfd4c4b667495abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb0fc0c9-e1", "ovs_interfaceid": "fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:b2:a3,bridge_name='br-int',has_traffic_filtering=True,id=fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd,network=Network(0c22d5d3-b93e-46b4-80d3-31d3ed402dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb0fc0c9-e1') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG os_vif [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:b2:a3,bridge_name='br-int',has_traffic_filtering=True,id=fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd,network=Network(0c22d5d3-b93e-46b4-80d3-31d3ed402dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb0fc0c9-e1') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c7115c2-fe3c-52b7-baf2-70e20a84ba0a', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb0fc0c9-e1, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb0fc0c9-e1, col_values=(('qos', UUID('dbc21dbc-9b99-490c-9e11-4af05541ceac')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb0fc0c9-e1, col_values=(('external_ids', {'iface-id': 'fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:b2:a3', 'vm-uuid': '0e877523-8409-4827-88cb-5c04c1f9604f'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:54 user nova-compute[75356]: INFO os_vif [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:b2:a3,bridge_name='br-int',has_traffic_filtering=True,id=fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd,network=Network(0c22d5d3-b93e-46b4-80d3-31d3ed402dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb0fc0c9-e1')
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:42:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] No VIF found with MAC fa:16:3e:b3:b2:a3, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:42:55 user nova-compute[75356]: DEBUG nova.network.neutron [req-a88c61da-7848-44ea-b2a6-b9fc0ab5c3ef req-234c83d5-9963-414a-9b3b-286b273aa37a service nova] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Updated VIF entry in instance network info cache for port fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:42:55 user nova-compute[75356]: DEBUG nova.network.neutron [req-a88c61da-7848-44ea-b2a6-b9fc0ab5c3ef req-234c83d5-9963-414a-9b3b-286b273aa37a service nova] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Updating instance_info_cache with network_info: [{"id": "fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd", "address": "fa:16:3e:b3:b2:a3", "network": {"id": "0c22d5d3-b93e-46b4-80d3-31d3ed402dd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005055289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "821217e86dd74fcbbfd4c4b667495abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb0fc0c9-e1", "ovs_interfaceid": "fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:42:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a88c61da-7848-44ea-b2a6-b9fc0ab5c3ef req-234c83d5-9963-414a-9b3b-286b273aa37a service nova] Releasing lock "refresh_cache-0e877523-8409-4827-88cb-5c04c1f9604f" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:42:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:56 user nova-compute[75356]: DEBUG nova.compute.manager [req-da8f7376-954b-4ca4-89b1-c09278c2dba3 req-fbf95620-7455-4994-b951-8f1fb774e70a service nova] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Received event network-vif-plugged-fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:42:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-da8f7376-954b-4ca4-89b1-c09278c2dba3 req-fbf95620-7455-4994-b951-8f1fb774e70a service nova] Acquiring lock "0e877523-8409-4827-88cb-5c04c1f9604f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-da8f7376-954b-4ca4-89b1-c09278c2dba3 req-fbf95620-7455-4994-b951-8f1fb774e70a service nova] Lock "0e877523-8409-4827-88cb-5c04c1f9604f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-da8f7376-954b-4ca4-89b1-c09278c2dba3 req-fbf95620-7455-4994-b951-8f1fb774e70a service nova] Lock "0e877523-8409-4827-88cb-5c04c1f9604f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:56 user nova-compute[75356]: DEBUG nova.compute.manager [req-da8f7376-954b-4ca4-89b1-c09278c2dba3 req-fbf95620-7455-4994-b951-8f1fb774e70a service nova] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] No waiting events found dispatching network-vif-plugged-fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:42:56 user nova-compute[75356]: WARNING nova.compute.manager [req-da8f7376-954b-4ca4-89b1-c09278c2dba3 req-fbf95620-7455-4994-b951-8f1fb774e70a service nova] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Received unexpected event network-vif-plugged-fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd for instance with vm_state building and task_state spawning.
Nov 29 20:42:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:42:58 user nova-compute[75356]: DEBUG nova.compute.manager [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:42:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:42:58 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Instance spawned successfully.
Nov 29 20:42:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:42:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:42:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:42:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:42:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:42:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:42:58 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:42:58 user nova-compute[75356]: INFO nova.compute.manager [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 29 20:42:58 user nova-compute[75356]: DEBUG nova.compute.manager [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:42:58 user nova-compute[75356]: INFO nova.compute.manager [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Took 6.24 seconds to build instance.
Nov 29 20:42:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-4afec4ac-35a7-4405-ab85-a6893e7f3e7d tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Lock "0e877523-8409-4827-88cb-5c04c1f9604f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.332s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:58 user nova-compute[75356]: DEBUG nova.compute.manager [req-132c3d40-8a27-4bcb-a9d9-2dd95f0690ba req-a85cb3de-d7ea-4a89-b37c-c643a17fb6fe service nova] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Received event network-vif-plugged-fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:42:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-132c3d40-8a27-4bcb-a9d9-2dd95f0690ba req-a85cb3de-d7ea-4a89-b37c-c643a17fb6fe service nova] Acquiring lock "0e877523-8409-4827-88cb-5c04c1f9604f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:42:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-132c3d40-8a27-4bcb-a9d9-2dd95f0690ba req-a85cb3de-d7ea-4a89-b37c-c643a17fb6fe service nova] Lock "0e877523-8409-4827-88cb-5c04c1f9604f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:42:58 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-132c3d40-8a27-4bcb-a9d9-2dd95f0690ba req-a85cb3de-d7ea-4a89-b37c-c643a17fb6fe service nova] Lock "0e877523-8409-4827-88cb-5c04c1f9604f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:42:58 user nova-compute[75356]: DEBUG nova.compute.manager [req-132c3d40-8a27-4bcb-a9d9-2dd95f0690ba req-a85cb3de-d7ea-4a89-b37c-c643a17fb6fe service nova] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] No waiting events found dispatching network-vif-plugged-fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:42:58 user nova-compute[75356]: WARNING nova.compute.manager [req-132c3d40-8a27-4bcb-a9d9-2dd95f0690ba req-a85cb3de-d7ea-4a89-b37c-c643a17fb6fe service nova] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Received unexpected event network-vif-plugged-fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd for instance with vm_state active and task_state None.
Nov 29 20:42:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:43:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:43:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:43:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:43:05 user nova-compute[75356]: DEBUG nova.compute.manager [req-2c6be01c-7946-43ec-80f3-f11ac58279d3 req-fe8baa14-0df2-427b-a583-34e6a0212179 service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Received event network-changed-8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:43:05 user nova-compute[75356]: DEBUG nova.compute.manager [req-2c6be01c-7946-43ec-80f3-f11ac58279d3 req-fe8baa14-0df2-427b-a583-34e6a0212179 service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Refreshing instance network info cache due to event network-changed-8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:43:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2c6be01c-7946-43ec-80f3-f11ac58279d3 req-fe8baa14-0df2-427b-a583-34e6a0212179 service nova] Acquiring lock "refresh_cache-f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:43:05 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2c6be01c-7946-43ec-80f3-f11ac58279d3 req-fe8baa14-0df2-427b-a583-34e6a0212179 service nova] Acquired lock "refresh_cache-f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:43:05 user nova-compute[75356]: DEBUG nova.network.neutron [req-2c6be01c-7946-43ec-80f3-f11ac58279d3 req-fe8baa14-0df2-427b-a583-34e6a0212179 service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Refreshing network info cache for port 8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:43:06 user nova-compute[75356]: DEBUG nova.network.neutron [req-2c6be01c-7946-43ec-80f3-f11ac58279d3 req-fe8baa14-0df2-427b-a583-34e6a0212179 service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Updated VIF entry in instance network info cache for port 8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:43:06 user nova-compute[75356]: DEBUG nova.network.neutron [req-2c6be01c-7946-43ec-80f3-f11ac58279d3 req-fe8baa14-0df2-427b-a583-34e6a0212179 service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Updating instance_info_cache with network_info: [{"id": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "address": "fa:16:3e:99:eb:79", "network": {"id": "9f7cb915-67ff-4081-abfb-03e49aad02c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-471863428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adafeea8f34e40728c5086c1e3f59397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6152ce-bf", "ovs_interfaceid": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:43:06 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-2c6be01c-7946-43ec-80f3-f11ac58279d3 req-fe8baa14-0df2-427b-a583-34e6a0212179 service nova] Releasing lock "refresh_cache-f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:43:07 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:43:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Acquiring lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG nova.objects.instance [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lazy-loading 'flavor' on Instance uuid f99c7008-ffbd-4f5c-96ef-ac50832b3f4c {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Acquiring lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:43:09 user nova-compute[75356]: INFO nova.compute.manager [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Attaching volume e67f93bc-1df1-45d5-a8d1-f897f66165ca to /dev/vdb
Nov 29 20:43:09 user nova-compute[75356]: DEBUG os_brick.utils [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfadc64-5514-44c7-80fd-7cc9bd869e53]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fab274-f8e7-4050-b390-fc4c99f4e3b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cba0f0b-e979-4e3d-9e86-fc71b8e69f37]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fac2fca-4342-45a8-aa17-7949fb304f30]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:43:09 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:43:09 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adc990b-b4fa-44e4-a321-bb529fa60116]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG os_brick.utils [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Updating existing volume attachment record: 0bc1087d-9f72-4a7d-8c3d-0f4c213243a3 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:43:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:43:11 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:43:11 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:43:11 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 20:43:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:43:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:43:11 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:43:11 user nova-compute[75356]: DEBUG nova.objects.instance [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lazy-loading 'info_cache' on Instance uuid f99c7008-ffbd-4f5c-96ef-ac50832b3f4c {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:43:11 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Updating instance_info_cache with network_info: [{"id": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "address": "fa:16:3e:99:eb:79", "network": {"id": "9f7cb915-67ff-4081-abfb-03e49aad02c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-471863428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adafeea8f34e40728c5086c1e3f59397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6152ce-bf", "ovs_interfaceid": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:43:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:43:11 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:43:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:43:13 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:43:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:43:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:43:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:43:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:43:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:43:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:43:14 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:43:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bda2d1-46e5-4ede-8d8c-0aacd0775357/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bda2d1-46e5-4ede-8d8c-0aacd0775357/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bda2d1-46e5-4ede-8d8c-0aacd0775357/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bda2d1-46e5-4ede-8d8c-0aacd0775357/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:43:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e877523-8409-4827-88cb-5c04c1f9604f/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e877523-8409-4827-88cb-5c04c1f9604f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e877523-8409-4827-88cb-5c04c1f9604f/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e877523-8409-4827-88cb-5c04c1f9604f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:16 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:43:16 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:43:16 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=8380MB free_disk=25.03902816772461GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance f99c7008-ffbd-4f5c-96ef-ac50832b3f4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 7b0f5aad-e45c-4637-825c-cb295e98603a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 81bda2d1-46e5-4ede-8d8c-0aacd0775357 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0e877523-8409-4827-88cb-5c04c1f9604f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing inventories for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Updating ProviderTree inventory for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Updating inventory in ProviderTree for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing aggregate associations for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a, aggregates: None {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing trait associations for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.544s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CzqNnJrf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:43:16 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:43:16 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:43:16 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:43:16 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:43:16 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:43:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3883757e-378e-4d12-bbd4-fd547983316c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:43:16 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:43:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58bafab-e9aa-48a9-a954-e6d9958be61d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca] added
Nov 29 20:43:17 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7008ba0a-b566-4d89-844c-e1f4c68cd6dd]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ef3310-beb4-4d88-b4f2-0336e07700df]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CzqNnJrf {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CzqNnJrf" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8befdb30-80db-40c7-8cfc-b76bd95132da]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CzqNnJrf'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6883c0ab-affa-446f-ab55-e129977cd0d9]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[237e59d4-dd76-4c03-b2a0-92594e91ffaf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 20:43:17 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 20:43:17 user nova-compute[75356]:  {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:43:17 user nova-compute[75356]: WARNING os_brick.initiator.connectors.iscsi [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 20:43:17 user nova-compute[75356]: 
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bb2a2b-c631-43f1-a16d-f48c693f85a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca, portal: 172.16.0.220,3260]
Nov 29 20:43:17 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca, portal: 172.16.0.220,3260] successful.
Nov 29 20:43:17 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5c5996-402d-4433-9252-a75478fbf813]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[86629102-df84-498e-9a3c-16f9b3dd9523]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca (non-flash)
Nov 29 20:43:17 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca (non-flash)
Nov 29 20:43:17 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2d63fe-b8dc-4587-8ac5-40bd6729f9cb]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CzqNnJrf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:43:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:43:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:43:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23838316137636435', 'path': '/dev/sdb'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:43:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838316137636435', 'path': '/dev/sdb'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:43:18 user nova-compute[75356]: DEBUG nova.objects.instance [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lazy-loading 'flavor' on Instance uuid f99c7008-ffbd-4f5c-96ef-ac50832b3f4c {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:43:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:43:18 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:43:18 user nova-compute[75356]:   <source dev="/dev/sdb"/>
Nov 29 20:43:18 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:43:18 user nova-compute[75356]:   <serial>e67f93bc-1df1-45d5-a8d1-f897f66165ca</serial>
Nov 29 20:43:18 user nova-compute[75356]: </disk>
Nov 29 20:43:18 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:43:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:43:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:43:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] No VIF found with MAC fa:16:3e:99:eb:79, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:43:18 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:43:18 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:43:18 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:43:18 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:43:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8e88fe69-6d3a-4948-aad7-38d08a11f159 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.271s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:43:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:43:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Acquiring lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:43:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:43:20 user nova-compute[75356]: INFO nova.compute.manager [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Detaching volume e67f93bc-1df1-45d5-a8d1-f897f66165ca
Nov 29 20:43:20 user nova-compute[75356]: INFO nova.virt.block_device [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Attempting to driver detach volume e67f93bc-1df1-45d5-a8d1-f897f66165ca from mountpoint /dev/vdb
Nov 29 20:43:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Attempting to detach device vdb from instance f99c7008-ffbd-4f5c-96ef-ac50832b3f4c from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:43:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:43:20 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:43:20 user nova-compute[75356]:   <source dev="/dev/sdb"/>
Nov 29 20:43:20 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:43:20 user nova-compute[75356]:   <serial>e67f93bc-1df1-45d5-a8d1-f897f66165ca</serial>
Nov 29 20:43:20 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:43:20 user nova-compute[75356]: </disk>
Nov 29 20:43:20 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:43:20 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Successfully detached device vdb from instance f99c7008-ffbd-4f5c-96ef-ac50832b3f4c from the persistent domain config.
Nov 29 20:43:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f99c7008-ffbd-4f5c-96ef-ac50832b3f4c from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:43:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:43:20 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:43:20 user nova-compute[75356]:   <source dev="/dev/sdb"/>
Nov 29 20:43:20 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:43:20 user nova-compute[75356]:   <serial>e67f93bc-1df1-45d5-a8d1-f897f66165ca</serial>
Nov 29 20:43:20 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:43:20 user nova-compute[75356]: </disk>
Nov 29 20:43:20 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:43:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f99c7008-ffbd-4f5c-96ef-ac50832b3f4c {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:43:21 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:43:22 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:43:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:43:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:43:25 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:43:25 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75356) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 20:43:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:43:28 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:43:28 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Cleaning up deleted instances {{(pid=75356) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 20:43:28 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] There are 0 instances to clean {{(pid=75356) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 20:43:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:43:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:43:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:43:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:43:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:43:40 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f99c7008-ffbd-4f5c-96ef-ac50832b3f4c is timed out.
Nov 29 20:43:40 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Successfully detached device vdb from instance f99c7008-ffbd-4f5c-96ef-ac50832b3f4c from the live domain config.
Nov 29 20:43:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CzqNnJrf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:43:40 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:43:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[094bd040-3514-4466-abad-ed62e4a987b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:43:40 user nova-compute[75356]: No targets found.
Nov 29 20:43:40 user nova-compute[75356]: iSNS:
Nov 29 20:43:40 user nova-compute[75356]: No targets found.
Nov 29 20:43:40 user nova-compute[75356]: STATIC:
Nov 29 20:43:40 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca
Nov 29 20:43:40 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:43:40 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:43:40 user nova-compute[75356]: FIRMWARE:
Nov 29 20:43:40 user nova-compute[75356]: No targets found.
Nov 29 20:43:40 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:43:40 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:43:40 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e9e31d-4d36-4bff-923b-85da17292c29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[212a8fc1-763b-4dd7-a0ab-da9fe7cfdbc3]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca (non-flash)
Nov 29 20:43:40 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca (non-flash)
Nov 29 20:43:40 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8319d8dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca'): ({'sdb'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Removing single pathed devices sdb {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6902fc9-cbd2-492f-878e-a2eb556100d5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f043e969-ee39-450b-b407-931ef7e3dde2]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Flushing IO for device /dev/sdb {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6c653e-9c7b-4189-9865-3de2723d3041]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcabbca3-ea8c-402e-9e9a-50e98875b832]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] SCSI volumes sdb have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2363c1-b748-4358-9c73-1d2d1b03034f]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa4cd71-57ce-44ec-b9b8-c2baf82806d7]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca, portal: 172.16.0.220,3260]
Nov 29 20:43:40 user nova-compute[75356]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca, portal: 172.16.0.220,3260] successful.
Nov 29 20:43:40 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e67f93bc-1df1-45d5-a8d1-f897f66165ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ce8c2f-cf8d-4f73-b38e-d5b21f74bd8f]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] <== disconnect_volume: return (271ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:43:40 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:43:41 user nova-compute[75356]: DEBUG nova.objects.instance [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lazy-loading 'flavor' on Instance uuid f99c7008-ffbd-4f5c-96ef-ac50832b3f4c {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:43:41 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-bf9d74df-ef49-458b-a43c-873c2bc91a6c tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.763s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:43:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:43:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:43:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:43:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:43:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:43:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:43:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:43:54 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:43:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:43:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:43:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:43:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:43:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:43:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:43:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:44:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:08 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:44:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:44:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:44:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:44:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:44:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:13 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:44:13 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:44:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:44:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:44:13 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:44:13 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Updating instance_info_cache with network_info: [{"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:44:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:44:13 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:44:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:44:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:14 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:44:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bda2d1-46e5-4ede-8d8c-0aacd0775357/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bda2d1-46e5-4ede-8d8c-0aacd0775357/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:44:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bda2d1-46e5-4ede-8d8c-0aacd0775357/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81bda2d1-46e5-4ede-8d8c-0aacd0775357/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:44:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Acquiring lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Acquiring lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:14 user nova-compute[75356]: INFO nova.compute.manager [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Terminating instance
Nov 29 20:44:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:44:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:44:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-19453d7f-b583-4be8-978d-6458f06e5e0d req-d6132842-0511-4c46-b623-d57f2670a346 service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Received event network-vif-unplugged-8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-19453d7f-b583-4be8-978d-6458f06e5e0d req-d6132842-0511-4c46-b623-d57f2670a346 service nova] Acquiring lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-19453d7f-b583-4be8-978d-6458f06e5e0d req-d6132842-0511-4c46-b623-d57f2670a346 service nova] Lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-19453d7f-b583-4be8-978d-6458f06e5e0d req-d6132842-0511-4c46-b623-d57f2670a346 service nova] Lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-19453d7f-b583-4be8-978d-6458f06e5e0d req-d6132842-0511-4c46-b623-d57f2670a346 service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] No waiting events found dispatching network-vif-unplugged-8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-19453d7f-b583-4be8-978d-6458f06e5e0d req-d6132842-0511-4c46-b623-d57f2670a346 service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Received event network-vif-unplugged-8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:15 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Instance destroyed successfully.
Nov 29 20:44:15 user nova-compute[75356]: DEBUG nova.objects.instance [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lazy-loading 'resources' on Instance uuid f99c7008-ffbd-4f5c-96ef-ac50832b3f4c {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:41:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-78163504',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-78163504',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7816350',id=45,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyj6WIucggDhKNfmFzsFMPdQEk5dAM1wGGw3BY8NmU4dmYl4rES3fNHdZyEXq5GrgZ7b3xGi2rLRCb6RRk2fNJUa9tJC9EJCwIv2quuus9RI7/IMviaPodg2XTr6DDMfQ==',key_name='tempest-keypair-1774540889',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:41:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='adafeea8f34e40728c5086c1e3f59397',ramdisk_id='',reservation_id='r-i3xec4n2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1850217482',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:41:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3a34d4f6a7843e3926761cd1f752033',uuid=f99c7008-ffbd-4f5c-96ef-ac50832b3f4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "address": "fa:16:3e:99:eb:79", "network": {"id": "9f7cb915-67ff-4081-abfb-03e49aad02c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-471863428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adafeea8f34e40728c5086c1e3f59397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6152ce-bf", "ovs_interfaceid": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Converting VIF {"id": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "address": "fa:16:3e:99:eb:79", "network": {"id": "9f7cb915-67ff-4081-abfb-03e49aad02c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-471863428-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "adafeea8f34e40728c5086c1e3f59397", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a6152ce-bf", "ovs_interfaceid": "8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:eb:79,bridge_name='br-int',has_traffic_filtering=True,id=8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4,network=Network(9f7cb915-67ff-4081-abfb-03e49aad02c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a6152ce-bf') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG os_vif [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:eb:79,bridge_name='br-int',has_traffic_filtering=True,id=8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4,network=Network(9f7cb915-67ff-4081-abfb-03e49aad02c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a6152ce-bf') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a6152ce-bf, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=def757ae-854f-423a-8767-3a082c8b5d00) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e877523-8409-4827-88cb-5c04c1f9604f/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:15 user nova-compute[75356]: INFO os_vif [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:eb:79,bridge_name='br-int',has_traffic_filtering=True,id=8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4,network=Network(9f7cb915-67ff-4081-abfb-03e49aad02c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a6152ce-bf')
Nov 29 20:44:15 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Deleting instance files /opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c_del
Nov 29 20:44:15 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Deletion of /opt/stack/data/nova/instances/f99c7008-ffbd-4f5c-96ef-ac50832b3f4c_del complete
Nov 29 20:44:15 user nova-compute[75356]: INFO nova.compute.manager [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 29 20:44:15 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e877523-8409-4827-88cb-5c04c1f9604f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:44:15 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e877523-8409-4827-88cb-5c04c1f9604f/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e877523-8409-4827-88cb-5c04c1f9604f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:44:16 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:44:16 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:44:16 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=8574MB free_disk=25.036216735839844GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:44:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:16 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:44:16 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Took 0.69 seconds to deallocate network for instance.
Nov 29 20:44:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-f2ec8426-aed4-4b23-9aa4-40b7f1c6ef87 req-70edbaae-581d-4a26-a536-ea37e34bfdf4 service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Received event network-vif-deleted-8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:44:16 user nova-compute[75356]: INFO nova.compute.manager [req-f2ec8426-aed4-4b23-9aa4-40b7f1c6ef87 req-70edbaae-581d-4a26-a536-ea37e34bfdf4 service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Neutron deleted interface 8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4; detaching it from the instance and deleting it from the info cache
Nov 29 20:44:16 user nova-compute[75356]: DEBUG nova.network.neutron [req-f2ec8426-aed4-4b23-9aa4-40b7f1c6ef87 req-70edbaae-581d-4a26-a536-ea37e34bfdf4 service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:44:16 user nova-compute[75356]: DEBUG nova.compute.manager [req-f2ec8426-aed4-4b23-9aa4-40b7f1c6ef87 req-70edbaae-581d-4a26-a536-ea37e34bfdf4 service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Detach interface failed, port_id=8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4, reason: Instance f99c7008-ffbd-4f5c-96ef-ac50832b3f4c could not be found. {{(pid=75356) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 20:44:16 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance f99c7008-ffbd-4f5c-96ef-ac50832b3f4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:44:16 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 7b0f5aad-e45c-4637-825c-cb295e98603a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:44:16 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 81bda2d1-46e5-4ede-8d8c-0aacd0775357 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:44:16 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 0e877523-8409-4827-88cb-5c04c1f9604f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:44:16 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:44:16 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:44:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:16 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:44:16 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:44:16 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:44:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.320s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.199s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:16 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:44:16 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:44:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:16 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Deleted allocations for instance f99c7008-ffbd-4f5c-96ef-ac50832b3f4c
Nov 29 20:44:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-2d03e8fa-2e72-4182-8f1f-6ab4a82d9c40 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482 tempest-TestServerVolumeAttachScenarioOldVersion-1850217482-project-member] Lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.273s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:17 user nova-compute[75356]: DEBUG nova.compute.manager [req-115aa146-e432-45de-ab84-542fb21dfb1b req-4ce2deb3-c656-4fd1-89a6-d17ee68f46f7 service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Received event network-vif-plugged-8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:44:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-115aa146-e432-45de-ab84-542fb21dfb1b req-4ce2deb3-c656-4fd1-89a6-d17ee68f46f7 service nova] Acquiring lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-115aa146-e432-45de-ab84-542fb21dfb1b req-4ce2deb3-c656-4fd1-89a6-d17ee68f46f7 service nova] Lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-115aa146-e432-45de-ab84-542fb21dfb1b req-4ce2deb3-c656-4fd1-89a6-d17ee68f46f7 service nova] Lock "f99c7008-ffbd-4f5c-96ef-ac50832b3f4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:17 user nova-compute[75356]: DEBUG nova.compute.manager [req-115aa146-e432-45de-ab84-542fb21dfb1b req-4ce2deb3-c656-4fd1-89a6-d17ee68f46f7 service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] No waiting events found dispatching network-vif-plugged-8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:44:17 user nova-compute[75356]: WARNING nova.compute.manager [req-115aa146-e432-45de-ab84-542fb21dfb1b req-4ce2deb3-c656-4fd1-89a6-d17ee68f46f7 service nova] [instance: f99c7008-ffbd-4f5c-96ef-ac50832b3f4c] Received unexpected event network-vif-plugged-8a6152ce-bf0e-4b2b-8a35-0c8e5a9d19d4 for instance with vm_state deleted and task_state None.
Nov 29 20:44:17 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:44:17 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:44:17 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:44:18 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:44:19 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:44:19 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:44:19 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:44:19 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:44:19 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid 81bda2d1-46e5-4ede-8d8c-0aacd0775357 {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:44:19 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid 0e877523-8409-4827-88cb-5c04c1f9604f {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:44:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "7b0f5aad-e45c-4637-825c-cb295e98603a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "0e877523-8409-4827-88cb-5c04c1f9604f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "0e877523-8409-4827-88cb-5c04c1f9604f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "0e877523-8409-4827-88cb-5c04c1f9604f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-f65af28a-fac9-4d06-947f-9c1a4db92fd1 req-86f6e8d9-40e4-4700-94ce-404a185b68b8 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received event network-changed-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:44:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-f65af28a-fac9-4d06-947f-9c1a4db92fd1 req-86f6e8d9-40e4-4700-94ce-404a185b68b8 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Refreshing instance network info cache due to event network-changed-ddf386ac-899d-4106-88a9-ec3916a51b7c. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:44:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f65af28a-fac9-4d06-947f-9c1a4db92fd1 req-86f6e8d9-40e4-4700-94ce-404a185b68b8 service nova] Acquiring lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:44:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f65af28a-fac9-4d06-947f-9c1a4db92fd1 req-86f6e8d9-40e4-4700-94ce-404a185b68b8 service nova] Acquired lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:44:19 user nova-compute[75356]: DEBUG nova.network.neutron [req-f65af28a-fac9-4d06-947f-9c1a4db92fd1 req-86f6e8d9-40e4-4700-94ce-404a185b68b8 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Refreshing network info cache for port ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:44:20 user nova-compute[75356]: DEBUG nova.network.neutron [req-f65af28a-fac9-4d06-947f-9c1a4db92fd1 req-86f6e8d9-40e4-4700-94ce-404a185b68b8 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Updated VIF entry in instance network info cache for port ddf386ac-899d-4106-88a9-ec3916a51b7c. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:44:20 user nova-compute[75356]: DEBUG nova.network.neutron [req-f65af28a-fac9-4d06-947f-9c1a4db92fd1 req-86f6e8d9-40e4-4700-94ce-404a185b68b8 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Updating instance_info_cache with network_info: [{"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:44:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f65af28a-fac9-4d06-947f-9c1a4db92fd1 req-86f6e8d9-40e4-4700-94ce-404a185b68b8 service nova] Releasing lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:44:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:22 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:44:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "7b0f5aad-e45c-4637-825c-cb295e98603a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:23 user nova-compute[75356]: DEBUG nova.objects.instance [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'flavor' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "7b0f5aad-e45c-4637-825c-cb295e98603a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:24 user nova-compute[75356]: INFO nova.compute.manager [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Attaching volume 5b92a220-95f0-4732-b104-9b2895c29d05 to /dev/vdb
Nov 29 20:44:24 user nova-compute[75356]: DEBUG os_brick.utils [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ad6175-9510-4814-aecc-d760fadd335a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f571231-d6ea-4bb0-b630-fba57132b67b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22b8f91-2334-4461-b373-70d6270d22e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ef86a1-eeb7-4c8b-bd32-ade7dad58797]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:44:24 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:44:24 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb1299a-05a8-46d7-9ed4-f1b1124eccad]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG os_brick.utils [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Updating existing volume attachment record: d37d3f9e-7163-401c-ac9a-2b994a41c1a7 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Acquiring lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Acquiring lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:24 user nova-compute[75356]: INFO nova.compute.manager [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Terminating instance
Nov 29 20:44:24 user nova-compute[75356]: DEBUG nova.compute.manager [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-a69252f6-a778-4a78-bf3c-626c05c737a7 req-9de51b99-b2a1-4ee2-9c84-ded99e934c5c service nova] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Received event network-vif-unplugged-913732fd-3fa1-4474-a7d6-bc45be8c6494 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a69252f6-a778-4a78-bf3c-626c05c737a7 req-9de51b99-b2a1-4ee2-9c84-ded99e934c5c service nova] Acquiring lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a69252f6-a778-4a78-bf3c-626c05c737a7 req-9de51b99-b2a1-4ee2-9c84-ded99e934c5c service nova] Lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a69252f6-a778-4a78-bf3c-626c05c737a7 req-9de51b99-b2a1-4ee2-9c84-ded99e934c5c service nova] Lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-a69252f6-a778-4a78-bf3c-626c05c737a7 req-9de51b99-b2a1-4ee2-9c84-ded99e934c5c service nova] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] No waiting events found dispatching network-vif-unplugged-913732fd-3fa1-4474-a7d6-bc45be8c6494 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG nova.compute.manager [req-a69252f6-a778-4a78-bf3c-626c05c737a7 req-9de51b99-b2a1-4ee2-9c84-ded99e934c5c service nova] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Received event network-vif-unplugged-913732fd-3fa1-4474-a7d6-bc45be8c6494 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:44:25 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Instance destroyed successfully.
Nov 29 20:44:25 user nova-compute[75356]: DEBUG nova.objects.instance [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lazy-loading 'resources' on Instance uuid 81bda2d1-46e5-4ede-8d8c-0aacd0775357 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:42:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-300901372',display_name='tempest-VolumesActionsTest-instance-300901372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-300901372',id=47,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:42:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04a7b959735c4cf29119e47e9fe8f8bb',ramdisk_id='',reservation_id='r-a2ykto9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1193759144',owner_user_name='tempest-VolumesActionsTest-1193759144-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:42:41Z,user_data=None,user_id='cae1d8859ca742f99d90f205658e2760',uuid=81bda2d1-46e5-4ede-8d8c-0aacd0775357,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "913732fd-3fa1-4474-a7d6-bc45be8c6494", "address": "fa:16:3e:06:4f:ea", "network": {"id": "3c2575ba-8eac-478b-be1a-cbaf757e68da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647638728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a7b959735c4cf29119e47e9fe8f8bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap913732fd-3f", "ovs_interfaceid": "913732fd-3fa1-4474-a7d6-bc45be8c6494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Converting VIF {"id": "913732fd-3fa1-4474-a7d6-bc45be8c6494", "address": "fa:16:3e:06:4f:ea", "network": {"id": "3c2575ba-8eac-478b-be1a-cbaf757e68da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647638728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a7b959735c4cf29119e47e9fe8f8bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap913732fd-3f", "ovs_interfaceid": "913732fd-3fa1-4474-a7d6-bc45be8c6494", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:4f:ea,bridge_name='br-int',has_traffic_filtering=True,id=913732fd-3fa1-4474-a7d6-bc45be8c6494,network=Network(3c2575ba-8eac-478b-be1a-cbaf757e68da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap913732fd-3f') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG os_vif [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:4f:ea,bridge_name='br-int',has_traffic_filtering=True,id=913732fd-3fa1-4474-a7d6-bc45be8c6494,network=Network(3c2575ba-8eac-478b-be1a-cbaf757e68da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap913732fd-3f') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap913732fd-3f, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4b75d09-64ad-4185-81f4-73ddc4700c30) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:44:25 user nova-compute[75356]: INFO os_vif [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:4f:ea,bridge_name='br-int',has_traffic_filtering=True,id=913732fd-3fa1-4474-a7d6-bc45be8c6494,network=Network(3c2575ba-8eac-478b-be1a-cbaf757e68da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap913732fd-3f')
Nov 29 20:44:25 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Deleting instance files /opt/stack/data/nova/instances/81bda2d1-46e5-4ede-8d8c-0aacd0775357_del
Nov 29 20:44:25 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Deletion of /opt/stack/data/nova/instances/81bda2d1-46e5-4ede-8d8c-0aacd0775357_del complete
Nov 29 20:44:25 user nova-compute[75356]: INFO nova.compute.manager [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 29 20:44:25 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:44:25 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:44:26 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:44:26 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Took 0.57 seconds to deallocate network for instance.
Nov 29 20:44:26 user nova-compute[75356]: DEBUG nova.compute.manager [req-c4448d90-27c3-4617-b6b9-3e443053b577 req-01c7157c-1a49-4bfa-a61c-abd24329fd58 service nova] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Received event network-vif-deleted-913732fd-3fa1-4474-a7d6-bc45be8c6494 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:44:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:26 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:44:26 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:44:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:26 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Deleted allocations for instance 81bda2d1-46e5-4ede-8d8c-0aacd0775357
Nov 29 20:44:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-b68d0503-ab0a-4939-9672-3e398723a489 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.591s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-90260c1f-672d-4a3d-ae03-39febb10c4c4 req-92cbd31e-b570-44cd-81a2-4a9058308dfc service nova] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Received event network-vif-plugged-913732fd-3fa1-4474-a7d6-bc45be8c6494 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:44:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-90260c1f-672d-4a3d-ae03-39febb10c4c4 req-92cbd31e-b570-44cd-81a2-4a9058308dfc service nova] Acquiring lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-90260c1f-672d-4a3d-ae03-39febb10c4c4 req-92cbd31e-b570-44cd-81a2-4a9058308dfc service nova] Lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-90260c1f-672d-4a3d-ae03-39febb10c4c4 req-92cbd31e-b570-44cd-81a2-4a9058308dfc service nova] Lock "81bda2d1-46e5-4ede-8d8c-0aacd0775357-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:27 user nova-compute[75356]: DEBUG nova.compute.manager [req-90260c1f-672d-4a3d-ae03-39febb10c4c4 req-92cbd31e-b570-44cd-81a2-4a9058308dfc service nova] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] No waiting events found dispatching network-vif-plugged-913732fd-3fa1-4474-a7d6-bc45be8c6494 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:44:27 user nova-compute[75356]: WARNING nova.compute.manager [req-90260c1f-672d-4a3d-ae03-39febb10c4c4 req-92cbd31e-b570-44cd-81a2-4a9058308dfc service nova] [instance: 81bda2d1-46e5-4ede-8d8c-0aacd0775357] Received unexpected event network-vif-plugged-913732fd-3fa1-4474-a7d6-bc45be8c6494 for instance with vm_state deleted and task_state None.
Nov 29 20:44:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVsqBLGy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:44:31 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:44:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:44:31 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:44:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:44:31 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:44:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2c76ea-573b-4552-93a5-641d4fb9e88a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:44:31 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cecd91-6304-4210-b508-1f535ab59531]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05] added
Nov 29 20:44:31 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a022aca7-8c1e-4c96-a489-85e4d10a3269]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2822be-20db-41f7-bf64-70ea405edbe5]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVsqBLGy {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVsqBLGy" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfab6574-11c8-4499-bf14-c6f0a744e113]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zVsqBLGy'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f17541f-f1c0-4326-8d86-c4012e7834f1]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:44:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[79191b3a-76bd-41e3-bf56-480cc44ab731]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 20:44:32 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 20:44:32 user nova-compute[75356]:  {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:44:32 user nova-compute[75356]: WARNING os_brick.initiator.connectors.iscsi [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 20:44:32 user nova-compute[75356]: 
Nov 29 20:44:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[35129542-9b72-420d-a249-f6b466dcc761]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05, portal: 172.16.0.220,3260]
Nov 29 20:44:32 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05, portal: 172.16.0.220,3260] successful.
Nov 29 20:44:32 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cce8de0-aa85-408a-84a5-084be06dc46c]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[476f6da7-6fb4-4444-b7c7-22d0a5eba000]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 (non-flash)
Nov 29 20:44:32 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 (non-flash)
Nov 29 20:44:32 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7622ef91-770e-4a38-939f-b8e1da6c460d]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:44:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVsqBLGy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:44:33 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:44:33 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26437643737393066', 'path': '/dev/sdb'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:44:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437643737393066', 'path': '/dev/sdb'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:44:33 user nova-compute[75356]: DEBUG nova.objects.instance [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'flavor' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:44:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:44:33 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:44:33 user nova-compute[75356]:   <source dev="/dev/sdb"/>
Nov 29 20:44:33 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:44:33 user nova-compute[75356]:   <serial>5b92a220-95f0-4732-b104-9b2895c29d05</serial>
Nov 29 20:44:33 user nova-compute[75356]: </disk>
Nov 29 20:44:33 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:44:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:44:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:44:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] No VIF found with MAC fa:16:3e:8b:f0:8d, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:44:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-54165a72-995c-4d90-b686-0353fcc2c1cf tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.505s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f2381b7f-c662-4fde-8ac0-7a39cfe04551 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "7b0f5aad-e45c-4637-825c-cb295e98603a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f2381b7f-c662-4fde-8ac0-7a39cfe04551 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:33 user nova-compute[75356]: DEBUG nova.compute.manager [None req-f2381b7f-c662-4fde-8ac0-7a39cfe04551 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:44:33 user nova-compute[75356]: DEBUG nova.compute.manager [None req-f2381b7f-c662-4fde-8ac0-7a39cfe04551 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75356) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 29 20:44:33 user nova-compute[75356]: DEBUG nova.objects.instance [None req-f2381b7f-c662-4fde-8ac0-7a39cfe04551 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'flavor' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:44:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:34 user nova-compute[75356]: DEBUG nova.compute.manager [req-3d035d78-9b07-455e-8398-94bddd9fd65f req-bf1ac55d-d66d-4950-85e6-4f0736b4f183 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received event network-vif-unplugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:44:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3d035d78-9b07-455e-8398-94bddd9fd65f req-bf1ac55d-d66d-4950-85e6-4f0736b4f183 service nova] Acquiring lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3d035d78-9b07-455e-8398-94bddd9fd65f req-bf1ac55d-d66d-4950-85e6-4f0736b4f183 service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3d035d78-9b07-455e-8398-94bddd9fd65f req-bf1ac55d-d66d-4950-85e6-4f0736b4f183 service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:34 user nova-compute[75356]: DEBUG nova.compute.manager [req-3d035d78-9b07-455e-8398-94bddd9fd65f req-bf1ac55d-d66d-4950-85e6-4f0736b4f183 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] No waiting events found dispatching network-vif-unplugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:44:34 user nova-compute[75356]: WARNING nova.compute.manager [req-3d035d78-9b07-455e-8398-94bddd9fd65f req-bf1ac55d-d66d-4950-85e6-4f0736b4f183 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received unexpected event network-vif-unplugged-ddf386ac-899d-4106-88a9-ec3916a51b7c for instance with vm_state active and task_state powering-off.
Nov 29 20:44:34 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Instance destroyed successfully.
Nov 29 20:44:34 user nova-compute[75356]: DEBUG nova.compute.manager [None req-f2381b7f-c662-4fde-8ac0-7a39cfe04551 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:44:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-f2381b7f-c662-4fde-8ac0-7a39cfe04551 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.868s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:36 user nova-compute[75356]: DEBUG nova.compute.manager [req-c283be8e-35ff-487e-a5f6-4c561b7bb0b9 req-5ea3668f-af66-406f-a035-74d54c1ca59b service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received event network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:44:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c283be8e-35ff-487e-a5f6-4c561b7bb0b9 req-5ea3668f-af66-406f-a035-74d54c1ca59b service nova] Acquiring lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c283be8e-35ff-487e-a5f6-4c561b7bb0b9 req-5ea3668f-af66-406f-a035-74d54c1ca59b service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c283be8e-35ff-487e-a5f6-4c561b7bb0b9 req-5ea3668f-af66-406f-a035-74d54c1ca59b service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:36 user nova-compute[75356]: DEBUG nova.compute.manager [req-c283be8e-35ff-487e-a5f6-4c561b7bb0b9 req-5ea3668f-af66-406f-a035-74d54c1ca59b service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] No waiting events found dispatching network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:44:36 user nova-compute[75356]: WARNING nova.compute.manager [req-c283be8e-35ff-487e-a5f6-4c561b7bb0b9 req-5ea3668f-af66-406f-a035-74d54c1ca59b service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received unexpected event network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c for instance with vm_state stopped and task_state None.
Nov 29 20:44:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:44:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:44:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:44:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:44:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Acquiring lock "0e877523-8409-4827-88cb-5c04c1f9604f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Lock "0e877523-8409-4827-88cb-5c04c1f9604f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Acquiring lock "0e877523-8409-4827-88cb-5c04c1f9604f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Lock "0e877523-8409-4827-88cb-5c04c1f9604f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Lock "0e877523-8409-4827-88cb-5c04c1f9604f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:49 user nova-compute[75356]: INFO nova.compute.manager [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Terminating instance
Nov 29 20:44:49 user nova-compute[75356]: DEBUG nova.compute.manager [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:44:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:49 user nova-compute[75356]: DEBUG nova.compute.manager [req-75f0efbb-dfdf-4099-ae5f-933cb09d32fb req-e41f9036-bb81-43d9-a40a-ea2a9abee7bb service nova] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Received event network-vif-unplugged-fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:44:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-75f0efbb-dfdf-4099-ae5f-933cb09d32fb req-e41f9036-bb81-43d9-a40a-ea2a9abee7bb service nova] Acquiring lock "0e877523-8409-4827-88cb-5c04c1f9604f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-75f0efbb-dfdf-4099-ae5f-933cb09d32fb req-e41f9036-bb81-43d9-a40a-ea2a9abee7bb service nova] Lock "0e877523-8409-4827-88cb-5c04c1f9604f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:49 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-75f0efbb-dfdf-4099-ae5f-933cb09d32fb req-e41f9036-bb81-43d9-a40a-ea2a9abee7bb service nova] Lock "0e877523-8409-4827-88cb-5c04c1f9604f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:49 user nova-compute[75356]: DEBUG nova.compute.manager [req-75f0efbb-dfdf-4099-ae5f-933cb09d32fb req-e41f9036-bb81-43d9-a40a-ea2a9abee7bb service nova] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] No waiting events found dispatching network-vif-unplugged-fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:44:49 user nova-compute[75356]: DEBUG nova.compute.manager [req-75f0efbb-dfdf-4099-ae5f-933cb09d32fb req-e41f9036-bb81-43d9-a40a-ea2a9abee7bb service nova] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Received event network-vif-unplugged-fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:44:50 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Instance destroyed successfully.
Nov 29 20:44:50 user nova-compute[75356]: DEBUG nova.objects.instance [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Lazy-loading 'resources' on Instance uuid 0e877523-8409-4827-88cb-5c04c1f9604f {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:44:50 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-846488318',display_name='tempest-VolumesActionsTest-instance-846488318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-846488318',id=48,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:42:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='821217e86dd74fcbbfd4c4b667495abc',ramdisk_id='',reservation_id='r-qrr6thtq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1384750743',owner_user_name='tempest-VolumesActionsTest-1384750743-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:42:59Z,user_data=None,user_id='f54c7bea442c4c50886ffef8f2cb2dcf',uuid=0e877523-8409-4827-88cb-5c04c1f9604f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd", "address": "fa:16:3e:b3:b2:a3", "network": {"id": "0c22d5d3-b93e-46b4-80d3-31d3ed402dd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005055289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "821217e86dd74fcbbfd4c4b667495abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb0fc0c9-e1", "ovs_interfaceid": "fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:44:50 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Converting VIF {"id": "fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd", "address": "fa:16:3e:b3:b2:a3", "network": {"id": "0c22d5d3-b93e-46b4-80d3-31d3ed402dd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005055289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "821217e86dd74fcbbfd4c4b667495abc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb0fc0c9-e1", "ovs_interfaceid": "fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:44:50 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:b2:a3,bridge_name='br-int',has_traffic_filtering=True,id=fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd,network=Network(0c22d5d3-b93e-46b4-80d3-31d3ed402dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb0fc0c9-e1') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:44:50 user nova-compute[75356]: DEBUG os_vif [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:b2:a3,bridge_name='br-int',has_traffic_filtering=True,id=fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd,network=Network(0c22d5d3-b93e-46b4-80d3-31d3ed402dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb0fc0c9-e1') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:44:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb0fc0c9-e1, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:44:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:44:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dbc21dbc-9b99-490c-9e11-4af05541ceac) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:44:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:44:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:50 user nova-compute[75356]: INFO os_vif [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:b2:a3,bridge_name='br-int',has_traffic_filtering=True,id=fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd,network=Network(0c22d5d3-b93e-46b4-80d3-31d3ed402dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb0fc0c9-e1')
Nov 29 20:44:50 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Deleting instance files /opt/stack/data/nova/instances/0e877523-8409-4827-88cb-5c04c1f9604f_del
Nov 29 20:44:50 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Deletion of /opt/stack/data/nova/instances/0e877523-8409-4827-88cb-5c04c1f9604f_del complete
Nov 29 20:44:50 user nova-compute[75356]: INFO nova.compute.manager [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 29 20:44:50 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:44:50 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:44:50 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:44:50 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:44:50 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Took 0.44 seconds to deallocate network for instance.
Nov 29 20:44:50 user nova-compute[75356]: DEBUG nova.compute.manager [req-d7bebb31-f780-4997-9e03-ce55752ed415 req-b10d7051-33bc-47e0-adda-2c1eae4bef06 service nova] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Received event network-vif-deleted-fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:44:50 user nova-compute[75356]: INFO nova.compute.manager [req-d7bebb31-f780-4997-9e03-ce55752ed415 req-b10d7051-33bc-47e0-adda-2c1eae4bef06 service nova] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Neutron deleted interface fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd; detaching it from the instance and deleting it from the info cache
Nov 29 20:44:50 user nova-compute[75356]: DEBUG nova.network.neutron [req-d7bebb31-f780-4997-9e03-ce55752ed415 req-b10d7051-33bc-47e0-adda-2c1eae4bef06 service nova] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:44:50 user nova-compute[75356]: DEBUG nova.compute.manager [req-d7bebb31-f780-4997-9e03-ce55752ed415 req-b10d7051-33bc-47e0-adda-2c1eae4bef06 service nova] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Detach interface failed, port_id=fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd, reason: Instance 0e877523-8409-4827-88cb-5c04c1f9604f could not be found. {{(pid=75356) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 20:44:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:50 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:44:50 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:44:50 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:50 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Deleted allocations for instance 0e877523-8409-4827-88cb-5c04c1f9604f
Nov 29 20:44:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-51cc87d1-3802-407a-91c5-6af62b9c7adf tempest-VolumesActionsTest-1384750743 tempest-VolumesActionsTest-1384750743-project-member] Lock "0e877523-8409-4827-88cb-5c04c1f9604f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.492s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:51 user nova-compute[75356]: DEBUG nova.compute.manager [req-d47b1539-e28c-46b7-bd7c-c26f168cc345 req-21e0e27d-c903-40fe-9966-15520783944b service nova] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Received event network-vif-plugged-fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:44:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d47b1539-e28c-46b7-bd7c-c26f168cc345 req-21e0e27d-c903-40fe-9966-15520783944b service nova] Acquiring lock "0e877523-8409-4827-88cb-5c04c1f9604f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:44:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d47b1539-e28c-46b7-bd7c-c26f168cc345 req-21e0e27d-c903-40fe-9966-15520783944b service nova] Lock "0e877523-8409-4827-88cb-5c04c1f9604f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:44:51 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d47b1539-e28c-46b7-bd7c-c26f168cc345 req-21e0e27d-c903-40fe-9966-15520783944b service nova] Lock "0e877523-8409-4827-88cb-5c04c1f9604f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:44:51 user nova-compute[75356]: DEBUG nova.compute.manager [req-d47b1539-e28c-46b7-bd7c-c26f168cc345 req-21e0e27d-c903-40fe-9966-15520783944b service nova] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] No waiting events found dispatching network-vif-plugged-fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:44:51 user nova-compute[75356]: WARNING nova.compute.manager [req-d47b1539-e28c-46b7-bd7c-c26f168cc345 req-21e0e27d-c903-40fe-9966-15520783944b service nova] [instance: 0e877523-8409-4827-88cb-5c04c1f9604f] Received unexpected event network-vif-plugged-fb0fc0c9-e1ff-416c-bae6-8b2ddb85fecd for instance with vm_state deleted and task_state None.
Nov 29 20:44:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:44:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:09 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:45:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:13 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:45:13 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:45:13 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Didn't find any instances for network info cache update. {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 20:45:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:45:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:45:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:45:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:45:14 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:45:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:45:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:45:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:45:14 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:45:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:45:15 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:45:15 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:45:15 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=9085MB free_disk=25.11783218383789GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:45:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:45:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:45:15 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 7b0f5aad-e45c-4637-825c-cb295e98603a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:45:15 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:45:15 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:45:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:15 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:45:15 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:45:15 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:45:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:45:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Acquiring lock "d8e689c4-af7b-4535-af47-cf458e2acc92" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:45:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "d8e689c4-af7b-4535-af47-cf458e2acc92" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:45:16 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:45:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:45:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:45:16 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:45:16 user nova-compute[75356]: INFO nova.compute.claims [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Claim successful on node user
Nov 29 20:45:16 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:45:16 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:45:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.196s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:45:16 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG nova.network.neutron [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:45:17 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:45:17 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG nova.policy [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cae1d8859ca742f99d90f205658e2760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a7b959735c4cf29119e47e9fe8f8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:45:17 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Creating image(s)
Nov 29 20:45:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8e689c4-af7b-4535-af47-cf458e2acc92/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "/opt/stack/data/nova/instances/d8e689c4-af7b-4535-af47-cf458e2acc92/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "/opt/stack/data/nova/instances/d8e689c4-af7b-4535-af47-cf458e2acc92/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.173s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/d8e689c4-af7b-4535-af47-cf458e2acc92/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG nova.network.neutron [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Successfully created port: c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/d8e689c4-af7b-4535-af47-cf458e2acc92/disk 1073741824" returned: 0 in 0.055s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.177s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8e689c4-af7b-4535-af47-cf458e2acc92/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:45:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e689c4-af7b-4535-af47-cf458e2acc92/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e689c4-af7b-4535-af47-cf458e2acc92/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Cannot resize image /opt/stack/data/nova/instances/d8e689c4-af7b-4535-af47-cf458e2acc92/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Ensure instance console log exists: /opt/stack/data/nova/instances/d8e689c4-af7b-4535-af47-cf458e2acc92/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.network.neutron [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Successfully updated port: c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Acquiring lock "refresh_cache-d8e689c4-af7b-4535-af47-cf458e2acc92" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Acquired lock "refresh_cache-d8e689c4-af7b-4535-af47-cf458e2acc92" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.network.neutron [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-14e74ed2-874b-4dd1-ba5a-aba56bd39f3a req-74a4d89f-643d-41b3-a876-90494e8484e7 service nova] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Received event network-changed-c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-14e74ed2-874b-4dd1-ba5a-aba56bd39f3a req-74a4d89f-643d-41b3-a876-90494e8484e7 service nova] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Refreshing instance network info cache due to event network-changed-c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-14e74ed2-874b-4dd1-ba5a-aba56bd39f3a req-74a4d89f-643d-41b3-a876-90494e8484e7 service nova] Acquiring lock "refresh_cache-d8e689c4-af7b-4535-af47-cf458e2acc92" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.network.neutron [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.network.neutron [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Updating instance_info_cache with network_info: [{"id": "c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c", "address": "fa:16:3e:57:18:69", "network": {"id": "3c2575ba-8eac-478b-be1a-cbaf757e68da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647638728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a7b959735c4cf29119e47e9fe8f8bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11f05ef-c6", "ovs_interfaceid": "c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Releasing lock "refresh_cache-d8e689c4-af7b-4535-af47-cf458e2acc92" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Instance network_info: |[{"id": "c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c", "address": "fa:16:3e:57:18:69", "network": {"id": "3c2575ba-8eac-478b-be1a-cbaf757e68da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647638728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a7b959735c4cf29119e47e9fe8f8bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11f05ef-c6", "ovs_interfaceid": "c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-14e74ed2-874b-4dd1-ba5a-aba56bd39f3a req-74a4d89f-643d-41b3-a876-90494e8484e7 service nova] Acquired lock "refresh_cache-d8e689c4-af7b-4535-af47-cf458e2acc92" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.network.neutron [req-14e74ed2-874b-4dd1-ba5a-aba56bd39f3a req-74a4d89f-643d-41b3-a876-90494e8484e7 service nova] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Refreshing network info cache for port c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Start _get_guest_xml network_info=[{"id": "c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c", "address": "fa:16:3e:57:18:69", "network": {"id": "3c2575ba-8eac-478b-be1a-cbaf757e68da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647638728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a7b959735c4cf29119e47e9fe8f8bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11f05ef-c6", "ovs_interfaceid": "c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:45:18 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:45:18 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1652952213',display_name='tempest-VolumesActionsTest-instance-1652952213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1652952213',id=49,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04a7b959735c4cf29119e47e9fe8f8bb',ramdisk_id='',reservation_id='r-urcnc1iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1193759144',owner_user_name='tempest-VolumesActionsTest-1193759144-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:45:17Z,user_data=None,user_id='cae1d8859ca742f99d90f205658e2760',uuid=d8e689c4-af7b-4535-af47-cf458e2acc92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c", "address": "fa:16:3e:57:18:69", "network": {"id": "3c2575ba-8eac-478b-be1a-cbaf757e68da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647638728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a7b959735c4cf29119e47e9fe8f8bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11f05ef-c6", "ovs_interfaceid": "c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Converting VIF {"id": "c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c", "address": "fa:16:3e:57:18:69", "network": {"id": "3c2575ba-8eac-478b-be1a-cbaf757e68da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647638728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a7b959735c4cf29119e47e9fe8f8bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11f05ef-c6", "ovs_interfaceid": "c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:18:69,bridge_name='br-int',has_traffic_filtering=True,id=c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c,network=Network(3c2575ba-8eac-478b-be1a-cbaf757e68da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc11f05ef-c6') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.objects.instance [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lazy-loading 'pci_devices' on Instance uuid d8e689c4-af7b-4535-af47-cf458e2acc92 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:45:18 user nova-compute[75356]:   <uuid>d8e689c4-af7b-4535-af47-cf458e2acc92</uuid>
Nov 29 20:45:18 user nova-compute[75356]:   <name>instance-00000031</name>
Nov 29 20:45:18 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:45:18 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:45:18 user nova-compute[75356]:   <metadata>
Nov 29 20:45:18 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:45:18 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:45:18 user nova-compute[75356]:       <nova:name>tempest-VolumesActionsTest-instance-1652952213</nova:name>
Nov 29 20:45:18 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:45:18</nova:creationTime>
Nov 29 20:45:18 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:45:18 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:45:18 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:45:18 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:45:18 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:45:18 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:45:18 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:45:18 user nova-compute[75356]:       <nova:owner>
Nov 29 20:45:18 user nova-compute[75356]:         <nova:user uuid="cae1d8859ca742f99d90f205658e2760">tempest-VolumesActionsTest-1193759144-project-member</nova:user>
Nov 29 20:45:18 user nova-compute[75356]:         <nova:project uuid="04a7b959735c4cf29119e47e9fe8f8bb">tempest-VolumesActionsTest-1193759144</nova:project>
Nov 29 20:45:18 user nova-compute[75356]:       </nova:owner>
Nov 29 20:45:18 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:45:18 user nova-compute[75356]:       <nova:ports>
Nov 29 20:45:18 user nova-compute[75356]:         <nova:port uuid="c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c">
Nov 29 20:45:18 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 20:45:18 user nova-compute[75356]:         </nova:port>
Nov 29 20:45:18 user nova-compute[75356]:       </nova:ports>
Nov 29 20:45:18 user nova-compute[75356]:     </nova:instance>
Nov 29 20:45:18 user nova-compute[75356]:   </metadata>
Nov 29 20:45:18 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:45:18 user nova-compute[75356]:     <system>
Nov 29 20:45:18 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:45:18 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:45:18 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:45:18 user nova-compute[75356]:       <entry name="serial">d8e689c4-af7b-4535-af47-cf458e2acc92</entry>
Nov 29 20:45:18 user nova-compute[75356]:       <entry name="uuid">d8e689c4-af7b-4535-af47-cf458e2acc92</entry>
Nov 29 20:45:18 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:45:18 user nova-compute[75356]:     </system>
Nov 29 20:45:18 user nova-compute[75356]:   </sysinfo>
Nov 29 20:45:18 user nova-compute[75356]:   <os>
Nov 29 20:45:18 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:45:18 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:45:18 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:45:18 user nova-compute[75356]:   </os>
Nov 29 20:45:18 user nova-compute[75356]:   <features>
Nov 29 20:45:18 user nova-compute[75356]:     <acpi/>
Nov 29 20:45:18 user nova-compute[75356]:     <apic/>
Nov 29 20:45:18 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:45:18 user nova-compute[75356]:   </features>
Nov 29 20:45:18 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:45:18 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:45:18 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:45:18 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:45:18 user nova-compute[75356]:   </clock>
Nov 29 20:45:18 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:45:18 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:45:18 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:45:18 user nova-compute[75356]:   </cpu>
Nov 29 20:45:18 user nova-compute[75356]:   <devices>
Nov 29 20:45:18 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:45:18 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:45:18 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/d8e689c4-af7b-4535-af47-cf458e2acc92/disk"/>
Nov 29 20:45:18 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:45:18 user nova-compute[75356]:     </disk>
Nov 29 20:45:18 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:45:18 user nova-compute[75356]:       <mac address="fa:16:3e:57:18:69"/>
Nov 29 20:45:18 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:45:18 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:45:18 user nova-compute[75356]:       <target dev="tapc11f05ef-c6"/>
Nov 29 20:45:18 user nova-compute[75356]:     </interface>
Nov 29 20:45:18 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:45:18 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/d8e689c4-af7b-4535-af47-cf458e2acc92/console.log" append="off"/>
Nov 29 20:45:18 user nova-compute[75356]:     </serial>
Nov 29 20:45:18 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:45:18 user nova-compute[75356]:     <video>
Nov 29 20:45:18 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:45:18 user nova-compute[75356]:     </video>
Nov 29 20:45:18 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:45:18 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:45:18 user nova-compute[75356]:     </rng>
Nov 29 20:45:18 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:45:18 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:45:18 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:45:18 user nova-compute[75356]:     </memballoon>
Nov 29 20:45:18 user nova-compute[75356]:   </devices>
Nov 29 20:45:18 user nova-compute[75356]: </domain>
Nov 29 20:45:18 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1652952213',display_name='tempest-VolumesActionsTest-instance-1652952213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1652952213',id=49,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04a7b959735c4cf29119e47e9fe8f8bb',ramdisk_id='',reservation_id='r-urcnc1iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1193759144',owner_user_name='tempest-VolumesActionsTest-1193759144-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:45:17Z,user_data=None,user_id='cae1d8859ca742f99d90f205658e2760',uuid=d8e689c4-af7b-4535-af47-cf458e2acc92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c", "address": "fa:16:3e:57:18:69", "network": {"id": "3c2575ba-8eac-478b-be1a-cbaf757e68da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647638728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a7b959735c4cf29119e47e9fe8f8bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11f05ef-c6", "ovs_interfaceid": "c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Converting VIF {"id": "c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c", "address": "fa:16:3e:57:18:69", "network": {"id": "3c2575ba-8eac-478b-be1a-cbaf757e68da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647638728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a7b959735c4cf29119e47e9fe8f8bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11f05ef-c6", "ovs_interfaceid": "c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:18:69,bridge_name='br-int',has_traffic_filtering=True,id=c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c,network=Network(3c2575ba-8eac-478b-be1a-cbaf757e68da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc11f05ef-c6') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG os_vif [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:18:69,bridge_name='br-int',has_traffic_filtering=True,id=c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c,network=Network(3c2575ba-8eac-478b-be1a-cbaf757e68da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc11f05ef-c6') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4cc8d09f-399a-5385-9498-d116b9750745', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc11f05ef-c6, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc11f05ef-c6, col_values=(('qos', UUID('9d49fa26-8a4e-471e-bf7f-228ca4d407dd')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc11f05ef-c6, col_values=(('external_ids', {'iface-id': 'c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:18:69', 'vm-uuid': 'd8e689c4-af7b-4535-af47-cf458e2acc92'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:18 user nova-compute[75356]: INFO os_vif [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:18:69,bridge_name='br-int',has_traffic_filtering=True,id=c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c,network=Network(3c2575ba-8eac-478b-be1a-cbaf757e68da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc11f05ef-c6')
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:45:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] No VIF found with MAC fa:16:3e:57:18:69, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:45:19 user nova-compute[75356]: DEBUG nova.network.neutron [req-14e74ed2-874b-4dd1-ba5a-aba56bd39f3a req-74a4d89f-643d-41b3-a876-90494e8484e7 service nova] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Updated VIF entry in instance network info cache for port c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:45:19 user nova-compute[75356]: DEBUG nova.network.neutron [req-14e74ed2-874b-4dd1-ba5a-aba56bd39f3a req-74a4d89f-643d-41b3-a876-90494e8484e7 service nova] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Updating instance_info_cache with network_info: [{"id": "c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c", "address": "fa:16:3e:57:18:69", "network": {"id": "3c2575ba-8eac-478b-be1a-cbaf757e68da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647638728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a7b959735c4cf29119e47e9fe8f8bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11f05ef-c6", "ovs_interfaceid": "c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:45:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-14e74ed2-874b-4dd1-ba5a-aba56bd39f3a req-74a4d89f-643d-41b3-a876-90494e8484e7 service nova] Releasing lock "refresh_cache-d8e689c4-af7b-4535-af47-cf458e2acc92" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:45:19 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:45:19 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:45:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:20 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:45:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-39943b98-f9b6-4355-ba30-d7bd549cfb1b req-cfea7b82-835c-4b59-928b-63f8c1c2e28d service nova] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Received event network-vif-plugged-c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:45:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-39943b98-f9b6-4355-ba30-d7bd549cfb1b req-cfea7b82-835c-4b59-928b-63f8c1c2e28d service nova] Acquiring lock "d8e689c4-af7b-4535-af47-cf458e2acc92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:45:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-39943b98-f9b6-4355-ba30-d7bd549cfb1b req-cfea7b82-835c-4b59-928b-63f8c1c2e28d service nova] Lock "d8e689c4-af7b-4535-af47-cf458e2acc92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:45:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-39943b98-f9b6-4355-ba30-d7bd549cfb1b req-cfea7b82-835c-4b59-928b-63f8c1c2e28d service nova] Lock "d8e689c4-af7b-4535-af47-cf458e2acc92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:45:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-39943b98-f9b6-4355-ba30-d7bd549cfb1b req-cfea7b82-835c-4b59-928b-63f8c1c2e28d service nova] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] No waiting events found dispatching network-vif-plugged-c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:45:20 user nova-compute[75356]: WARNING nova.compute.manager [req-39943b98-f9b6-4355-ba30-d7bd549cfb1b req-cfea7b82-835c-4b59-928b-63f8c1c2e28d service nova] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Received unexpected event network-vif-plugged-c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c for instance with vm_state building and task_state spawning.
Nov 29 20:45:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:21 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:45:22 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:45:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:45:22 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Instance spawned successfully.
Nov 29 20:45:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:45:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:45:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:45:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:45:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:45:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:45:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:45:22 user nova-compute[75356]: INFO nova.compute.manager [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 29 20:45:22 user nova-compute[75356]: DEBUG nova.compute.manager [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:45:22 user nova-compute[75356]: INFO nova.compute.manager [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Took 5.71 seconds to build instance.
Nov 29 20:45:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-d92c05e0-9fdd-45a1-88eb-f183c07e189d tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "d8e689c4-af7b-4535-af47-cf458e2acc92" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.802s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:45:22 user nova-compute[75356]: DEBUG nova.compute.manager [req-05215567-ea84-4d3a-a31d-58004ecbdaee req-71f3ac5a-2dba-46a7-a145-5060b49cc739 service nova] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Received event network-vif-plugged-c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:45:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-05215567-ea84-4d3a-a31d-58004ecbdaee req-71f3ac5a-2dba-46a7-a145-5060b49cc739 service nova] Acquiring lock "d8e689c4-af7b-4535-af47-cf458e2acc92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:45:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-05215567-ea84-4d3a-a31d-58004ecbdaee req-71f3ac5a-2dba-46a7-a145-5060b49cc739 service nova] Lock "d8e689c4-af7b-4535-af47-cf458e2acc92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:45:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-05215567-ea84-4d3a-a31d-58004ecbdaee req-71f3ac5a-2dba-46a7-a145-5060b49cc739 service nova] Lock "d8e689c4-af7b-4535-af47-cf458e2acc92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:45:22 user nova-compute[75356]: DEBUG nova.compute.manager [req-05215567-ea84-4d3a-a31d-58004ecbdaee req-71f3ac5a-2dba-46a7-a145-5060b49cc739 service nova] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] No waiting events found dispatching network-vif-plugged-c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:45:22 user nova-compute[75356]: WARNING nova.compute.manager [req-05215567-ea84-4d3a-a31d-58004ecbdaee req-71f3ac5a-2dba-46a7-a145-5060b49cc739 service nova] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Received unexpected event network-vif-plugged-c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c for instance with vm_state active and task_state None.
Nov 29 20:45:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:24 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:45:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:45:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:45:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:10 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:46:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:46:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:46:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 20:46:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:46:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:46:14 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:46:14 user nova-compute[75356]: DEBUG nova.objects.instance [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lazy-loading 'info_cache' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:46:14 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Updating instance_info_cache with network_info: [{"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:46:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:46:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:46:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:16 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:46:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:46:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:46:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:46:16 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:46:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:46:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e689c4-af7b-4535-af47-cf458e2acc92/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e689c4-af7b-4535-af47-cf458e2acc92/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e689c4-af7b-4535-af47-cf458e2acc92/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e689c4-af7b-4535-af47-cf458e2acc92/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:17 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:46:17 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:46:17 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=8958MB free_disk=25.07952880859375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:46:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:46:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:46:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:17 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 7b0f5aad-e45c-4637-825c-cb295e98603a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:46:17 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance d8e689c4-af7b-4535-af47-cf458e2acc92 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:46:17 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:46:17 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:46:17 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:46:17 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:46:17 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:46:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:46:18 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:46:18 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:46:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:20 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:46:20 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:46:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:21 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:46:22 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:46:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:24 user nova-compute[75356]: DEBUG nova.objects.instance [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'flavor' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:46:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:46:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquired lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:46:24 user nova-compute[75356]: DEBUG nova.network.neutron [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:46:24 user nova-compute[75356]: DEBUG nova.objects.instance [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'info_cache' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:46:24 user nova-compute[75356]: DEBUG nova.objects.base [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Object Instance<7b0f5aad-e45c-4637-825c-cb295e98603a> lazy-loaded attributes: flavor,info_cache {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.network.neutron [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Updating instance_info_cache with network_info: [{"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Releasing lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:46:25 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Instance destroyed successfully.
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.objects.instance [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'resources' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.objects.base [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Object Instance<7b0f5aad-e45c-4637-825c-cb295e98603a> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2030304790',display_name='tempest-AttachVolumeTestJSON-server-2030304790',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2030304790',id=46,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKJDjh0oQT6q6eYOe6FVZPoIq0B87siUqrQL2lCAPFszfSPQfbW6SrRyyUbxMDfAEyss1bZglpIevHc2gR0WGMrHpVbgzZpOeBJ4a3Y1yQFHxnZ6St4LQDIVjP1b8kKlA==',key_name='tempest-keypair-2102929947',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:42:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5a1b8a1f1c6f4c24bb1ca7faafb49226',ramdisk_id='',reservation_id='r-ptrcc6aq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1837009022',owner_user_name='tempest-AttachVolumeTestJSON-1837009022-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:44:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43ecf2b8c0f04d90a1ad6a780894fefc',uuid=7b0f5aad-e45c-4637-825c-cb295e98603a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converting VIF {"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f0:8d,bridge_name='br-int',has_traffic_filtering=True,id=ddf386ac-899d-4106-88a9-ec3916a51b7c,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf386ac-89') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_vif [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f0:8d,bridge_name='br-int',has_traffic_filtering=True,id=ddf386ac-899d-4106-88a9-ec3916a51b7c,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf386ac-89') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddf386ac-89, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b786f44-d4af-4aef-9f36-53bbcda430f7) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:46:25 user nova-compute[75356]: INFO os_vif [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f0:8d,bridge_name='br-int',has_traffic_filtering=True,id=ddf386ac-899d-4106-88a9-ec3916a51b7c,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf386ac-89')
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVsqBLGy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:46:25 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9083670-61d9-4d09-b77b-f0188a644b94]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:46:25 user nova-compute[75356]: No targets found.
Nov 29 20:46:25 user nova-compute[75356]: iSNS:
Nov 29 20:46:25 user nova-compute[75356]: No targets found.
Nov 29 20:46:25 user nova-compute[75356]: STATIC:
Nov 29 20:46:25 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05
Nov 29 20:46:25 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:46:25 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:46:25 user nova-compute[75356]: FIRMWARE:
Nov 29 20:46:25 user nova-compute[75356]: No targets found.
Nov 29 20:46:25 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:46:25 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:46:25 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90920a1-ecab-440c-96fd-77ad7ab0ff1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb019f6-5065-450d-a3a3-0e9658aef879]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 (non-flash)
Nov 29 20:46:25 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 (non-flash)
Nov 29 20:46:25 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e41b1cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05'): ({'sdb'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Removing single pathed devices sdb {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7d027e-7ed3-4f7a-8086-953a0d4688e5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a539e1-6220-4b3b-91fc-6d2a2e49589f]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Flushing IO for device /dev/sdb {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7918da-b304-4f10-8316-6e4942513060]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b187da-ef9c-4a23-91f4-ab7c5e6b6ad3]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] SCSI volumes sdb have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a741ff66-3003-4e30-9846-b7cef807e1cf]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[456c8eb4-4668-4924-9905-a9c26027c50e]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05, portal: 172.16.0.220,3260]
Nov 29 20:46:25 user nova-compute[75356]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05, portal: 172.16.0.220,3260] successful.
Nov 29 20:46:25 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[797260ed-bf05-421a-a28e-62b80cb467ec]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] <== disconnect_volume: return (282ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Start _get_guest_xml network_info=[{"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVsqBLGy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '7b0f5aad-e45c-4637-825c-cb295e98603a', 'attached_at': '', 'detached_at': '', 'volume_id': '5b92a220-95f0-4732-b104-9b2895c29d05', 'serial': '5b92a220-95f0-4732-b104-9b2895c29d05'}, 'attachment_id': 'd37d3f9e-7163-401c-ac9a-2b994a41c1a7', 'volume_type': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.objects.instance [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'numa_topology' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.objects.base [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Object Instance<7b0f5aad-e45c-4637-825c-cb295e98603a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:46:25 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:46:25 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.objects.instance [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.objects.base [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Object Instance<7b0f5aad-e45c-4637-825c-cb295e98603a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVsqBLGy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:46:25 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:46:25 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:46:25 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[486b0557-6a77-4b8e-96c9-d354d33b23df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:46:25 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c93e03-8da3-45f0-add2-291b424546a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05] added
Nov 29 20:46:25 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbaff10-ba98-4b8d-91f0-b171bbc29dc4]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[099d9839-1222-4722-9a2f-f0f2d701d7cc]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVsqBLGy {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVsqBLGy" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c7805d-56db-4ded-9adb-7b41a4f98285]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zVsqBLGy'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38e6b35-3a43-44ba-99e0-7e14456fc462]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0578b8db-77ce-44b2-8a8a-b8d79f6bc424]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 20:46:25 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 20:46:25 user nova-compute[75356]:  {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:46:25 user nova-compute[75356]: WARNING os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 20:46:25 user nova-compute[75356]: 
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[115e79b1-ce94-44d4-894e-66f91e0b2b73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05, portal: 172.16.0.220,3260]
Nov 29 20:46:25 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05, portal: 172.16.0.220,3260] successful.
Nov 29 20:46:25 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd078d5-74f8-4ec3-b245-6fafc86e8e6d]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[326764ba-09f9-497b-b87d-91b8be088058]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 (non-flash)
Nov 29 20:46:25 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 (non-flash)
Nov 29 20:46:25 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.235s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d18caed-2b40-456f-aa82-d8975ef01b9c]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:46:25 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVsqBLGy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:46:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.262s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:46:26 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] <== connect_volume: return (1263ms) {'type': 'block', 'scsi_wwn': '26437643737393066', 'path': '/dev/sdb'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:46:26 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437643737393066', 'path': '/dev/sdb'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:46:26 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2030304790',display_name='tempest-AttachVolumeTestJSON-server-2030304790',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2030304790',id=46,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKJDjh0oQT6q6eYOe6FVZPoIq0B87siUqrQL2lCAPFszfSPQfbW6SrRyyUbxMDfAEyss1bZglpIevHc2gR0WGMrHpVbgzZpOeBJ4a3Y1yQFHxnZ6St4LQDIVjP1b8kKlA==',key_name='tempest-keypair-2102929947',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:42:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5a1b8a1f1c6f4c24bb1ca7faafb49226',ramdisk_id='',reservation_id='r-ptrcc6aq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1837009022',owner_user_name='tempest-AttachVolumeTestJSON-1837009022-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:44:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43ecf2b8c0f04d90a1ad6a780894fefc',uuid=7b0f5aad-e45c-4637-825c-cb295e98603a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:46:26 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converting VIF {"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:46:26 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f0:8d,bridge_name='br-int',has_traffic_filtering=True,id=ddf386ac-899d-4106-88a9-ec3916a51b7c,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf386ac-89') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:46:26 user nova-compute[75356]: DEBUG nova.objects.instance [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:46:26 user nova-compute[75356]: DEBUG nova.objects.base [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Object Instance<7b0f5aad-e45c-4637-825c-cb295e98603a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:46:26 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:46:26 user nova-compute[75356]:   <uuid>7b0f5aad-e45c-4637-825c-cb295e98603a</uuid>
Nov 29 20:46:26 user nova-compute[75356]:   <name>instance-0000002e</name>
Nov 29 20:46:26 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:46:26 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:46:26 user nova-compute[75356]:   <metadata>
Nov 29 20:46:26 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:46:26 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:46:26 user nova-compute[75356]:       <nova:name>tempest-AttachVolumeTestJSON-server-2030304790</nova:name>
Nov 29 20:46:26 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:46:25</nova:creationTime>
Nov 29 20:46:26 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:46:26 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:46:26 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:46:26 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:46:26 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:46:26 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:46:26 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:46:26 user nova-compute[75356]:       <nova:owner>
Nov 29 20:46:26 user nova-compute[75356]:         <nova:user uuid="43ecf2b8c0f04d90a1ad6a780894fefc">tempest-AttachVolumeTestJSON-1837009022-project-member</nova:user>
Nov 29 20:46:26 user nova-compute[75356]:         <nova:project uuid="5a1b8a1f1c6f4c24bb1ca7faafb49226">tempest-AttachVolumeTestJSON-1837009022</nova:project>
Nov 29 20:46:26 user nova-compute[75356]:       </nova:owner>
Nov 29 20:46:26 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:46:26 user nova-compute[75356]:       <nova:ports>
Nov 29 20:46:26 user nova-compute[75356]:         <nova:port uuid="ddf386ac-899d-4106-88a9-ec3916a51b7c">
Nov 29 20:46:26 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 20:46:26 user nova-compute[75356]:         </nova:port>
Nov 29 20:46:26 user nova-compute[75356]:       </nova:ports>
Nov 29 20:46:26 user nova-compute[75356]:     </nova:instance>
Nov 29 20:46:26 user nova-compute[75356]:   </metadata>
Nov 29 20:46:26 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:46:26 user nova-compute[75356]:     <system>
Nov 29 20:46:26 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:46:26 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:46:26 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:46:26 user nova-compute[75356]:       <entry name="serial">7b0f5aad-e45c-4637-825c-cb295e98603a</entry>
Nov 29 20:46:26 user nova-compute[75356]:       <entry name="uuid">7b0f5aad-e45c-4637-825c-cb295e98603a</entry>
Nov 29 20:46:26 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:46:26 user nova-compute[75356]:     </system>
Nov 29 20:46:26 user nova-compute[75356]:   </sysinfo>
Nov 29 20:46:26 user nova-compute[75356]:   <os>
Nov 29 20:46:26 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:46:26 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:46:26 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:46:26 user nova-compute[75356]:   </os>
Nov 29 20:46:26 user nova-compute[75356]:   <features>
Nov 29 20:46:26 user nova-compute[75356]:     <acpi/>
Nov 29 20:46:26 user nova-compute[75356]:     <apic/>
Nov 29 20:46:26 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:46:26 user nova-compute[75356]:   </features>
Nov 29 20:46:26 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:46:26 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:46:26 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:46:26 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:46:26 user nova-compute[75356]:   </clock>
Nov 29 20:46:26 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:46:26 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:46:26 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:46:26 user nova-compute[75356]:   </cpu>
Nov 29 20:46:26 user nova-compute[75356]:   <devices>
Nov 29 20:46:26 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:46:26 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:46:26 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk"/>
Nov 29 20:46:26 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:46:26 user nova-compute[75356]:     </disk>
Nov 29 20:46:26 user nova-compute[75356]:     <disk type="block" device="disk">
Nov 29 20:46:26 user nova-compute[75356]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:46:26 user nova-compute[75356]:       <source dev="/dev/sdb"/>
Nov 29 20:46:26 user nova-compute[75356]:       <target dev="vdb" bus="virtio"/>
Nov 29 20:46:26 user nova-compute[75356]:       <serial>5b92a220-95f0-4732-b104-9b2895c29d05</serial>
Nov 29 20:46:26 user nova-compute[75356]:     </disk>
Nov 29 20:46:26 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:46:26 user nova-compute[75356]:       <mac address="fa:16:3e:8b:f0:8d"/>
Nov 29 20:46:26 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:46:26 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:46:26 user nova-compute[75356]:       <target dev="tapddf386ac-89"/>
Nov 29 20:46:26 user nova-compute[75356]:     </interface>
Nov 29 20:46:26 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:46:26 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/console.log" append="off"/>
Nov 29 20:46:26 user nova-compute[75356]:     </serial>
Nov 29 20:46:26 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:46:26 user nova-compute[75356]:     <video>
Nov 29 20:46:26 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:46:26 user nova-compute[75356]:     </video>
Nov 29 20:46:26 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:46:26 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:46:26 user nova-compute[75356]:     </rng>
Nov 29 20:46:26 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:46:26 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:46:26 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:46:26 user nova-compute[75356]:     </memballoon>
Nov 29 20:46:26 user nova-compute[75356]:   </devices>
Nov 29 20:46:26 user nova-compute[75356]: </domain>
Nov 29 20:46:26 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:46:26 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG nova.objects.instance [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG nova.objects.base [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Object Instance<7b0f5aad-e45c-4637-825c-cb295e98603a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.252s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Cannot resize image /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG nova.objects.instance [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'migration_context' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG nova.objects.base [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Object Instance<7b0f5aad-e45c-4637-825c-cb295e98603a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2030304790',display_name='tempest-AttachVolumeTestJSON-server-2030304790',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2030304790',id=46,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKJDjh0oQT6q6eYOe6FVZPoIq0B87siUqrQL2lCAPFszfSPQfbW6SrRyyUbxMDfAEyss1bZglpIevHc2gR0WGMrHpVbgzZpOeBJ4a3Y1yQFHxnZ6St4LQDIVjP1b8kKlA==',key_name='tempest-keypair-2102929947',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:42:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5a1b8a1f1c6f4c24bb1ca7faafb49226',ramdisk_id='',reservation_id='r-ptrcc6aq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1837009022',owner_user_name='tempest-AttachVolumeTestJSON-1837009022-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:44:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43ecf2b8c0f04d90a1ad6a780894fefc',uuid=7b0f5aad-e45c-4637-825c-cb295e98603a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converting VIF {"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f0:8d,bridge_name='br-int',has_traffic_filtering=True,id=ddf386ac-899d-4106-88a9-ec3916a51b7c,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf386ac-89') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG os_vif [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f0:8d,bridge_name='br-int',has_traffic_filtering=True,id=ddf386ac-899d-4106-88a9-ec3916a51b7c,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf386ac-89') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c3cd329-ea94-5b5b-8008-4a4199dd44a1', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddf386ac-89, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapddf386ac-89, col_values=(('qos', UUID('9b49316c-0039-4eb5-991d-71322b47756f')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapddf386ac-89, col_values=(('external_ids', {'iface-id': 'ddf386ac-899d-4106-88a9-ec3916a51b7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:f0:8d', 'vm-uuid': '7b0f5aad-e45c-4637-825c-cb295e98603a'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:46:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:27 user nova-compute[75356]: INFO os_vif [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f0:8d,bridge_name='br-int',has_traffic_filtering=True,id=ddf386ac-899d-4106-88a9-ec3916a51b7c,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf386ac-89')
Nov 29 20:46:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:29 user nova-compute[75356]: DEBUG nova.compute.manager [req-cfe59367-3bdd-4bd3-aef1-6601668c5bd3 req-ca8cc7a9-3102-45e0-a758-6cd273643463 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received event network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:46:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cfe59367-3bdd-4bd3-aef1-6601668c5bd3 req-ca8cc7a9-3102-45e0-a758-6cd273643463 service nova] Acquiring lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:46:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cfe59367-3bdd-4bd3-aef1-6601668c5bd3 req-ca8cc7a9-3102-45e0-a758-6cd273643463 service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:46:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cfe59367-3bdd-4bd3-aef1-6601668c5bd3 req-ca8cc7a9-3102-45e0-a758-6cd273643463 service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:46:29 user nova-compute[75356]: DEBUG nova.compute.manager [req-cfe59367-3bdd-4bd3-aef1-6601668c5bd3 req-ca8cc7a9-3102-45e0-a758-6cd273643463 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] No waiting events found dispatching network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:46:29 user nova-compute[75356]: WARNING nova.compute.manager [req-cfe59367-3bdd-4bd3-aef1-6601668c5bd3 req-ca8cc7a9-3102-45e0-a758-6cd273643463 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received unexpected event network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c for instance with vm_state stopped and task_state powering-on.
Nov 29 20:46:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:31 user nova-compute[75356]: DEBUG nova.compute.manager [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:46:31 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Instance rebooted successfully.
Nov 29 20:46:31 user nova-compute[75356]: DEBUG nova.compute.manager [None req-9588809b-88ed-4202-b7b5-1de5ed70375a tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:46:31 user nova-compute[75356]: DEBUG nova.compute.manager [req-522cd2d2-1dfe-4ce1-8c4e-0e233efde5c2 req-fefcccf9-2c8a-4212-9bed-844ef50a62c0 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received event network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:46:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-522cd2d2-1dfe-4ce1-8c4e-0e233efde5c2 req-fefcccf9-2c8a-4212-9bed-844ef50a62c0 service nova] Acquiring lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:46:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-522cd2d2-1dfe-4ce1-8c4e-0e233efde5c2 req-fefcccf9-2c8a-4212-9bed-844ef50a62c0 service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:46:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-522cd2d2-1dfe-4ce1-8c4e-0e233efde5c2 req-fefcccf9-2c8a-4212-9bed-844ef50a62c0 service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:46:31 user nova-compute[75356]: DEBUG nova.compute.manager [req-522cd2d2-1dfe-4ce1-8c4e-0e233efde5c2 req-fefcccf9-2c8a-4212-9bed-844ef50a62c0 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] No waiting events found dispatching network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:46:31 user nova-compute[75356]: WARNING nova.compute.manager [req-522cd2d2-1dfe-4ce1-8c4e-0e233efde5c2 req-fefcccf9-2c8a-4212-9bed-844ef50a62c0 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received unexpected event network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c for instance with vm_state active and task_state None.
Nov 29 20:46:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:46:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:46:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:47:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:47:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:47:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Acquiring lock "d8e689c4-af7b-4535-af47-cf458e2acc92" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:47:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "d8e689c4-af7b-4535-af47-cf458e2acc92" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:47:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Acquiring lock "d8e689c4-af7b-4535-af47-cf458e2acc92-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:47:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "d8e689c4-af7b-4535-af47-cf458e2acc92-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:47:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "d8e689c4-af7b-4535-af47-cf458e2acc92-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:47:07 user nova-compute[75356]: INFO nova.compute.manager [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Terminating instance
Nov 29 20:47:07 user nova-compute[75356]: DEBUG nova.compute.manager [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:47:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:47:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:47:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:47:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:47:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:47:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-6738623a-24a5-43b3-a658-d29d720470a2 req-05c214b6-42e7-43ac-af59-dbaa3c4e811c service nova] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Received event network-vif-unplugged-c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:47:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6738623a-24a5-43b3-a658-d29d720470a2 req-05c214b6-42e7-43ac-af59-dbaa3c4e811c service nova] Acquiring lock "d8e689c4-af7b-4535-af47-cf458e2acc92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:47:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6738623a-24a5-43b3-a658-d29d720470a2 req-05c214b6-42e7-43ac-af59-dbaa3c4e811c service nova] Lock "d8e689c4-af7b-4535-af47-cf458e2acc92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:47:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6738623a-24a5-43b3-a658-d29d720470a2 req-05c214b6-42e7-43ac-af59-dbaa3c4e811c service nova] Lock "d8e689c4-af7b-4535-af47-cf458e2acc92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:47:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-6738623a-24a5-43b3-a658-d29d720470a2 req-05c214b6-42e7-43ac-af59-dbaa3c4e811c service nova] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] No waiting events found dispatching network-vif-unplugged-c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:47:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-6738623a-24a5-43b3-a658-d29d720470a2 req-05c214b6-42e7-43ac-af59-dbaa3c4e811c service nova] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Received event network-vif-unplugged-c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:47:08 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Instance destroyed successfully.
Nov 29 20:47:08 user nova-compute[75356]: DEBUG nova.objects.instance [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lazy-loading 'resources' on Instance uuid d8e689c4-af7b-4535-af47-cf458e2acc92 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:47:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1652952213',display_name='tempest-VolumesActionsTest-instance-1652952213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1652952213',id=49,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:45:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04a7b959735c4cf29119e47e9fe8f8bb',ramdisk_id='',reservation_id='r-urcnc1iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1193759144',owner_user_name='tempest-VolumesActionsTest-1193759144-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:45:22Z,user_data=None,user_id='cae1d8859ca742f99d90f205658e2760',uuid=d8e689c4-af7b-4535-af47-cf458e2acc92,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c", "address": "fa:16:3e:57:18:69", "network": {"id": "3c2575ba-8eac-478b-be1a-cbaf757e68da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647638728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a7b959735c4cf29119e47e9fe8f8bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11f05ef-c6", "ovs_interfaceid": "c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:47:08 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Converting VIF {"id": "c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c", "address": "fa:16:3e:57:18:69", "network": {"id": "3c2575ba-8eac-478b-be1a-cbaf757e68da", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647638728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04a7b959735c4cf29119e47e9fe8f8bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11f05ef-c6", "ovs_interfaceid": "c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:47:08 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:18:69,bridge_name='br-int',has_traffic_filtering=True,id=c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c,network=Network(3c2575ba-8eac-478b-be1a-cbaf757e68da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc11f05ef-c6') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:47:08 user nova-compute[75356]: DEBUG os_vif [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:18:69,bridge_name='br-int',has_traffic_filtering=True,id=c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c,network=Network(3c2575ba-8eac-478b-be1a-cbaf757e68da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc11f05ef-c6') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:47:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:47:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc11f05ef-c6, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:47:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:47:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:47:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:47:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d49fa26-8a4e-471e-bf7f-228ca4d407dd) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:47:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:47:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:47:08 user nova-compute[75356]: INFO os_vif [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:18:69,bridge_name='br-int',has_traffic_filtering=True,id=c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c,network=Network(3c2575ba-8eac-478b-be1a-cbaf757e68da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc11f05ef-c6')
Nov 29 20:47:08 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Deleting instance files /opt/stack/data/nova/instances/d8e689c4-af7b-4535-af47-cf458e2acc92_del
Nov 29 20:47:08 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Deletion of /opt/stack/data/nova/instances/d8e689c4-af7b-4535-af47-cf458e2acc92_del complete
Nov 29 20:47:08 user nova-compute[75356]: INFO nova.compute.manager [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 20:47:08 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:47:08 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:47:08 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:47:08 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:47:08 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Took 0.58 seconds to deallocate network for instance.
Nov 29 20:47:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:47:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:47:09 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:47:09 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:47:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:47:09 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Deleted allocations for instance d8e689c4-af7b-4535-af47-cf458e2acc92
Nov 29 20:47:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cc39e7fd-d96c-46fd-afd0-cc1fd7ef3f93 tempest-VolumesActionsTest-1193759144 tempest-VolumesActionsTest-1193759144-project-member] Lock "d8e689c4-af7b-4535-af47-cf458e2acc92" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.831s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:47:09 user nova-compute[75356]: DEBUG nova.compute.manager [req-a07fddca-8c31-4753-b199-5b59dce1a325 req-bc4b05a0-b476-409d-b9c3-2aea296b279e service nova] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Received event network-vif-plugged-c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:47:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a07fddca-8c31-4753-b199-5b59dce1a325 req-bc4b05a0-b476-409d-b9c3-2aea296b279e service nova] Acquiring lock "d8e689c4-af7b-4535-af47-cf458e2acc92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:47:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a07fddca-8c31-4753-b199-5b59dce1a325 req-bc4b05a0-b476-409d-b9c3-2aea296b279e service nova] Lock "d8e689c4-af7b-4535-af47-cf458e2acc92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:47:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-a07fddca-8c31-4753-b199-5b59dce1a325 req-bc4b05a0-b476-409d-b9c3-2aea296b279e service nova] Lock "d8e689c4-af7b-4535-af47-cf458e2acc92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:47:09 user nova-compute[75356]: DEBUG nova.compute.manager [req-a07fddca-8c31-4753-b199-5b59dce1a325 req-bc4b05a0-b476-409d-b9c3-2aea296b279e service nova] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] No waiting events found dispatching network-vif-plugged-c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:47:09 user nova-compute[75356]: WARNING nova.compute.manager [req-a07fddca-8c31-4753-b199-5b59dce1a325 req-bc4b05a0-b476-409d-b9c3-2aea296b279e service nova] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Received unexpected event network-vif-plugged-c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c for instance with vm_state deleted and task_state None.
Nov 29 20:47:09 user nova-compute[75356]: DEBUG nova.compute.manager [req-a07fddca-8c31-4753-b199-5b59dce1a325 req-bc4b05a0-b476-409d-b9c3-2aea296b279e service nova] [instance: d8e689c4-af7b-4535-af47-cf458e2acc92] Received event network-vif-deleted-c11f05ef-c65d-4ff9-8f41-4e3ca3ee0c3c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:47:11 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:47:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:47:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:47:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:47:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Didn't find any instances for network info cache update. {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 20:47:17 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:47:17 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:47:18 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:47:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:47:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:47:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:47:18 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:47:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:47:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:47:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:47:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:47:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:47:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:47:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:47:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:47:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:47:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:47:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:47:19 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:47:19 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:47:19 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=8953MB free_disk=25.104511260986328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:47:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:47:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:47:19 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 7b0f5aad-e45c-4637-825c-cb295e98603a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:47:19 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:47:19 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:47:19 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:47:19 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:47:19 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:47:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:47:21 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:47:21 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:47:22 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:47:22 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:47:22 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:47:22 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:47:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:47:26 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:47:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:47:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:47:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:47:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:47:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:47:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:47:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:47:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:47:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:47:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:47:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:47:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:47:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:47:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:47:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:47:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:47:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:47:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:47:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:47:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:47:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:47:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:47:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:47:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:47:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:47:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:47:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:48:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:48:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:48:11 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:48:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:48:15 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:48:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:48:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 20:48:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:48:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:48:15 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:48:15 user nova-compute[75356]: DEBUG nova.objects.instance [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lazy-loading 'info_cache' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:48:16 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Updating instance_info_cache with network_info: [{"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:48:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "7b0f5aad-e45c-4637-825c-cb295e98603a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:48:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:48:16 user nova-compute[75356]: INFO nova.compute.manager [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Detaching volume 5b92a220-95f0-4732-b104-9b2895c29d05
Nov 29 20:48:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:48:16 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:48:16 user nova-compute[75356]: INFO nova.virt.block_device [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Attempting to driver detach volume 5b92a220-95f0-4732-b104-9b2895c29d05 from mountpoint /dev/vdb
Nov 29 20:48:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Attempting to detach device vdb from instance 7b0f5aad-e45c-4637-825c-cb295e98603a from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:48:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:48:16 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:48:16 user nova-compute[75356]:   <source dev="/dev/sdb"/>
Nov 29 20:48:16 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:48:16 user nova-compute[75356]:   <serial>5b92a220-95f0-4732-b104-9b2895c29d05</serial>
Nov 29 20:48:16 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 20:48:16 user nova-compute[75356]: </disk>
Nov 29 20:48:16 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:48:16 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Successfully detached device vdb from instance 7b0f5aad-e45c-4637-825c-cb295e98603a from the persistent domain config.
Nov 29 20:48:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b0f5aad-e45c-4637-825c-cb295e98603a from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:48:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:48:16 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:48:16 user nova-compute[75356]:   <source dev="/dev/sdb"/>
Nov 29 20:48:16 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:48:16 user nova-compute[75356]:   <serial>5b92a220-95f0-4732-b104-9b2895c29d05</serial>
Nov 29 20:48:16 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 20:48:16 user nova-compute[75356]: </disk>
Nov 29 20:48:16 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:48:17 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:48:17 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:48:17 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:48:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:48:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:48:19 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:48:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:48:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:48:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:48:19 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:48:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:48:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:48:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:48:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:48:20 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:48:20 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:48:20 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=9026MB free_disk=24.368263244628906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:48:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:48:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:48:20 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 7b0f5aad-e45c-4637-825c-cb295e98603a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:48:20 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:48:20 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:48:20 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing inventories for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 20:48:20 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Updating ProviderTree inventory for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 20:48:20 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Updating inventory in ProviderTree for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 20:48:20 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing aggregate associations for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a, aggregates: None {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 20:48:20 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing trait associations for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 20:48:20 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:48:20 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:48:20 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:48:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.682s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:48:22 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:48:22 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:48:23 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:48:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:48:24 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:48:28 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:48:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:48:31 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:48:31 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75356) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 20:48:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:48:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:48:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:48:35 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:48:35 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Cleaning up deleted instances {{(pid=75356) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 20:48:35 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] There are 0 instances to clean {{(pid=75356) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 20:48:36 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:48:37 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7b0f5aad-e45c-4637-825c-cb295e98603a is timed out.
Nov 29 20:48:37 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Successfully detached device vdb from instance 7b0f5aad-e45c-4637-825c-cb295e98603a from the live domain config.
Nov 29 20:48:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVsqBLGy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:48:37 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:48:37 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b4a9ef-6719-4f54-ac49-6429c7134b39]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:48:37 user nova-compute[75356]: No targets found.
Nov 29 20:48:37 user nova-compute[75356]: iSNS:
Nov 29 20:48:37 user nova-compute[75356]: No targets found.
Nov 29 20:48:37 user nova-compute[75356]: STATIC:
Nov 29 20:48:37 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05
Nov 29 20:48:37 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:48:37 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:48:37 user nova-compute[75356]: FIRMWARE:
Nov 29 20:48:37 user nova-compute[75356]: No targets found.
Nov 29 20:48:37 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:48:37 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:48:37 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f694a38-2647-4047-8692-717afaa5f709]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[61938294-b2c5-416d-b49f-b1f97528f2a8]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 (non-flash)
Nov 29 20:48:37 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 (non-flash)
Nov 29 20:48:37 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f83084911b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05'): ({'sdb'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Removing single pathed devices sdb {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c60ec6-94d9-454c-9bfa-1e15c6016b44]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab8d5be-dfcb-4146-bf37-7156418f4e68]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Flushing IO for device /dev/sdb {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[27de3cfd-d8bd-4a2d-8c15-de72bb1c8732]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd54f6df-1b15-416a-b17f-6c5242537fa5]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] SCSI volumes sdb have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[2054855f-c917-495a-95bb-f65b832b45ee]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f88f13-d7ed-4a36-98a3-7b928ebfe236]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05, portal: 172.16.0.220,3260]
Nov 29 20:48:37 user nova-compute[75356]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05, portal: 172.16.0.220,3260] successful.
Nov 29 20:48:37 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b92a220-95f0-4732-b104-9b2895c29d05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2935cf-368c-46d8-b23e-32910065742f]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] <== disconnect_volume: return (311ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:48:37 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:48:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:48:38 user nova-compute[75356]: DEBUG nova.objects.instance [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'flavor' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:48:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-991e81e6-520c-427b-bdec-f72ba35790bc tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.428s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:48:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cdcc95e2-aeb7-4e72-a371-e155ced34ed9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "7b0f5aad-e45c-4637-825c-cb295e98603a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:48:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cdcc95e2-aeb7-4e72-a371-e155ced34ed9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:48:40 user nova-compute[75356]: DEBUG nova.compute.manager [None req-cdcc95e2-aeb7-4e72-a371-e155ced34ed9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:48:40 user nova-compute[75356]: DEBUG nova.compute.manager [None req-cdcc95e2-aeb7-4e72-a371-e155ced34ed9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75356) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 29 20:48:40 user nova-compute[75356]: DEBUG nova.objects.instance [None req-cdcc95e2-aeb7-4e72-a371-e155ced34ed9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'flavor' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:48:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:48:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:48:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:48:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:48:40 user nova-compute[75356]: DEBUG nova.compute.manager [req-d67fef4c-7db4-40ae-bdf7-252bbe9d5052 req-3d43703b-2cd3-4e27-bc18-98d703459799 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received event network-vif-unplugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:48:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d67fef4c-7db4-40ae-bdf7-252bbe9d5052 req-3d43703b-2cd3-4e27-bc18-98d703459799 service nova] Acquiring lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:48:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d67fef4c-7db4-40ae-bdf7-252bbe9d5052 req-3d43703b-2cd3-4e27-bc18-98d703459799 service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:48:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d67fef4c-7db4-40ae-bdf7-252bbe9d5052 req-3d43703b-2cd3-4e27-bc18-98d703459799 service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:48:40 user nova-compute[75356]: DEBUG nova.compute.manager [req-d67fef4c-7db4-40ae-bdf7-252bbe9d5052 req-3d43703b-2cd3-4e27-bc18-98d703459799 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] No waiting events found dispatching network-vif-unplugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:48:40 user nova-compute[75356]: WARNING nova.compute.manager [req-d67fef4c-7db4-40ae-bdf7-252bbe9d5052 req-3d43703b-2cd3-4e27-bc18-98d703459799 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received unexpected event network-vif-unplugged-ddf386ac-899d-4106-88a9-ec3916a51b7c for instance with vm_state active and task_state powering-off.
Nov 29 20:48:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:48:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:48:40 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Instance destroyed successfully.
Nov 29 20:48:40 user nova-compute[75356]: DEBUG nova.compute.manager [None req-cdcc95e2-aeb7-4e72-a371-e155ced34ed9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:48:40 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-cdcc95e2-aeb7-4e72-a371-e155ced34ed9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.845s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:48:42 user nova-compute[75356]: DEBUG nova.compute.manager [req-0d6209b7-60a3-4408-96ba-37e6e483c7a3 req-cf7b7c5d-780f-45c0-909f-9efdfca9c3ee service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received event network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:48:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0d6209b7-60a3-4408-96ba-37e6e483c7a3 req-cf7b7c5d-780f-45c0-909f-9efdfca9c3ee service nova] Acquiring lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:48:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0d6209b7-60a3-4408-96ba-37e6e483c7a3 req-cf7b7c5d-780f-45c0-909f-9efdfca9c3ee service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:48:42 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0d6209b7-60a3-4408-96ba-37e6e483c7a3 req-cf7b7c5d-780f-45c0-909f-9efdfca9c3ee service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:48:42 user nova-compute[75356]: DEBUG nova.compute.manager [req-0d6209b7-60a3-4408-96ba-37e6e483c7a3 req-cf7b7c5d-780f-45c0-909f-9efdfca9c3ee service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] No waiting events found dispatching network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:48:42 user nova-compute[75356]: WARNING nova.compute.manager [req-0d6209b7-60a3-4408-96ba-37e6e483c7a3 req-cf7b7c5d-780f-45c0-909f-9efdfca9c3ee service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received unexpected event network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c for instance with vm_state stopped and task_state None.
Nov 29 20:48:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:48:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:48:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:48:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:49:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:49:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:49:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:49:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:49:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:49:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:49:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:49:11 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:49:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:49:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:49:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:49:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:49:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:49:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:49:16 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:49:16 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:49:16 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 20:49:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:49:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:49:16 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:49:16 user nova-compute[75356]: DEBUG nova.objects.instance [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lazy-loading 'info_cache' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:49:16 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Updating instance_info_cache with network_info: [{"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:49:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:49:16 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:49:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:49:19 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:49:19 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:49:21 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:49:21 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:49:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:49:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:49:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:49:21 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:49:21 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:49:21 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:49:21 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:49:21 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:49:22 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:49:22 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:49:22 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=9228MB free_disk=25.09360122680664GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:49:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:49:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:49:22 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 7b0f5aad-e45c-4637-825c-cb295e98603a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:49:22 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:49:22 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:49:22 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:49:22 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:49:22 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:49:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:49:23 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:49:23 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:49:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:49:26 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:49:26 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:49:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:49:30 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:49:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:49:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:49:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:49:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:49:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:49:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:49:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:49:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:49:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:49:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:49:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:49:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:49:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:49:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:49:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:49:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:49:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:49:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:49:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:49:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:49:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:49:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:49:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:49:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:49:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:49:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:50:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:50:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:50:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:50:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:50:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:50:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:11 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:50:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:50:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:50:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:50:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:50:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:17 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:50:17 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:50:17 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 20:50:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:50:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:50:17 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:50:17 user nova-compute[75356]: DEBUG nova.objects.instance [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lazy-loading 'info_cache' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:50:17 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Updating instance_info_cache with network_info: [{"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:50:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:50:17 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:50:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:50:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:50:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:50:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:50:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:21 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:50:21 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:50:23 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:50:23 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:50:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:50:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:50:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:50:23 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:50:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:50:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:50:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:50:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:50:23 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:50:24 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:50:24 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:50:24 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=9244MB free_disk=25.093074798583984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:50:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:50:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:50:24 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 7b0f5aad-e45c-4637-825c-cb295e98603a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:50:24 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:50:24 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:50:24 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:50:24 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:50:24 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:50:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:50:25 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:50:25 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:50:28 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:50:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:50:30 user nova-compute[75356]: DEBUG nova.objects.instance [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'flavor' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:50:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:50:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquired lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:50:30 user nova-compute[75356]: DEBUG nova.network.neutron [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:50:30 user nova-compute[75356]: DEBUG nova.objects.instance [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'info_cache' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:50:30 user nova-compute[75356]: DEBUG nova.objects.base [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Object Instance<7b0f5aad-e45c-4637-825c-cb295e98603a> lazy-loaded attributes: flavor,info_cache {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.network.neutron [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Updating instance_info_cache with network_info: [{"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Releasing lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:50:31 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Instance destroyed successfully.
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.objects.instance [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'resources' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.objects.base [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Object Instance<7b0f5aad-e45c-4637-825c-cb295e98603a> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2030304790',display_name='tempest-AttachVolumeTestJSON-server-2030304790',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2030304790',id=46,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKJDjh0oQT6q6eYOe6FVZPoIq0B87siUqrQL2lCAPFszfSPQfbW6SrRyyUbxMDfAEyss1bZglpIevHc2gR0WGMrHpVbgzZpOeBJ4a3Y1yQFHxnZ6St4LQDIVjP1b8kKlA==',key_name='tempest-keypair-2102929947',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:42:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5a1b8a1f1c6f4c24bb1ca7faafb49226',ramdisk_id='',reservation_id='r-ptrcc6aq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1837009022',owner_user_name='tempest-AttachVolumeTestJSON-1837009022-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:48:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43ecf2b8c0f04d90a1ad6a780894fefc',uuid=7b0f5aad-e45c-4637-825c-cb295e98603a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converting VIF {"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f0:8d,bridge_name='br-int',has_traffic_filtering=True,id=ddf386ac-899d-4106-88a9-ec3916a51b7c,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf386ac-89') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG os_vif [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f0:8d,bridge_name='br-int',has_traffic_filtering=True,id=ddf386ac-899d-4106-88a9-ec3916a51b7c,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf386ac-89') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddf386ac-89, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b49316c-0039-4eb5-991d-71322b47756f) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:50:31 user nova-compute[75356]: INFO os_vif [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f0:8d,bridge_name='br-int',has_traffic_filtering=True,id=ddf386ac-899d-4106-88a9-ec3916a51b7c,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf386ac-89')
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Start _get_guest_xml network_info=[{"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.objects.instance [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'numa_topology' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.objects.base [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Object Instance<7b0f5aad-e45c-4637-825c-cb295e98603a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:50:31 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:50:31 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.objects.instance [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.objects.base [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Object Instance<7b0f5aad-e45c-4637-825c-cb295e98603a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2030304790',display_name='tempest-AttachVolumeTestJSON-server-2030304790',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2030304790',id=46,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKJDjh0oQT6q6eYOe6FVZPoIq0B87siUqrQL2lCAPFszfSPQfbW6SrRyyUbxMDfAEyss1bZglpIevHc2gR0WGMrHpVbgzZpOeBJ4a3Y1yQFHxnZ6St4LQDIVjP1b8kKlA==',key_name='tempest-keypair-2102929947',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:42:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5a1b8a1f1c6f4c24bb1ca7faafb49226',ramdisk_id='',reservation_id='r-ptrcc6aq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1837009022',owner_user_name='tempest-AttachVolumeTestJSON-1837009022-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:48:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43ecf2b8c0f04d90a1ad6a780894fefc',uuid=7b0f5aad-e45c-4637-825c-cb295e98603a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converting VIF {"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f0:8d,bridge_name='br-int',has_traffic_filtering=True,id=ddf386ac-899d-4106-88a9-ec3916a51b7c,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf386ac-89') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.objects.instance [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.objects.base [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Object Instance<7b0f5aad-e45c-4637-825c-cb295e98603a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:50:31 user nova-compute[75356]:   <uuid>7b0f5aad-e45c-4637-825c-cb295e98603a</uuid>
Nov 29 20:50:31 user nova-compute[75356]:   <name>instance-0000002e</name>
Nov 29 20:50:31 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:50:31 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:50:31 user nova-compute[75356]:   <metadata>
Nov 29 20:50:31 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:50:31 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:50:31 user nova-compute[75356]:       <nova:name>tempest-AttachVolumeTestJSON-server-2030304790</nova:name>
Nov 29 20:50:31 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:50:31</nova:creationTime>
Nov 29 20:50:31 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:50:31 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:50:31 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:50:31 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:50:31 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:50:31 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:50:31 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:50:31 user nova-compute[75356]:       <nova:owner>
Nov 29 20:50:31 user nova-compute[75356]:         <nova:user uuid="43ecf2b8c0f04d90a1ad6a780894fefc">tempest-AttachVolumeTestJSON-1837009022-project-member</nova:user>
Nov 29 20:50:31 user nova-compute[75356]:         <nova:project uuid="5a1b8a1f1c6f4c24bb1ca7faafb49226">tempest-AttachVolumeTestJSON-1837009022</nova:project>
Nov 29 20:50:31 user nova-compute[75356]:       </nova:owner>
Nov 29 20:50:31 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:50:31 user nova-compute[75356]:       <nova:ports>
Nov 29 20:50:31 user nova-compute[75356]:         <nova:port uuid="ddf386ac-899d-4106-88a9-ec3916a51b7c">
Nov 29 20:50:31 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 20:50:31 user nova-compute[75356]:         </nova:port>
Nov 29 20:50:31 user nova-compute[75356]:       </nova:ports>
Nov 29 20:50:31 user nova-compute[75356]:     </nova:instance>
Nov 29 20:50:31 user nova-compute[75356]:   </metadata>
Nov 29 20:50:31 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:50:31 user nova-compute[75356]:     <system>
Nov 29 20:50:31 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:50:31 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:50:31 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:50:31 user nova-compute[75356]:       <entry name="serial">7b0f5aad-e45c-4637-825c-cb295e98603a</entry>
Nov 29 20:50:31 user nova-compute[75356]:       <entry name="uuid">7b0f5aad-e45c-4637-825c-cb295e98603a</entry>
Nov 29 20:50:31 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:50:31 user nova-compute[75356]:     </system>
Nov 29 20:50:31 user nova-compute[75356]:   </sysinfo>
Nov 29 20:50:31 user nova-compute[75356]:   <os>
Nov 29 20:50:31 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:50:31 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:50:31 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:50:31 user nova-compute[75356]:   </os>
Nov 29 20:50:31 user nova-compute[75356]:   <features>
Nov 29 20:50:31 user nova-compute[75356]:     <acpi/>
Nov 29 20:50:31 user nova-compute[75356]:     <apic/>
Nov 29 20:50:31 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:50:31 user nova-compute[75356]:   </features>
Nov 29 20:50:31 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:50:31 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:50:31 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:50:31 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:50:31 user nova-compute[75356]:   </clock>
Nov 29 20:50:31 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:50:31 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:50:31 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:50:31 user nova-compute[75356]:   </cpu>
Nov 29 20:50:31 user nova-compute[75356]:   <devices>
Nov 29 20:50:31 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:50:31 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:50:31 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk"/>
Nov 29 20:50:31 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:50:31 user nova-compute[75356]:     </disk>
Nov 29 20:50:31 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:50:31 user nova-compute[75356]:       <mac address="fa:16:3e:8b:f0:8d"/>
Nov 29 20:50:31 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:50:31 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:50:31 user nova-compute[75356]:       <target dev="tapddf386ac-89"/>
Nov 29 20:50:31 user nova-compute[75356]:     </interface>
Nov 29 20:50:31 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:50:31 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/console.log" append="off"/>
Nov 29 20:50:31 user nova-compute[75356]:     </serial>
Nov 29 20:50:31 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:50:31 user nova-compute[75356]:     <video>
Nov 29 20:50:31 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:50:31 user nova-compute[75356]:     </video>
Nov 29 20:50:31 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:50:31 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:50:31 user nova-compute[75356]:     </rng>
Nov 29 20:50:31 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:50:31 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:50:31 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:50:31 user nova-compute[75356]:     </memballoon>
Nov 29 20:50:31 user nova-compute[75356]:   </devices>
Nov 29 20:50:31 user nova-compute[75356]: </domain>
Nov 29 20:50:31 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.objects.instance [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG nova.objects.base [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Object Instance<7b0f5aad-e45c-4637-825c-cb295e98603a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:50:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.181s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Cannot resize image /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG nova.objects.instance [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'migration_context' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG nova.objects.base [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Object Instance<7b0f5aad-e45c-4637-825c-cb295e98603a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75356) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2030304790',display_name='tempest-AttachVolumeTestJSON-server-2030304790',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2030304790',id=46,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKJDjh0oQT6q6eYOe6FVZPoIq0B87siUqrQL2lCAPFszfSPQfbW6SrRyyUbxMDfAEyss1bZglpIevHc2gR0WGMrHpVbgzZpOeBJ4a3Y1yQFHxnZ6St4LQDIVjP1b8kKlA==',key_name='tempest-keypair-2102929947',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:42:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5a1b8a1f1c6f4c24bb1ca7faafb49226',ramdisk_id='',reservation_id='r-ptrcc6aq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1837009022',owner_user_name='tempest-AttachVolumeTestJSON-1837009022-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:48:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43ecf2b8c0f04d90a1ad6a780894fefc',uuid=7b0f5aad-e45c-4637-825c-cb295e98603a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converting VIF {"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f0:8d,bridge_name='br-int',has_traffic_filtering=True,id=ddf386ac-899d-4106-88a9-ec3916a51b7c,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf386ac-89') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG os_vif [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f0:8d,bridge_name='br-int',has_traffic_filtering=True,id=ddf386ac-899d-4106-88a9-ec3916a51b7c,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf386ac-89') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c3cd329-ea94-5b5b-8008-4a4199dd44a1', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddf386ac-89, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapddf386ac-89, col_values=(('qos', UUID('48810166-9991-4e19-b575-11f2f370970b')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapddf386ac-89, col_values=(('external_ids', {'iface-id': 'ddf386ac-899d-4106-88a9-ec3916a51b7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:f0:8d', 'vm-uuid': '7b0f5aad-e45c-4637-825c-cb295e98603a'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:50:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:32 user nova-compute[75356]: INFO os_vif [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f0:8d,bridge_name='br-int',has_traffic_filtering=True,id=ddf386ac-899d-4106-88a9-ec3916a51b7c,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf386ac-89')
Nov 29 20:50:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:33 user nova-compute[75356]: DEBUG nova.compute.manager [req-646ea838-4df4-4a14-8091-1c573999b54a req-f23804b5-7bc3-4f3c-9f4d-b010e51d8003 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received event network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:50:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-646ea838-4df4-4a14-8091-1c573999b54a req-f23804b5-7bc3-4f3c-9f4d-b010e51d8003 service nova] Acquiring lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:50:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-646ea838-4df4-4a14-8091-1c573999b54a req-f23804b5-7bc3-4f3c-9f4d-b010e51d8003 service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:50:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-646ea838-4df4-4a14-8091-1c573999b54a req-f23804b5-7bc3-4f3c-9f4d-b010e51d8003 service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:50:33 user nova-compute[75356]: DEBUG nova.compute.manager [req-646ea838-4df4-4a14-8091-1c573999b54a req-f23804b5-7bc3-4f3c-9f4d-b010e51d8003 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] No waiting events found dispatching network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:50:33 user nova-compute[75356]: WARNING nova.compute.manager [req-646ea838-4df4-4a14-8091-1c573999b54a req-f23804b5-7bc3-4f3c-9f4d-b010e51d8003 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received unexpected event network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c for instance with vm_state stopped and task_state powering-on.
Nov 29 20:50:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:35 user nova-compute[75356]: DEBUG nova.compute.manager [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:50:35 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Instance rebooted successfully.
Nov 29 20:50:35 user nova-compute[75356]: DEBUG nova.compute.manager [None req-edd303ed-e72a-4558-b5ee-37e41ebb84a7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:50:35 user nova-compute[75356]: DEBUG nova.compute.manager [req-0f25ae5d-ce13-424c-9f6a-97289de107c3 req-465059de-1f6f-416d-86a2-94eef57bcfa3 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received event network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:50:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0f25ae5d-ce13-424c-9f6a-97289de107c3 req-465059de-1f6f-416d-86a2-94eef57bcfa3 service nova] Acquiring lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:50:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0f25ae5d-ce13-424c-9f6a-97289de107c3 req-465059de-1f6f-416d-86a2-94eef57bcfa3 service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:50:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-0f25ae5d-ce13-424c-9f6a-97289de107c3 req-465059de-1f6f-416d-86a2-94eef57bcfa3 service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:50:35 user nova-compute[75356]: DEBUG nova.compute.manager [req-0f25ae5d-ce13-424c-9f6a-97289de107c3 req-465059de-1f6f-416d-86a2-94eef57bcfa3 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] No waiting events found dispatching network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:50:35 user nova-compute[75356]: WARNING nova.compute.manager [req-0f25ae5d-ce13-424c-9f6a-97289de107c3 req-465059de-1f6f-416d-86a2-94eef57bcfa3 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received unexpected event network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c for instance with vm_state stopped and task_state powering-on.
Nov 29 20:50:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:50:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:51:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:51:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:51:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:51:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:51:11 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:51:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:51:17 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:51:17 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:51:17 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 20:51:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:51:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:51:17 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:51:17 user nova-compute[75356]: DEBUG nova.objects.instance [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lazy-loading 'info_cache' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:51:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:51:17 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Updating instance_info_cache with network_info: [{"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:51:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:51:17 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:51:22 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:51:22 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:51:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:51:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:51:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:51:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:51:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:51:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:51:24 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:51:24 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:51:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:51:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:51:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:51:24 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:51:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:51:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:51:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:51:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:51:25 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:51:25 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:51:25 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=9080MB free_disk=25.09168243408203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:51:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:51:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:51:25 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 7b0f5aad-e45c-4637-825c-cb295e98603a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:51:25 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:51:25 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:51:25 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:51:25 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:51:25 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:51:25 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:51:26 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:51:26 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:51:27 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:51:27 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:51:28 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:51:32 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:51:33 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:51:37 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:51:42 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:51:47 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:51:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:51:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:51:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:51:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:51:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:51:52 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:51:57 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:52:02 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:52:07 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:52:12 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:52:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:52:17 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:52:18 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:52:18 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:52:18 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 20:52:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:52:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:52:18 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:52:18 user nova-compute[75356]: DEBUG nova.objects.instance [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lazy-loading 'info_cache' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:52:19 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Updating instance_info_cache with network_info: [{"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:52:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-7b0f5aad-e45c-4637-825c-cb295e98603a" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:52:19 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:52:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "7b0f5aad-e45c-4637-825c-cb295e98603a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:52:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:52:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:52:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:52:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:52:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:52:22 user nova-compute[75356]: INFO nova.compute.manager [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Terminating instance
Nov 29 20:52:22 user nova-compute[75356]: DEBUG nova.compute.manager [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:52:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:52:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:52:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:52:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:52:22 user nova-compute[75356]: DEBUG nova.compute.manager [req-06991a86-873b-48a2-9dd2-497441cf138b req-5e72bbda-a820-49ae-9c3f-e2e975415c33 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received event network-vif-unplugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:52:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-06991a86-873b-48a2-9dd2-497441cf138b req-5e72bbda-a820-49ae-9c3f-e2e975415c33 service nova] Acquiring lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:52:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-06991a86-873b-48a2-9dd2-497441cf138b req-5e72bbda-a820-49ae-9c3f-e2e975415c33 service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:52:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-06991a86-873b-48a2-9dd2-497441cf138b req-5e72bbda-a820-49ae-9c3f-e2e975415c33 service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:52:22 user nova-compute[75356]: DEBUG nova.compute.manager [req-06991a86-873b-48a2-9dd2-497441cf138b req-5e72bbda-a820-49ae-9c3f-e2e975415c33 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] No waiting events found dispatching network-vif-unplugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:52:22 user nova-compute[75356]: DEBUG nova.compute.manager [req-06991a86-873b-48a2-9dd2-497441cf138b req-5e72bbda-a820-49ae-9c3f-e2e975415c33 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received event network-vif-unplugged-ddf386ac-899d-4106-88a9-ec3916a51b7c for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:52:22 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:52:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:52:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:52:23 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Instance destroyed successfully.
Nov 29 20:52:23 user nova-compute[75356]: DEBUG nova.objects.instance [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'resources' on Instance uuid 7b0f5aad-e45c-4637-825c-cb295e98603a {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:52:23 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:42:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2030304790',display_name='tempest-AttachVolumeTestJSON-server-2030304790',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2030304790',id=46,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKJDjh0oQT6q6eYOe6FVZPoIq0B87siUqrQL2lCAPFszfSPQfbW6SrRyyUbxMDfAEyss1bZglpIevHc2gR0WGMrHpVbgzZpOeBJ4a3Y1yQFHxnZ6St4LQDIVjP1b8kKlA==',key_name='tempest-keypair-2102929947',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:42:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a1b8a1f1c6f4c24bb1ca7faafb49226',ramdisk_id='',reservation_id='r-ptrcc6aq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1837009022',owner_user_name='tempest-AttachVolumeTestJSON-1837009022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43ecf2b8c0f04d90a1ad6a780894fefc',uuid=7b0f5aad-e45c-4637-825c-cb295e98603a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:52:23 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converting VIF {"id": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "address": "fa:16:3e:8b:f0:8d", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddf386ac-89", "ovs_interfaceid": "ddf386ac-899d-4106-88a9-ec3916a51b7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:52:23 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:f0:8d,bridge_name='br-int',has_traffic_filtering=True,id=ddf386ac-899d-4106-88a9-ec3916a51b7c,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf386ac-89') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:52:23 user nova-compute[75356]: DEBUG os_vif [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:f0:8d,bridge_name='br-int',has_traffic_filtering=True,id=ddf386ac-899d-4106-88a9-ec3916a51b7c,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf386ac-89') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:52:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:52:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddf386ac-89, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:52:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:52:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:52:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48810166-9991-4e19-b575-11f2f370970b) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:52:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:52:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:52:23 user nova-compute[75356]: INFO os_vif [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:f0:8d,bridge_name='br-int',has_traffic_filtering=True,id=ddf386ac-899d-4106-88a9-ec3916a51b7c,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddf386ac-89')
Nov 29 20:52:23 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Deleting instance files /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a_del
Nov 29 20:52:23 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Deletion of /opt/stack/data/nova/instances/7b0f5aad-e45c-4637-825c-cb295e98603a_del complete
Nov 29 20:52:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:52:23 user nova-compute[75356]: INFO nova.compute.manager [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 20:52:23 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:52:23 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:52:23 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:52:23 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:52:23 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Took 0.67 seconds to deallocate network for instance.
Nov 29 20:52:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:52:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:52:24 user nova-compute[75356]: DEBUG nova.compute.manager [req-2d5d8f4f-a4aa-4dd3-b423-fbc126d3d23a req-e429701b-f221-4d87-9e59-2610cd1c1c02 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received event network-vif-deleted-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:52:24 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:52:24 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:52:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:52:24 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Deleted allocations for instance 7b0f5aad-e45c-4637-825c-cb295e98603a
Nov 29 20:52:24 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:52:24 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:52:24 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:52:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-3c6b1c30-39d4-4ce4-b66d-e97bc7db4e89 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.878s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:52:24 user nova-compute[75356]: DEBUG nova.compute.manager [req-c1458ced-6990-4d40-a808-b4a87fb635ec req-27838b95-15eb-4b0e-89e3-59a0a5c0d582 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received event network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:52:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c1458ced-6990-4d40-a808-b4a87fb635ec req-27838b95-15eb-4b0e-89e3-59a0a5c0d582 service nova] Acquiring lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:52:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c1458ced-6990-4d40-a808-b4a87fb635ec req-27838b95-15eb-4b0e-89e3-59a0a5c0d582 service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:52:24 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-c1458ced-6990-4d40-a808-b4a87fb635ec req-27838b95-15eb-4b0e-89e3-59a0a5c0d582 service nova] Lock "7b0f5aad-e45c-4637-825c-cb295e98603a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:52:24 user nova-compute[75356]: DEBUG nova.compute.manager [req-c1458ced-6990-4d40-a808-b4a87fb635ec req-27838b95-15eb-4b0e-89e3-59a0a5c0d582 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] No waiting events found dispatching network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:52:24 user nova-compute[75356]: WARNING nova.compute.manager [req-c1458ced-6990-4d40-a808-b4a87fb635ec req-27838b95-15eb-4b0e-89e3-59a0a5c0d582 service nova] [instance: 7b0f5aad-e45c-4637-825c-cb295e98603a] Received unexpected event network-vif-plugged-ddf386ac-899d-4106-88a9-ec3916a51b7c for instance with vm_state deleted and task_state None.
Nov 29 20:52:25 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:52:26 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:52:26 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:52:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:52:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:52:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:52:26 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:52:26 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:52:26 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:52:26 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=9207MB free_disk=25.119182586669922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:52:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:52:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:52:26 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:52:26 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:52:26 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:52:26 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:52:26 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:52:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:52:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:52:29 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:52:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:52:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:52:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:52:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:52:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:52:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:52:35 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:52:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:52:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:52:46 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:52:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:52:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:52:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:52:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:52:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:52:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:52:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.imagecache [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Verify base images {{(pid=75356) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 29 20:52:46 user nova-compute[75356]: WARNING nova.virt.libvirt.imagecache [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1b00baf7ca2f005ad497c2280811ac15efef87f7
Nov 29 20:52:46 user nova-compute[75356]: WARNING nova.virt.libvirt.imagecache [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2a2834f55fdcae3559c708e72fc6a4141faf8438
Nov 29 20:52:46 user nova-compute[75356]: WARNING nova.virt.libvirt.imagecache [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77
Nov 29 20:52:46 user nova-compute[75356]: WARNING nova.virt.libvirt.imagecache [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9e26944ebafb7dbc83a3e23417e1c8827981807f
Nov 29 20:52:46 user nova-compute[75356]: WARNING nova.virt.libvirt.imagecache [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b2d3c24e4b16198ce6fa6670c8c7c07cd2d4c9c5
Nov 29 20:52:46 user nova-compute[75356]: WARNING nova.virt.libvirt.imagecache [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Unknown base file: /opt/stack/data/nova/instances/_base/23e57a017c2f08320a144940a07993702711c3d9
Nov 29 20:52:46 user nova-compute[75356]: WARNING nova.virt.libvirt.imagecache [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7
Nov 29 20:52:46 user nova-compute[75356]: WARNING nova.virt.libvirt.imagecache [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Unknown base file: /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9
Nov 29 20:52:46 user nova-compute[75356]: INFO nova.virt.libvirt.imagecache [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Removable base files: /opt/stack/data/nova/instances/_base/1b00baf7ca2f005ad497c2280811ac15efef87f7 /opt/stack/data/nova/instances/_base/2a2834f55fdcae3559c708e72fc6a4141faf8438 /opt/stack/data/nova/instances/_base/8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77 /opt/stack/data/nova/instances/_base/9e26944ebafb7dbc83a3e23417e1c8827981807f /opt/stack/data/nova/instances/_base/b2d3c24e4b16198ce6fa6670c8c7c07cd2d4c9c5 /opt/stack/data/nova/instances/_base/23e57a017c2f08320a144940a07993702711c3d9 /opt/stack/data/nova/instances/_base/1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7 /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9
Nov 29 20:52:46 user nova-compute[75356]: INFO nova.virt.libvirt.imagecache [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1b00baf7ca2f005ad497c2280811ac15efef87f7
Nov 29 20:52:46 user nova-compute[75356]: INFO nova.virt.libvirt.imagecache [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2a2834f55fdcae3559c708e72fc6a4141faf8438
Nov 29 20:52:46 user nova-compute[75356]: INFO nova.virt.libvirt.imagecache [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8f8e0ebaba5dea6d3f24619b2d9d90b033f0ca77
Nov 29 20:52:46 user nova-compute[75356]: INFO nova.virt.libvirt.imagecache [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9e26944ebafb7dbc83a3e23417e1c8827981807f
Nov 29 20:52:46 user nova-compute[75356]: INFO nova.virt.libvirt.imagecache [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b2d3c24e4b16198ce6fa6670c8c7c07cd2d4c9c5
Nov 29 20:52:46 user nova-compute[75356]: INFO nova.virt.libvirt.imagecache [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/23e57a017c2f08320a144940a07993702711c3d9
Nov 29 20:52:46 user nova-compute[75356]: INFO nova.virt.libvirt.imagecache [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1601523d7da5e925b7b8af1a7b7294fe0f1ba6a7
Nov 29 20:52:46 user nova-compute[75356]: INFO nova.virt.libvirt.imagecache [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9
Nov 29 20:52:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.imagecache [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Verification complete {{(pid=75356) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 29 20:52:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.imagecache [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Verify swap images {{(pid=75356) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 29 20:52:46 user nova-compute[75356]: DEBUG nova.virt.libvirt.imagecache [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Verify ephemeral images {{(pid=75356) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 29 20:52:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:52:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:52:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:52:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:52:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:52:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:52:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:52:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:53:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:53:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:53:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:53:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:53:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:53:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:53:16 user nova-compute[75356]: DEBUG nova.compute.manager [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:53:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:53:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:53:16 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:53:16 user nova-compute[75356]: INFO nova.compute.claims [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Claim successful on node user
Nov 29 20:53:16 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:53:16 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:53:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.192s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:53:16 user nova-compute[75356]: DEBUG nova.compute.manager [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:53:16 user nova-compute[75356]: DEBUG nova.compute.manager [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:53:16 user nova-compute[75356]: DEBUG nova.network.neutron [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:53:16 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:53:16 user nova-compute[75356]: DEBUG nova.compute.manager [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:53:16 user nova-compute[75356]: DEBUG nova.policy [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43ecf2b8c0f04d90a1ad6a780894fefc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b8a1f1c6f4c24bb1ca7faafb49226', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:53:16 user nova-compute[75356]: DEBUG nova.compute.manager [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:53:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:53:16 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Creating image(s)
Nov 29 20:53:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:53:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "/opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:53:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "/opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:53:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:53:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.169s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:53:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:53:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:53:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:53:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.184s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:53:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:53:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/disk 1073741824" returned: 0 in 0.053s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:53:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:53:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:53:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.183s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:53:17 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:53:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:53:17 user nova-compute[75356]: DEBUG nova.network.neutron [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Successfully created port: 6b2745f1-616a-4e8d-a8fb-ef69c79a07c4 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:53:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:53:17 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Cannot resize image /opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:53:17 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:53:17 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Ensure instance console log exists: /opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:53:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:53:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:53:17 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.network.neutron [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Successfully updated port: 6b2745f1-616a-4e8d-a8fb-ef69c79a07c4 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "refresh_cache-d5dc21a8-9710-40fc-95b0-bf66b4908f86" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquired lock "refresh_cache-d5dc21a8-9710-40fc-95b0-bf66b4908f86" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.network.neutron [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-3b1058a2-64a6-44c0-8278-9a6b90751d19 req-7cde2fd1-d113-4cd0-9284-0f2ee3a28707 service nova] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Received event network-changed-6b2745f1-616a-4e8d-a8fb-ef69c79a07c4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-3b1058a2-64a6-44c0-8278-9a6b90751d19 req-7cde2fd1-d113-4cd0-9284-0f2ee3a28707 service nova] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Refreshing instance network info cache due to event network-changed-6b2745f1-616a-4e8d-a8fb-ef69c79a07c4. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3b1058a2-64a6-44c0-8278-9a6b90751d19 req-7cde2fd1-d113-4cd0-9284-0f2ee3a28707 service nova] Acquiring lock "refresh_cache-d5dc21a8-9710-40fc-95b0-bf66b4908f86" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.network.neutron [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.network.neutron [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Updating instance_info_cache with network_info: [{"id": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "address": "fa:16:3e:3b:f6:fd", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b2745f1-61", "ovs_interfaceid": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Releasing lock "refresh_cache-d5dc21a8-9710-40fc-95b0-bf66b4908f86" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.compute.manager [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Instance network_info: |[{"id": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "address": "fa:16:3e:3b:f6:fd", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b2745f1-61", "ovs_interfaceid": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3b1058a2-64a6-44c0-8278-9a6b90751d19 req-7cde2fd1-d113-4cd0-9284-0f2ee3a28707 service nova] Acquired lock "refresh_cache-d5dc21a8-9710-40fc-95b0-bf66b4908f86" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.network.neutron [req-3b1058a2-64a6-44c0-8278-9a6b90751d19 req-7cde2fd1-d113-4cd0-9284-0f2ee3a28707 service nova] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Refreshing network info cache for port 6b2745f1-616a-4e8d-a8fb-ef69c79a07c4 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Start _get_guest_xml network_info=[{"id": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "address": "fa:16:3e:3b:f6:fd", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b2745f1-61", "ovs_interfaceid": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:53:18 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:53:18 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-678544185',display_name='tempest-AttachVolumeTestJSON-server-678544185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-678544185',id=50,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJs5BK2siZ8ByQY4Bd41yYDOvafxfkyz8Y4wDAej6mv+Oe4UZbiTuQiZfaa2zNu4or3qEAjvDQBIYQ6clgDbNVrPgNXexkbvmyT23dz9NeS5BICtDk05sFvu0sFwGRQ8g==',key_name='tempest-keypair-1757323624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a1b8a1f1c6f4c24bb1ca7faafb49226',ramdisk_id='',reservation_id='r-04zgnz1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1837009022',owner_user_name='tempest-AttachVolumeTestJSON-1837009022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:53:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43ecf2b8c0f04d90a1ad6a780894fefc',uuid=d5dc21a8-9710-40fc-95b0-bf66b4908f86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "address": "fa:16:3e:3b:f6:fd", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b2745f1-61", "ovs_interfaceid": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converting VIF {"id": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "address": "fa:16:3e:3b:f6:fd", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b2745f1-61", "ovs_interfaceid": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f6:fd,bridge_name='br-int',has_traffic_filtering=True,id=6b2745f1-616a-4e8d-a8fb-ef69c79a07c4,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b2745f1-61') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.objects.instance [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'pci_devices' on Instance uuid d5dc21a8-9710-40fc-95b0-bf66b4908f86 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:53:18 user nova-compute[75356]:   <uuid>d5dc21a8-9710-40fc-95b0-bf66b4908f86</uuid>
Nov 29 20:53:18 user nova-compute[75356]:   <name>instance-00000032</name>
Nov 29 20:53:18 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:53:18 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:53:18 user nova-compute[75356]:   <metadata>
Nov 29 20:53:18 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:53:18 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:53:18 user nova-compute[75356]:       <nova:name>tempest-AttachVolumeTestJSON-server-678544185</nova:name>
Nov 29 20:53:18 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:53:18</nova:creationTime>
Nov 29 20:53:18 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:53:18 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:53:18 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:53:18 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:53:18 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:53:18 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:53:18 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:53:18 user nova-compute[75356]:       <nova:owner>
Nov 29 20:53:18 user nova-compute[75356]:         <nova:user uuid="43ecf2b8c0f04d90a1ad6a780894fefc">tempest-AttachVolumeTestJSON-1837009022-project-member</nova:user>
Nov 29 20:53:18 user nova-compute[75356]:         <nova:project uuid="5a1b8a1f1c6f4c24bb1ca7faafb49226">tempest-AttachVolumeTestJSON-1837009022</nova:project>
Nov 29 20:53:18 user nova-compute[75356]:       </nova:owner>
Nov 29 20:53:18 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:53:18 user nova-compute[75356]:       <nova:ports>
Nov 29 20:53:18 user nova-compute[75356]:         <nova:port uuid="6b2745f1-616a-4e8d-a8fb-ef69c79a07c4">
Nov 29 20:53:18 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 20:53:18 user nova-compute[75356]:         </nova:port>
Nov 29 20:53:18 user nova-compute[75356]:       </nova:ports>
Nov 29 20:53:18 user nova-compute[75356]:     </nova:instance>
Nov 29 20:53:18 user nova-compute[75356]:   </metadata>
Nov 29 20:53:18 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:53:18 user nova-compute[75356]:     <system>
Nov 29 20:53:18 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:53:18 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:53:18 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:53:18 user nova-compute[75356]:       <entry name="serial">d5dc21a8-9710-40fc-95b0-bf66b4908f86</entry>
Nov 29 20:53:18 user nova-compute[75356]:       <entry name="uuid">d5dc21a8-9710-40fc-95b0-bf66b4908f86</entry>
Nov 29 20:53:18 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:53:18 user nova-compute[75356]:     </system>
Nov 29 20:53:18 user nova-compute[75356]:   </sysinfo>
Nov 29 20:53:18 user nova-compute[75356]:   <os>
Nov 29 20:53:18 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:53:18 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:53:18 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:53:18 user nova-compute[75356]:   </os>
Nov 29 20:53:18 user nova-compute[75356]:   <features>
Nov 29 20:53:18 user nova-compute[75356]:     <acpi/>
Nov 29 20:53:18 user nova-compute[75356]:     <apic/>
Nov 29 20:53:18 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:53:18 user nova-compute[75356]:   </features>
Nov 29 20:53:18 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:53:18 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:53:18 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:53:18 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:53:18 user nova-compute[75356]:   </clock>
Nov 29 20:53:18 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:53:18 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:53:18 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:53:18 user nova-compute[75356]:   </cpu>
Nov 29 20:53:18 user nova-compute[75356]:   <devices>
Nov 29 20:53:18 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:53:18 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:53:18 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/disk"/>
Nov 29 20:53:18 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:53:18 user nova-compute[75356]:     </disk>
Nov 29 20:53:18 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:53:18 user nova-compute[75356]:       <mac address="fa:16:3e:3b:f6:fd"/>
Nov 29 20:53:18 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:53:18 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:53:18 user nova-compute[75356]:       <target dev="tap6b2745f1-61"/>
Nov 29 20:53:18 user nova-compute[75356]:     </interface>
Nov 29 20:53:18 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:53:18 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/console.log" append="off"/>
Nov 29 20:53:18 user nova-compute[75356]:     </serial>
Nov 29 20:53:18 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:53:18 user nova-compute[75356]:     <video>
Nov 29 20:53:18 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:53:18 user nova-compute[75356]:     </video>
Nov 29 20:53:18 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:53:18 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:53:18 user nova-compute[75356]:     </rng>
Nov 29 20:53:18 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:53:18 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:53:18 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:53:18 user nova-compute[75356]:     </memballoon>
Nov 29 20:53:18 user nova-compute[75356]:   </devices>
Nov 29 20:53:18 user nova-compute[75356]: </domain>
Nov 29 20:53:18 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-678544185',display_name='tempest-AttachVolumeTestJSON-server-678544185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-678544185',id=50,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJs5BK2siZ8ByQY4Bd41yYDOvafxfkyz8Y4wDAej6mv+Oe4UZbiTuQiZfaa2zNu4or3qEAjvDQBIYQ6clgDbNVrPgNXexkbvmyT23dz9NeS5BICtDk05sFvu0sFwGRQ8g==',key_name='tempest-keypair-1757323624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a1b8a1f1c6f4c24bb1ca7faafb49226',ramdisk_id='',reservation_id='r-04zgnz1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1837009022',owner_user_name='tempest-AttachVolumeTestJSON-1837009022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:53:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43ecf2b8c0f04d90a1ad6a780894fefc',uuid=d5dc21a8-9710-40fc-95b0-bf66b4908f86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "address": "fa:16:3e:3b:f6:fd", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b2745f1-61", "ovs_interfaceid": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converting VIF {"id": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "address": "fa:16:3e:3b:f6:fd", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b2745f1-61", "ovs_interfaceid": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f6:fd,bridge_name='br-int',has_traffic_filtering=True,id=6b2745f1-616a-4e8d-a8fb-ef69c79a07c4,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b2745f1-61') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG os_vif [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f6:fd,bridge_name='br-int',has_traffic_filtering=True,id=6b2745f1-616a-4e8d-a8fb-ef69c79a07c4,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b2745f1-61') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3094657-6a07-59bc-b301-90632af2454e', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b2745f1-61, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b2745f1-61, col_values=(('qos', UUID('8b024308-441a-435b-9536-381c15758824')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b2745f1-61, col_values=(('external_ids', {'iface-id': '6b2745f1-616a-4e8d-a8fb-ef69c79a07c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:f6:fd', 'vm-uuid': 'd5dc21a8-9710-40fc-95b0-bf66b4908f86'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:18 user nova-compute[75356]: INFO os_vif [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f6:fd,bridge_name='br-int',has_traffic_filtering=True,id=6b2745f1-616a-4e8d-a8fb-ef69c79a07c4,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b2745f1-61')
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] No VIF found with MAC fa:16:3e:3b:f6:fd, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.network.neutron [req-3b1058a2-64a6-44c0-8278-9a6b90751d19 req-7cde2fd1-d113-4cd0-9284-0f2ee3a28707 service nova] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Updated VIF entry in instance network info cache for port 6b2745f1-616a-4e8d-a8fb-ef69c79a07c4. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG nova.network.neutron [req-3b1058a2-64a6-44c0-8278-9a6b90751d19 req-7cde2fd1-d113-4cd0-9284-0f2ee3a28707 service nova] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Updating instance_info_cache with network_info: [{"id": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "address": "fa:16:3e:3b:f6:fd", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b2745f1-61", "ovs_interfaceid": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:53:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-3b1058a2-64a6-44c0-8278-9a6b90751d19 req-7cde2fd1-d113-4cd0-9284-0f2ee3a28707 service nova] Releasing lock "refresh_cache-d5dc21a8-9710-40fc-95b0-bf66b4908f86" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:53:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:20 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:53:20 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:53:20 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 20:53:20 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Skipping network cache update for instance because it is Building. {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 20:53:20 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Didn't find any instances for network info cache update. {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 20:53:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-d74c3051-a913-49d2-bd00-65f6d646a7d6 req-d32b96e2-445a-42fb-a9e4-e22f6285fc2c service nova] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Received event network-vif-plugged-6b2745f1-616a-4e8d-a8fb-ef69c79a07c4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:53:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d74c3051-a913-49d2-bd00-65f6d646a7d6 req-d32b96e2-445a-42fb-a9e4-e22f6285fc2c service nova] Acquiring lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:53:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d74c3051-a913-49d2-bd00-65f6d646a7d6 req-d32b96e2-445a-42fb-a9e4-e22f6285fc2c service nova] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:53:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d74c3051-a913-49d2-bd00-65f6d646a7d6 req-d32b96e2-445a-42fb-a9e4-e22f6285fc2c service nova] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:53:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-d74c3051-a913-49d2-bd00-65f6d646a7d6 req-d32b96e2-445a-42fb-a9e4-e22f6285fc2c service nova] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] No waiting events found dispatching network-vif-plugged-6b2745f1-616a-4e8d-a8fb-ef69c79a07c4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:53:20 user nova-compute[75356]: WARNING nova.compute.manager [req-d74c3051-a913-49d2-bd00-65f6d646a7d6 req-d32b96e2-445a-42fb-a9e4-e22f6285fc2c service nova] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Received unexpected event network-vif-plugged-6b2745f1-616a-4e8d-a8fb-ef69c79a07c4 for instance with vm_state building and task_state spawning.
Nov 29 20:53:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:22 user nova-compute[75356]: DEBUG nova.compute.manager [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:53:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:53:22 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Instance spawned successfully.
Nov 29 20:53:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:53:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:53:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:53:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:53:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:53:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:53:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:53:22 user nova-compute[75356]: INFO nova.compute.manager [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 29 20:53:22 user nova-compute[75356]: DEBUG nova.compute.manager [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:53:22 user nova-compute[75356]: INFO nova.compute.manager [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Took 5.73 seconds to build instance.
Nov 29 20:53:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-780fd894-ae1b-4c13-9ce7-766b100d4de7 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.833s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:53:22 user nova-compute[75356]: DEBUG nova.compute.manager [req-6a40bc41-ef78-4e74-8e8a-88fa72491e2d req-e6856e06-666c-4391-b757-be693867fa9c service nova] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Received event network-vif-plugged-6b2745f1-616a-4e8d-a8fb-ef69c79a07c4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:53:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6a40bc41-ef78-4e74-8e8a-88fa72491e2d req-e6856e06-666c-4391-b757-be693867fa9c service nova] Acquiring lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:53:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6a40bc41-ef78-4e74-8e8a-88fa72491e2d req-e6856e06-666c-4391-b757-be693867fa9c service nova] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:53:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-6a40bc41-ef78-4e74-8e8a-88fa72491e2d req-e6856e06-666c-4391-b757-be693867fa9c service nova] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:53:22 user nova-compute[75356]: DEBUG nova.compute.manager [req-6a40bc41-ef78-4e74-8e8a-88fa72491e2d req-e6856e06-666c-4391-b757-be693867fa9c service nova] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] No waiting events found dispatching network-vif-plugged-6b2745f1-616a-4e8d-a8fb-ef69c79a07c4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:53:22 user nova-compute[75356]: WARNING nova.compute.manager [req-6a40bc41-ef78-4e74-8e8a-88fa72491e2d req-e6856e06-666c-4391-b757-be693867fa9c service nova] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Received unexpected event network-vif-plugged-6b2745f1-616a-4e8d-a8fb-ef69c79a07c4 for instance with vm_state active and task_state None.
Nov 29 20:53:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:24 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:53:25 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:53:25 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:53:27 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:53:27 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:53:27 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:53:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:53:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:53:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:53:27 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:53:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:53:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:53:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:53:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:53:28 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:53:28 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:53:28 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=9154MB free_disk=25.11722183227539GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:53:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:53:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:53:28 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance d5dc21a8-9710-40fc-95b0-bf66b4908f86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:53:28 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:53:28 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:53:28 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing inventories for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 20:53:28 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Updating ProviderTree inventory for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 20:53:28 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Updating inventory in ProviderTree for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 20:53:28 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing aggregate associations for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a, aggregates: None {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 20:53:28 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing trait associations for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 20:53:28 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:53:28 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:53:28 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:53:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.359s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:53:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:53:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:53:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:53:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:53:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:30 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:53:31 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:53:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:36 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:53:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:40 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:53:40 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75356) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 20:53:42 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:53:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:47 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:53:47 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Cleaning up deleted instances {{(pid=75356) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 20:53:47 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] There are 0 instances to clean {{(pid=75356) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 20:53:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:53:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:54:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:54:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:54:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:54:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:54:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:54:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:54:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:54:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:54:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:54:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:54:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:54:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:54:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:54:15 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:54:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:54:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:54:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:54:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:54:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:54:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:54:22 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:54:22 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:54:22 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 20:54:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-d5dc21a8-9710-40fc-95b0-bf66b4908f86" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:54:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-d5dc21a8-9710-40fc-95b0-bf66b4908f86" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:54:22 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:54:22 user nova-compute[75356]: DEBUG nova.objects.instance [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lazy-loading 'info_cache' on Instance uuid d5dc21a8-9710-40fc-95b0-bf66b4908f86 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:54:22 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Updating instance_info_cache with network_info: [{"id": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "address": "fa:16:3e:3b:f6:fd", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b2745f1-61", "ovs_interfaceid": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:54:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-d5dc21a8-9710-40fc-95b0-bf66b4908f86" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:54:22 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:54:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:54:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:54:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:54:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:54:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:54:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:54:25 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:54:26 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:54:26 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:54:27 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:54:27 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:54:27 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:54:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:54:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:54:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:54:27 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:54:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:54:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:54:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:54:27 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:54:28 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:54:28 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:54:28 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=9100MB free_disk=25.088855743408203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:54:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:54:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:54:28 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance d5dc21a8-9710-40fc-95b0-bf66b4908f86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:54:28 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:54:28 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:54:28 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:54:28 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:54:28 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:54:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:54:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:54:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:54:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:54:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:54:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:54:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:54:30 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:54:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:54:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:54:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:54:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:54:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:54:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:54:38 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:54:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:54:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:54:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:54:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:54:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:54:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:54:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:54:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:54:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:54:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:54:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:54:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:54:46 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:54:46 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid d5dc21a8-9710-40fc-95b0-bf66b4908f86 {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 20:54:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:54:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:54:46 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:54:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:54:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:54:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:54:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:54:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:54:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:54:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:54:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:54:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:54:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:54:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:54:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:54:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:55:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:55:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-fedd01ff-ae20-4d59-876f-a378d25633a6 req-c4895c7f-0a2a-4582-b84f-1b10ca9cafa5 service nova] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Received event network-changed-6b2745f1-616a-4e8d-a8fb-ef69c79a07c4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:55:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-fedd01ff-ae20-4d59-876f-a378d25633a6 req-c4895c7f-0a2a-4582-b84f-1b10ca9cafa5 service nova] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Refreshing instance network info cache due to event network-changed-6b2745f1-616a-4e8d-a8fb-ef69c79a07c4. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:55:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-fedd01ff-ae20-4d59-876f-a378d25633a6 req-c4895c7f-0a2a-4582-b84f-1b10ca9cafa5 service nova] Acquiring lock "refresh_cache-d5dc21a8-9710-40fc-95b0-bf66b4908f86" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:55:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-fedd01ff-ae20-4d59-876f-a378d25633a6 req-c4895c7f-0a2a-4582-b84f-1b10ca9cafa5 service nova] Acquired lock "refresh_cache-d5dc21a8-9710-40fc-95b0-bf66b4908f86" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:55:07 user nova-compute[75356]: DEBUG nova.network.neutron [req-fedd01ff-ae20-4d59-876f-a378d25633a6 req-c4895c7f-0a2a-4582-b84f-1b10ca9cafa5 service nova] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Refreshing network info cache for port 6b2745f1-616a-4e8d-a8fb-ef69c79a07c4 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:55:07 user nova-compute[75356]: DEBUG nova.network.neutron [req-fedd01ff-ae20-4d59-876f-a378d25633a6 req-c4895c7f-0a2a-4582-b84f-1b10ca9cafa5 service nova] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Updated VIF entry in instance network info cache for port 6b2745f1-616a-4e8d-a8fb-ef69c79a07c4. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:55:07 user nova-compute[75356]: DEBUG nova.network.neutron [req-fedd01ff-ae20-4d59-876f-a378d25633a6 req-c4895c7f-0a2a-4582-b84f-1b10ca9cafa5 service nova] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Updating instance_info_cache with network_info: [{"id": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "address": "fa:16:3e:3b:f6:fd", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b2745f1-61", "ovs_interfaceid": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:55:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-fedd01ff-ae20-4d59-876f-a378d25633a6 req-c4895c7f-0a2a-4582-b84f-1b10ca9cafa5 service nova] Releasing lock "refresh_cache-d5dc21a8-9710-40fc-95b0-bf66b4908f86" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:55:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:55:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG nova.objects.instance [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'flavor' on Instance uuid d5dc21a8-9710-40fc-95b0-bf66b4908f86 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:55:10 user nova-compute[75356]: INFO nova.compute.manager [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Attaching volume 14380836-bfca-4957-8aab-9193dc0f9772 to /dev/vdb
Nov 29 20:55:10 user nova-compute[75356]: DEBUG os_brick.utils [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebeaa4c-fc01-48e4-a63a-06368ed2dfb3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd069bf9-eb50-44b0-a60b-b25e303a3fe4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.073s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac9a3ef-6c9d-44f9-848a-d4353c30b1fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b1c9b6-337b-43b7-b302-7578001f5516]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:55:10 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:55:10 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d882ffba-1cc8-49c8-a095-a656dc02fa1e]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG os_brick.utils [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:55:10 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Updating existing volume attachment record: 0894c445-2348-48b1-a48f-5efda2a9262f {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:55:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:55:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:55:15 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEVBZrCp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:55:17 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:55:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:55:17 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:55:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:55:17 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:55:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d36c5e-8ea9-4afe-9004-d403765d78fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:55:17 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a93be67-14da-466c-8966-67b5f3aabd37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772] added
Nov 29 20:55:17 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af71249-5f54-41bc-8c25-1de4464c3e87]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b5d6d2-31bd-4ba7-90fe-d266a73e6bfe]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gEVBZrCp {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gEVBZrCp" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1735c2dc-f3d5-4ec4-9e56-df97a79c65ec]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gEVBZrCp'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8522c4-0811-4042-ad39-4873f0c9d221]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca005aa-a3ab-4d4b-a9c6-ba5ccffebf9d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 20:55:17 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:55:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 20:55:17 user nova-compute[75356]:  {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:55:17 user nova-compute[75356]: WARNING os_brick.initiator.connectors.iscsi [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 20:55:17 user nova-compute[75356]: 
Nov 29 20:55:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:55:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:55:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 -p 172.16.0.220:3260 --login" returned: 0 in 1.043s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6406daa0-60bb-4aac-b480-a01a07cce495]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772, portal: 172.16.0.220,3260]
Nov 29 20:55:18 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772, portal: 172.16.0.220,3260] successful.
Nov 29 20:55:18 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:55:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a07a12f-6052-4ee7-9280-3f5852f077cf]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:55:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[422eb253-f0c3-4ce0-8868-b2f875390820]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 (non-flash)
Nov 29 20:55:19 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:55:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 (non-flash)
Nov 29 20:55:19 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:55:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.250s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:55:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:55:19 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:55:19 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:55:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:19 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[203d4e41-eeeb-405a-9e09-8c89f4d3c285]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:19 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:55:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEVBZrCp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:55:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.277s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:55:20 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] <== connect_volume: return (2279ms) {'type': 'block', 'scsi_wwn': '23764653837613162', 'path': '/dev/sdb'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:55:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764653837613162', 'path': '/dev/sdb'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:55:20 user nova-compute[75356]: DEBUG nova.objects.instance [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'flavor' on Instance uuid d5dc21a8-9710-40fc-95b0-bf66b4908f86 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:55:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:55:20 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:55:20 user nova-compute[75356]:   <source dev="/dev/sdb"/>
Nov 29 20:55:20 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:55:20 user nova-compute[75356]:   <serial>14380836-bfca-4957-8aab-9193dc0f9772</serial>
Nov 29 20:55:20 user nova-compute[75356]: </disk>
Nov 29 20:55:20 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:55:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:55:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:55:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] No VIF found with MAC fa:16:3e:3b:f6:fd, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:55:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-432fb284-7d79-451d-ad6c-fafdc77bcaed tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.206s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:55:23 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:55:23 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:55:23 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 20:55:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:55:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-d5dc21a8-9710-40fc-95b0-bf66b4908f86" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:55:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-d5dc21a8-9710-40fc-95b0-bf66b4908f86" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:55:23 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:55:23 user nova-compute[75356]: DEBUG nova.objects.instance [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lazy-loading 'info_cache' on Instance uuid d5dc21a8-9710-40fc-95b0-bf66b4908f86 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:55:23 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Updating instance_info_cache with network_info: [{"id": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "address": "fa:16:3e:3b:f6:fd", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b2745f1-61", "ovs_interfaceid": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:55:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:55:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:55:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-d5dc21a8-9710-40fc-95b0-bf66b4908f86" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:55:23 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:55:23 user nova-compute[75356]: DEBUG nova.objects.instance [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'flavor' on Instance uuid d5dc21a8-9710-40fc-95b0-bf66b4908f86 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:55:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:55:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:55:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:55:23 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:55:23 user nova-compute[75356]: INFO nova.compute.manager [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Attaching volume e137c8d3-bcac-4ab1-bb63-f995a1532d7e to /dev/vdc
Nov 29 20:55:24 user nova-compute[75356]: DEBUG os_brick.utils [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:55:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:24 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb88f668-9d1d-4020-955e-88eddbacebd6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:24 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf7ef1c-6682-4d8d-933b-bb628669c5d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:24 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7bec76-3b2f-4dcf-ab1f-25a76fc7f79c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:24 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0936ea9c-1886-4f68-b9b0-d305916a15b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:55:24 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 20:55:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:24 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 20:55:24 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 20:55:24 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8875216b-1d7b-48cc-b692-a44acba5b043]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:24 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 20:55:24 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 20:55:24 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 20:55:24 user nova-compute[75356]: DEBUG os_brick.utils [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:55:24 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Updating existing volume attachment record: 68dfb732-3c8a-4e36-aebd-8ca981519720 {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 20:55:27 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:55:27 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:55:28 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:55:28 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:55:28 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:55:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:55:29 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:55:29 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:55:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:55:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:55:29 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:55:29 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:55:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:29 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:29 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75356) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 20:55:30 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:55:30 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:55:30 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=9088MB free_disk=25.079933166503906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:55:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:55:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:55:30 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance d5dc21a8-9710-40fc-95b0-bf66b4908f86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:55:30 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:55:30 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:55:30 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:55:30 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:55:30 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:55:30 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJIhxgFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:55:31 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:55:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:55:31 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:55:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:55:31 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[80431f4b-615c-493f-8180-0a261d9096cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 20:55:31 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[43592e66-868e-4779-8112-5d3ab9debac7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e] added
Nov 29 20:55:31 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad92b0b3-98b9-4ec2-8be4-948a993aec6a]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3e9aa3-292f-479c-967b-bb9711ac7979]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vJIhxgFp {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vJIhxgFp" returned: 0 in 0.026s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dadeaa-5130-4955-9c02-f430c4fba171]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vJIhxgFp'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5987568-972a-41f9-879e-e0da3f61d932]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9ba3d1-d3d3-4814-b435-425eca79b90d]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 (non-flash)
Nov 29 20:55:31 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 (non-flash)
Nov 29 20:55:31 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4624ab-b2d5-4bc2-931f-3a9a550ec3d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e, portal: 172.16.0.220,3260]
Nov 29 20:55:31 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e, portal: 172.16.0.220,3260] successful.
Nov 29 20:55:31 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afdded1-125d-4650-9c8e-a0a5c8b78e28]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c6b4cf-9889-4c55-9782-80c15582bbe9]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 (non-flash)
Nov 29 20:55:31 user nova-compute[75356]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e (non-flash)
Nov 29 20:55:31 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 (non-flash)
Nov 29 20:55:31 user nova-compute[75356]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e (non-flash)
Nov 29 20:55:31 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c88800f-7241-46e8-9bf5-306c1ca52283]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 20:55:31 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJIhxgFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 20:55:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:55:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23230336136653661', 'path': '/dev/sdc'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:55:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230336136653661', 'path': '/dev/sdc'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 20:55:32 user nova-compute[75356]: DEBUG nova.objects.instance [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'flavor' on Instance uuid d5dc21a8-9710-40fc-95b0-bf66b4908f86 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:55:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 20:55:32 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:55:32 user nova-compute[75356]:   <source dev="/dev/sdc"/>
Nov 29 20:55:32 user nova-compute[75356]:   <target dev="vdc" bus="virtio"/>
Nov 29 20:55:32 user nova-compute[75356]:   <serial>e137c8d3-bcac-4ab1-bb63-f995a1532d7e</serial>
Nov 29 20:55:32 user nova-compute[75356]: </disk>
Nov 29 20:55:32 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 20:55:33 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:55:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:55:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:55:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:55:33 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] No VIF found with MAC fa:16:3e:3b:f6:fd, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:55:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-fd2e4382-05ae-4f69-8609-6b3019b76dd9 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.373s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:55:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:55:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:55:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:55:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:55:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:55:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:55:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:55:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:55:34 user nova-compute[75356]: INFO nova.compute.manager [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Detaching volume 14380836-bfca-4957-8aab-9193dc0f9772
Nov 29 20:55:34 user nova-compute[75356]: INFO nova.virt.block_device [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Attempting to driver detach volume 14380836-bfca-4957-8aab-9193dc0f9772 from mountpoint /dev/vdb
Nov 29 20:55:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Attempting to detach device vdb from instance d5dc21a8-9710-40fc-95b0-bf66b4908f86 from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:55:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:55:34 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:55:34 user nova-compute[75356]:   <source dev="/dev/sdb"/>
Nov 29 20:55:34 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:55:34 user nova-compute[75356]:   <serial>14380836-bfca-4957-8aab-9193dc0f9772</serial>
Nov 29 20:55:34 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:55:34 user nova-compute[75356]: </disk>
Nov 29 20:55:34 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:55:34 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Successfully detached device vdb from instance d5dc21a8-9710-40fc-95b0-bf66b4908f86 from the persistent domain config.
Nov 29 20:55:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d5dc21a8-9710-40fc-95b0-bf66b4908f86 from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:55:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:55:34 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:55:34 user nova-compute[75356]:   <source dev="/dev/sdb"/>
Nov 29 20:55:34 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 20:55:34 user nova-compute[75356]:   <serial>14380836-bfca-4957-8aab-9193dc0f9772</serial>
Nov 29 20:55:34 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 20:55:34 user nova-compute[75356]: </disk>
Nov 29 20:55:34 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:55:34 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d5dc21a8-9710-40fc-95b0-bf66b4908f86 {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:55:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:55:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:55:39 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:55:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:55:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:55:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:55:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:55:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:55:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:55:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:55:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:55:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:55:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:55:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:55:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:55:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:55:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:55:54 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d5dc21a8-9710-40fc-95b0-bf66b4908f86 is timed out.
Nov 29 20:55:54 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Successfully detached device vdb from instance d5dc21a8-9710-40fc-95b0-bf66b4908f86 from the live domain config.
Nov 29 20:55:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gEVBZrCp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:55:54 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:55:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edaadcf-29e7-4e67-90b8-92359558033e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:55:54 user nova-compute[75356]: No targets found.
Nov 29 20:55:54 user nova-compute[75356]: iSNS:
Nov 29 20:55:54 user nova-compute[75356]: No targets found.
Nov 29 20:55:54 user nova-compute[75356]: STATIC:
Nov 29 20:55:54 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772
Nov 29 20:55:54 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:55:54 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:55:54 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e
Nov 29 20:55:54 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:55:54 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:55:54 user nova-compute[75356]: FIRMWARE:
Nov 29 20:55:54 user nova-compute[75356]: No targets found.
Nov 29 20:55:54 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:55:54 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:55:54 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e7fce9-de05-47a3-b25f-21ec937e65a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[12664f7f-f731-49fa-ba79-78e9090c6e4e]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 (non-flash)
Nov 29 20:55:54 user nova-compute[75356]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e (non-flash)
Nov 29 20:55:54 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 (non-flash)
Nov 29 20:55:54 user nova-compute[75356]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e (non-flash)
Nov 29 20:55:54 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f83082c6830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772'): ({'sdb'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Removing single pathed devices sdb {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41b5bb6-ed11-4b67-ab67-9f86e5f3a9f1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5361d1-6450-414c-a8d4-3a677ba577e1]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Flushing IO for device /dev/sdb {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.028s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a2247d-f3d2-47ab-aece-542d5889b7d9]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ead8a0-faac-4e44-875b-345a2f0ba3e4]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] SCSI volumes sdb have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88decb2-b26b-4607-9f08-7725f3961fc0]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e163be5b-4066-4da3-984d-a6672453fd2c]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772, portal: 172.16.0.220,3260]
Nov 29 20:55:54 user nova-compute[75356]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772, portal: 172.16.0.220,3260] successful.
Nov 29 20:55:54 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14380836-bfca-4957-8aab-9193dc0f9772 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d6ed88-4a04-4173-a9f6-29918c2285f4]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] <== disconnect_volume: return (302ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:55:54 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:55:55 user nova-compute[75356]: DEBUG nova.objects.instance [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'flavor' on Instance uuid d5dc21a8-9710-40fc-95b0-bf66b4908f86 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:55:55 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-de5bd6be-d0a0-441c-b562-dde8b5118a4c tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.794s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:55:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:55:56 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:55:56 user nova-compute[75356]: INFO nova.compute.manager [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Detaching volume e137c8d3-bcac-4ab1-bb63-f995a1532d7e
Nov 29 20:55:56 user nova-compute[75356]: INFO nova.virt.block_device [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Attempting to driver detach volume e137c8d3-bcac-4ab1-bb63-f995a1532d7e from mountpoint /dev/vdc
Nov 29 20:55:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Attempting to detach device vdc from instance d5dc21a8-9710-40fc-95b0-bf66b4908f86 from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 20:55:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:55:56 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:55:56 user nova-compute[75356]:   <source dev="/dev/sdc"/>
Nov 29 20:55:56 user nova-compute[75356]:   <target dev="vdc" bus="virtio"/>
Nov 29 20:55:56 user nova-compute[75356]:   <serial>e137c8d3-bcac-4ab1-bb63-f995a1532d7e</serial>
Nov 29 20:55:56 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 20:55:56 user nova-compute[75356]: </disk>
Nov 29 20:55:56 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:55:56 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Successfully detached device vdc from instance d5dc21a8-9710-40fc-95b0-bf66b4908f86 from the persistent domain config.
Nov 29 20:55:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d5dc21a8-9710-40fc-95b0-bf66b4908f86 from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 20:55:56 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 20:55:56 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 20:55:56 user nova-compute[75356]:   <source dev="/dev/sdc"/>
Nov 29 20:55:56 user nova-compute[75356]:   <target dev="vdc" bus="virtio"/>
Nov 29 20:55:56 user nova-compute[75356]:   <serial>e137c8d3-bcac-4ab1-bb63-f995a1532d7e</serial>
Nov 29 20:55:56 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 20:55:56 user nova-compute[75356]: </disk>
Nov 29 20:55:56 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 20:55:57 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d5dc21a8-9710-40fc-95b0-bf66b4908f86 {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 20:55:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:55:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:55:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:55:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:55:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:55:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:56:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:56:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:56:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:56:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:56:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:56:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:56:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:56:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:56:17 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance d5dc21a8-9710-40fc-95b0-bf66b4908f86 is timed out.
Nov 29 20:56:17 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Successfully detached device vdc from instance d5dc21a8-9710-40fc-95b0-bf66b4908f86 from the live domain config.
Nov 29 20:56:17 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJIhxgFp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 20:56:17 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 20:56:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b577c0c-63f3-4098-b33a-316d9d4f2ec2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 20:56:17 user nova-compute[75356]: No targets found.
Nov 29 20:56:17 user nova-compute[75356]: iSNS:
Nov 29 20:56:17 user nova-compute[75356]: No targets found.
Nov 29 20:56:17 user nova-compute[75356]: STATIC:
Nov 29 20:56:17 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e
Nov 29 20:56:17 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 20:56:17 user nova-compute[75356]:                 Iface Name: default
Nov 29 20:56:17 user nova-compute[75356]: FIRMWARE:
Nov 29 20:56:17 user nova-compute[75356]: No targets found.
Nov 29 20:56:17 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 20:56:17 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 20:56:17 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec8b1e5-32cc-48fe-a436-738df0ef776b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1049ed1-f109-4b23-8d06-bff3587db8ce]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e (non-flash)
Nov 29 20:56:17 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e (non-flash)
Nov 29 20:56:17 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f830823b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e'): ({'sdc'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Removing single pathed devices sdc {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdc7ff0-12f2-4413-b738-987fe9103e8a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48f9352-b64a-4703-8ab9-4642858acc55]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Flushing IO for device /dev/sdc {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[081b7b74-fbd5-4a1a-a3cf-fb8560865ec5]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7c5692-e95d-4a1c-ae7b-d6047fef15f8]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] SCSI volumes sdc have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bea4024-939e-4b86-8225-bc864f0eae61]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c122ef8-e8d1-4577-833d-1095823f5435]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e, portal: 172.16.0.220,3260]
Nov 29 20:56:17 user nova-compute[75356]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e, portal: 172.16.0.220,3260] successful.
Nov 29 20:56:17 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e137c8d3-bcac-4ab1-bb63-f995a1532d7e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc31fffd-312c-47b9-bae5-ffecb28dc6cb]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] <== disconnect_volume: return (256ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 20:56:17 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 20:56:18 user nova-compute[75356]: DEBUG nova.objects.instance [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'flavor' on Instance uuid d5dc21a8-9710-40fc-95b0-bf66b4908f86 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:56:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-30978a22-1270-4ff1-abbe-a7691303246f tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.620s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:56:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:56:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:56:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:56:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:56:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:56:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:56:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:56:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:56:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:56:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:56:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:56:19 user nova-compute[75356]: INFO nova.compute.manager [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Terminating instance
Nov 29 20:56:19 user nova-compute[75356]: DEBUG nova.compute.manager [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 20:56:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:56:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:56:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:56:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:56:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:56:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-71b87ebd-1f6d-44b7-b125-0a7bf58b7d39 req-949e7163-a21d-4970-abf8-2f76817d782b service nova] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Received event network-vif-unplugged-6b2745f1-616a-4e8d-a8fb-ef69c79a07c4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:56:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-71b87ebd-1f6d-44b7-b125-0a7bf58b7d39 req-949e7163-a21d-4970-abf8-2f76817d782b service nova] Acquiring lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:56:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-71b87ebd-1f6d-44b7-b125-0a7bf58b7d39 req-949e7163-a21d-4970-abf8-2f76817d782b service nova] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:56:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-71b87ebd-1f6d-44b7-b125-0a7bf58b7d39 req-949e7163-a21d-4970-abf8-2f76817d782b service nova] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:56:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-71b87ebd-1f6d-44b7-b125-0a7bf58b7d39 req-949e7163-a21d-4970-abf8-2f76817d782b service nova] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] No waiting events found dispatching network-vif-unplugged-6b2745f1-616a-4e8d-a8fb-ef69c79a07c4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:56:19 user nova-compute[75356]: DEBUG nova.compute.manager [req-71b87ebd-1f6d-44b7-b125-0a7bf58b7d39 req-949e7163-a21d-4970-abf8-2f76817d782b service nova] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Received event network-vif-unplugged-6b2745f1-616a-4e8d-a8fb-ef69c79a07c4 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 20:56:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:56:20 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Instance destroyed successfully.
Nov 29 20:56:20 user nova-compute[75356]: DEBUG nova.objects.instance [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lazy-loading 'resources' on Instance uuid d5dc21a8-9710-40fc-95b0-bf66b4908f86 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:56:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:53:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-678544185',display_name='tempest-AttachVolumeTestJSON-server-678544185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-678544185',id=50,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJs5BK2siZ8ByQY4Bd41yYDOvafxfkyz8Y4wDAej6mv+Oe4UZbiTuQiZfaa2zNu4or3qEAjvDQBIYQ6clgDbNVrPgNXexkbvmyT23dz9NeS5BICtDk05sFvu0sFwGRQ8g==',key_name='tempest-keypair-1757323624',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:53:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a1b8a1f1c6f4c24bb1ca7faafb49226',ramdisk_id='',reservation_id='r-04zgnz1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1837009022',owner_user_name='tempest-AttachVolumeTestJSON-1837009022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T20:53:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43ecf2b8c0f04d90a1ad6a780894fefc',uuid=d5dc21a8-9710-40fc-95b0-bf66b4908f86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "address": "fa:16:3e:3b:f6:fd", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b2745f1-61", "ovs_interfaceid": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 20:56:20 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converting VIF {"id": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "address": "fa:16:3e:3b:f6:fd", "network": {"id": "3c291812-5e85-410d-802d-6c3b491fe812", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1077652033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a1b8a1f1c6f4c24bb1ca7faafb49226", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b2745f1-61", "ovs_interfaceid": "6b2745f1-616a-4e8d-a8fb-ef69c79a07c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:56:20 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:f6:fd,bridge_name='br-int',has_traffic_filtering=True,id=6b2745f1-616a-4e8d-a8fb-ef69c79a07c4,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b2745f1-61') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:56:20 user nova-compute[75356]: DEBUG os_vif [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:f6:fd,bridge_name='br-int',has_traffic_filtering=True,id=6b2745f1-616a-4e8d-a8fb-ef69c79a07c4,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b2745f1-61') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 20:56:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:56:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b2745f1-61, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:56:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:56:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:56:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:56:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b024308-441a-435b-9536-381c15758824) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:56:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:56:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:56:20 user nova-compute[75356]: INFO os_vif [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:f6:fd,bridge_name='br-int',has_traffic_filtering=True,id=6b2745f1-616a-4e8d-a8fb-ef69c79a07c4,network=Network(3c291812-5e85-410d-802d-6c3b491fe812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b2745f1-61')
Nov 29 20:56:20 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Deleting instance files /opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86_del
Nov 29 20:56:20 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Deletion of /opt/stack/data/nova/instances/d5dc21a8-9710-40fc-95b0-bf66b4908f86_del complete
Nov 29 20:56:20 user nova-compute[75356]: INFO nova.compute.manager [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 20:56:20 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 20:56:20 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 20:56:20 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 20:56:21 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:56:21 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Took 0.84 seconds to deallocate network for instance.
Nov 29 20:56:21 user nova-compute[75356]: DEBUG nova.compute.manager [req-0f6d40dd-2298-4eb7-9c28-13b8127b2bf0 req-13b1c9dc-ffe0-47ae-8ef8-319b5dd069dd service nova] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Received event network-vif-deleted-6b2745f1-616a-4e8d-a8fb-ef69c79a07c4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:56:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:56:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:56:21 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:56:21 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:56:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:56:21 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Deleted allocations for instance d5dc21a8-9710-40fc-95b0-bf66b4908f86
Nov 29 20:56:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-da77443b-c219-4a22-8e54-a8db25b9da61 tempest-AttachVolumeTestJSON-1837009022 tempest-AttachVolumeTestJSON-1837009022-project-member] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:56:21 user nova-compute[75356]: DEBUG nova.compute.manager [req-7f6c64d3-0245-45f0-9a37-4411cf809816 req-c75d6d32-e378-4f1d-b5e7-e6f8e3e7e7bc service nova] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Received event network-vif-plugged-6b2745f1-616a-4e8d-a8fb-ef69c79a07c4 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:56:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7f6c64d3-0245-45f0-9a37-4411cf809816 req-c75d6d32-e378-4f1d-b5e7-e6f8e3e7e7bc service nova] Acquiring lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:56:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7f6c64d3-0245-45f0-9a37-4411cf809816 req-c75d6d32-e378-4f1d-b5e7-e6f8e3e7e7bc service nova] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:56:21 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7f6c64d3-0245-45f0-9a37-4411cf809816 req-c75d6d32-e378-4f1d-b5e7-e6f8e3e7e7bc service nova] Lock "d5dc21a8-9710-40fc-95b0-bf66b4908f86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:56:21 user nova-compute[75356]: DEBUG nova.compute.manager [req-7f6c64d3-0245-45f0-9a37-4411cf809816 req-c75d6d32-e378-4f1d-b5e7-e6f8e3e7e7bc service nova] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] No waiting events found dispatching network-vif-plugged-6b2745f1-616a-4e8d-a8fb-ef69c79a07c4 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:56:21 user nova-compute[75356]: WARNING nova.compute.manager [req-7f6c64d3-0245-45f0-9a37-4411cf809816 req-c75d6d32-e378-4f1d-b5e7-e6f8e3e7e7bc service nova] [instance: d5dc21a8-9710-40fc-95b0-bf66b4908f86] Received unexpected event network-vif-plugged-6b2745f1-616a-4e8d-a8fb-ef69c79a07c4 for instance with vm_state deleted and task_state None.
Nov 29 20:56:24 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:56:24 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:56:24 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 20:56:24 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Didn't find any instances for network info cache update. {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 20:56:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:56:28 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:56:28 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:56:28 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:56:29 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:56:29 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:56:30 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:56:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:56:31 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:56:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:56:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:56:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:56:31 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:56:31 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:56:31 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:56:31 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=9217MB free_disk=25.106597900390625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:56:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:56:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:56:31 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:56:31 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:56:31 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:56:31 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:56:31 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:56:31 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:56:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:56:39 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:56:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:56:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:56:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:56:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:57:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:57:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:57:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:57:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:57:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:57:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:57:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:57:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:57:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:57:18 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:57:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:57:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:57:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:57:26 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:57:26 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:57:26 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 20:57:26 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Didn't find any instances for network info cache update. {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 20:57:26 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:57:28 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:57:28 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:57:28 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:57:30 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:57:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:57:31 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:57:31 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:57:32 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:57:33 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:57:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:57:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:57:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:57:33 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:57:33 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:57:33 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:57:33 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=9224MB free_disk=25.105010986328125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:57:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:57:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:57:33 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:57:33 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:57:33 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:57:33 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:57:33 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:57:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.120s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:57:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:57:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:57:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:57:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:57:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:57:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:57:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:57:41 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:57:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:57:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:57:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:57:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:57:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:57:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:57:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:57:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:57:56 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:57:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:57:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:01 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "eda4aa1e-99e7-4973-832c-6ee42077012d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:58:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "eda4aa1e-99e7-4973-832c-6ee42077012d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:58:07 user nova-compute[75356]: DEBUG nova.compute.manager [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 20:58:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:58:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:58:07 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 20:58:07 user nova-compute[75356]: INFO nova.compute.claims [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Claim successful on node user
Nov 29 20:58:08 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:58:08 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:58:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:58:08 user nova-compute[75356]: DEBUG nova.compute.manager [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 20:58:08 user nova-compute[75356]: DEBUG nova.compute.manager [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 20:58:08 user nova-compute[75356]: DEBUG nova.network.neutron [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 20:58:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:08 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 20:58:08 user nova-compute[75356]: DEBUG nova.compute.manager [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 20:58:08 user nova-compute[75356]: DEBUG nova.policy [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac2b35f0b3784f51bbdb977070f922cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e55938263546bcb8e97bff962d6356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 20:58:08 user nova-compute[75356]: DEBUG nova.compute.manager [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 20:58:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 20:58:08 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Creating image(s)
Nov 29 20:58:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "/opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:58:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "/opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:58:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "/opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:58:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:58:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.173s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:58:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "318a91b9b2a34678512736c56af166c6b26a1dd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:58:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:58:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:58:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.175s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:58:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:58:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk 1073741824" returned: 0 in 0.052s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:58:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "318a91b9b2a34678512736c56af166c6b26a1dd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:58:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:58:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.184s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:58:09 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk. size=1073741824 {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 20:58:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:58:09 user nova-compute[75356]: DEBUG nova.network.neutron [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Successfully created port: 6859890f-25ac-4378-a758-58da0db29b49 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 20:58:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:58:09 user nova-compute[75356]: DEBUG nova.virt.disk.api [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Cannot resize image /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk to a smaller size. {{(pid=75356) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 20:58:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 20:58:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Ensure instance console log exists: /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 20:58:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:58:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:58:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:58:09 user nova-compute[75356]: DEBUG nova.network.neutron [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Successfully updated port: 6859890f-25ac-4378-a758-58da0db29b49 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 20:58:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:58:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquired lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:58:09 user nova-compute[75356]: DEBUG nova.network.neutron [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 20:58:09 user nova-compute[75356]: DEBUG nova.network.neutron [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 20:58:09 user nova-compute[75356]: DEBUG nova.compute.manager [req-84b4b2fa-5a28-4290-aaf3-7ed0c4c94057 req-15f4d1cf-36cd-4ad2-a4a3-2b71418d2f44 service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Received event network-changed-6859890f-25ac-4378-a758-58da0db29b49 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:58:09 user nova-compute[75356]: DEBUG nova.compute.manager [req-84b4b2fa-5a28-4290-aaf3-7ed0c4c94057 req-15f4d1cf-36cd-4ad2-a4a3-2b71418d2f44 service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Refreshing instance network info cache due to event network-changed-6859890f-25ac-4378-a758-58da0db29b49. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:58:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-84b4b2fa-5a28-4290-aaf3-7ed0c4c94057 req-15f4d1cf-36cd-4ad2-a4a3-2b71418d2f44 service nova] Acquiring lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.network.neutron [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Updating instance_info_cache with network_info: [{"id": "6859890f-25ac-4378-a758-58da0db29b49", "address": "fa:16:3e:04:d5:a0", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6859890f-25", "ovs_interfaceid": "6859890f-25ac-4378-a758-58da0db29b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Releasing lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.compute.manager [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Instance network_info: |[{"id": "6859890f-25ac-4378-a758-58da0db29b49", "address": "fa:16:3e:04:d5:a0", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6859890f-25", "ovs_interfaceid": "6859890f-25ac-4378-a758-58da0db29b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-84b4b2fa-5a28-4290-aaf3-7ed0c4c94057 req-15f4d1cf-36cd-4ad2-a4a3-2b71418d2f44 service nova] Acquired lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.network.neutron [req-84b4b2fa-5a28-4290-aaf3-7ed0c4c94057 req-15f4d1cf-36cd-4ad2-a4a3-2b71418d2f44 service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Refreshing network info cache for port 6859890f-25ac-4378-a758-58da0db29b49 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Start _get_guest_xml network_info=[{"id": "6859890f-25ac-4378-a758-58da0db29b49", "address": "fa:16:3e:04:d5:a0", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6859890f-25", "ovs_interfaceid": "6859890f-25ac-4378-a758-58da0db29b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '6ec9e8df-1fe5-47a2-a649-880c9c3e5f36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 20:58:10 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:58:10 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T20:13:14Z,direct_url=<?>,disk_format='qcow2',id=6ec9e8df-1fe5-47a2-a649-880c9c3e5f36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85354408285b41f9a373abccf0e04f50',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T20:13:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:58:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-927342429',display_name='tempest-TestStampPattern-server-927342429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-927342429',id=51,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGAFam8O0by6XSQDRfy1NdNe3iK/s41EVX/2vOG4f/avx+fZuldYPIcYw0ykNVKGY31g+OK6PLVJ/9BToxsJc6YzTuxdkUJ/LiSyuAXTM1wLeUdcFQ1eXOyB4opMKLyMA==',key_name='tempest-TestStampPattern-2006686699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12e55938263546bcb8e97bff962d6356',ramdisk_id='',reservation_id='r-5rdmmdub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-46479786',owner_user_name='tempest-TestStampPattern-46479786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:58:08Z,user_data=None,user_id='ac2b35f0b3784f51bbdb977070f922cc',uuid=eda4aa1e-99e7-4973-832c-6ee42077012d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6859890f-25ac-4378-a758-58da0db29b49", "address": "fa:16:3e:04:d5:a0", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6859890f-25", "ovs_interfaceid": "6859890f-25ac-4378-a758-58da0db29b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Converting VIF {"id": "6859890f-25ac-4378-a758-58da0db29b49", "address": "fa:16:3e:04:d5:a0", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6859890f-25", "ovs_interfaceid": "6859890f-25ac-4378-a758-58da0db29b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:d5:a0,bridge_name='br-int',has_traffic_filtering=True,id=6859890f-25ac-4378-a758-58da0db29b49,network=Network(152ef722-f2bf-4a14-84ef-0a650a2ff94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6859890f-25') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.objects.instance [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lazy-loading 'pci_devices' on Instance uuid eda4aa1e-99e7-4973-832c-6ee42077012d {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 20:58:10 user nova-compute[75356]:   <uuid>eda4aa1e-99e7-4973-832c-6ee42077012d</uuid>
Nov 29 20:58:10 user nova-compute[75356]:   <name>instance-00000033</name>
Nov 29 20:58:10 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 20:58:10 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 20:58:10 user nova-compute[75356]:   <metadata>
Nov 29 20:58:10 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 20:58:10 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 20:58:10 user nova-compute[75356]:       <nova:name>tempest-TestStampPattern-server-927342429</nova:name>
Nov 29 20:58:10 user nova-compute[75356]:       <nova:creationTime>2023-11-29 20:58:10</nova:creationTime>
Nov 29 20:58:10 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 20:58:10 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 20:58:10 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 20:58:10 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 20:58:10 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 20:58:10 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 20:58:10 user nova-compute[75356]:       </nova:flavor>
Nov 29 20:58:10 user nova-compute[75356]:       <nova:owner>
Nov 29 20:58:10 user nova-compute[75356]:         <nova:user uuid="ac2b35f0b3784f51bbdb977070f922cc">tempest-TestStampPattern-46479786-project-member</nova:user>
Nov 29 20:58:10 user nova-compute[75356]:         <nova:project uuid="12e55938263546bcb8e97bff962d6356">tempest-TestStampPattern-46479786</nova:project>
Nov 29 20:58:10 user nova-compute[75356]:       </nova:owner>
Nov 29 20:58:10 user nova-compute[75356]:       <nova:root type="image" uuid="6ec9e8df-1fe5-47a2-a649-880c9c3e5f36"/>
Nov 29 20:58:10 user nova-compute[75356]:       <nova:ports>
Nov 29 20:58:10 user nova-compute[75356]:         <nova:port uuid="6859890f-25ac-4378-a758-58da0db29b49">
Nov 29 20:58:10 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 20:58:10 user nova-compute[75356]:         </nova:port>
Nov 29 20:58:10 user nova-compute[75356]:       </nova:ports>
Nov 29 20:58:10 user nova-compute[75356]:     </nova:instance>
Nov 29 20:58:10 user nova-compute[75356]:   </metadata>
Nov 29 20:58:10 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 20:58:10 user nova-compute[75356]:     <system>
Nov 29 20:58:10 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 20:58:10 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 20:58:10 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 20:58:10 user nova-compute[75356]:       <entry name="serial">eda4aa1e-99e7-4973-832c-6ee42077012d</entry>
Nov 29 20:58:10 user nova-compute[75356]:       <entry name="uuid">eda4aa1e-99e7-4973-832c-6ee42077012d</entry>
Nov 29 20:58:10 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 20:58:10 user nova-compute[75356]:     </system>
Nov 29 20:58:10 user nova-compute[75356]:   </sysinfo>
Nov 29 20:58:10 user nova-compute[75356]:   <os>
Nov 29 20:58:10 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 20:58:10 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 20:58:10 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 20:58:10 user nova-compute[75356]:   </os>
Nov 29 20:58:10 user nova-compute[75356]:   <features>
Nov 29 20:58:10 user nova-compute[75356]:     <acpi/>
Nov 29 20:58:10 user nova-compute[75356]:     <apic/>
Nov 29 20:58:10 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 20:58:10 user nova-compute[75356]:   </features>
Nov 29 20:58:10 user nova-compute[75356]:   <clock offset="utc">
Nov 29 20:58:10 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 20:58:10 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 20:58:10 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 20:58:10 user nova-compute[75356]:   </clock>
Nov 29 20:58:10 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 20:58:10 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 20:58:10 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 20:58:10 user nova-compute[75356]:   </cpu>
Nov 29 20:58:10 user nova-compute[75356]:   <devices>
Nov 29 20:58:10 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 20:58:10 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 20:58:10 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk"/>
Nov 29 20:58:10 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 20:58:10 user nova-compute[75356]:     </disk>
Nov 29 20:58:10 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 20:58:10 user nova-compute[75356]:       <mac address="fa:16:3e:04:d5:a0"/>
Nov 29 20:58:10 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:58:10 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 20:58:10 user nova-compute[75356]:       <target dev="tap6859890f-25"/>
Nov 29 20:58:10 user nova-compute[75356]:     </interface>
Nov 29 20:58:10 user nova-compute[75356]:     <serial type="pty">
Nov 29 20:58:10 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/console.log" append="off"/>
Nov 29 20:58:10 user nova-compute[75356]:     </serial>
Nov 29 20:58:10 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 20:58:10 user nova-compute[75356]:     <video>
Nov 29 20:58:10 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 20:58:10 user nova-compute[75356]:     </video>
Nov 29 20:58:10 user nova-compute[75356]:     <rng model="virtio">
Nov 29 20:58:10 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 20:58:10 user nova-compute[75356]:     </rng>
Nov 29 20:58:10 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 20:58:10 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 20:58:10 user nova-compute[75356]:       <stats period="10"/>
Nov 29 20:58:10 user nova-compute[75356]:     </memballoon>
Nov 29 20:58:10 user nova-compute[75356]:   </devices>
Nov 29 20:58:10 user nova-compute[75356]: </domain>
Nov 29 20:58:10 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:58:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-927342429',display_name='tempest-TestStampPattern-server-927342429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-927342429',id=51,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGAFam8O0by6XSQDRfy1NdNe3iK/s41EVX/2vOG4f/avx+fZuldYPIcYw0ykNVKGY31g+OK6PLVJ/9BToxsJc6YzTuxdkUJ/LiSyuAXTM1wLeUdcFQ1eXOyB4opMKLyMA==',key_name='tempest-TestStampPattern-2006686699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12e55938263546bcb8e97bff962d6356',ramdisk_id='',reservation_id='r-5rdmmdub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-46479786',owner_user_name='tempest-TestStampPattern-46479786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T20:58:08Z,user_data=None,user_id='ac2b35f0b3784f51bbdb977070f922cc',uuid=eda4aa1e-99e7-4973-832c-6ee42077012d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6859890f-25ac-4378-a758-58da0db29b49", "address": "fa:16:3e:04:d5:a0", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6859890f-25", "ovs_interfaceid": "6859890f-25ac-4378-a758-58da0db29b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Converting VIF {"id": "6859890f-25ac-4378-a758-58da0db29b49", "address": "fa:16:3e:04:d5:a0", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6859890f-25", "ovs_interfaceid": "6859890f-25ac-4378-a758-58da0db29b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:d5:a0,bridge_name='br-int',has_traffic_filtering=True,id=6859890f-25ac-4378-a758-58da0db29b49,network=Network(152ef722-f2bf-4a14-84ef-0a650a2ff94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6859890f-25') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG os_vif [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:d5:a0,bridge_name='br-int',has_traffic_filtering=True,id=6859890f-25ac-4378-a758-58da0db29b49,network=Network(152ef722-f2bf-4a14-84ef-0a650a2ff94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6859890f-25') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72ba02af-687c-555f-acdd-749f0a15650a', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6859890f-25, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6859890f-25, col_values=(('qos', UUID('03acbe17-9fed-45df-96c4-5594ec028c9f')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6859890f-25, col_values=(('external_ids', {'iface-id': '6859890f-25ac-4378-a758-58da0db29b49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:d5:a0', 'vm-uuid': 'eda4aa1e-99e7-4973-832c-6ee42077012d'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:10 user nova-compute[75356]: INFO os_vif [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:d5:a0,bridge_name='br-int',has_traffic_filtering=True,id=6859890f-25ac-4378-a758-58da0db29b49,network=Network(152ef722-f2bf-4a14-84ef-0a650a2ff94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6859890f-25')
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] No VIF found with MAC fa:16:3e:04:d5:a0, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.network.neutron [req-84b4b2fa-5a28-4290-aaf3-7ed0c4c94057 req-15f4d1cf-36cd-4ad2-a4a3-2b71418d2f44 service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Updated VIF entry in instance network info cache for port 6859890f-25ac-4378-a758-58da0db29b49. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG nova.network.neutron [req-84b4b2fa-5a28-4290-aaf3-7ed0c4c94057 req-15f4d1cf-36cd-4ad2-a4a3-2b71418d2f44 service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Updating instance_info_cache with network_info: [{"id": "6859890f-25ac-4378-a758-58da0db29b49", "address": "fa:16:3e:04:d5:a0", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6859890f-25", "ovs_interfaceid": "6859890f-25ac-4378-a758-58da0db29b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:58:10 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-84b4b2fa-5a28-4290-aaf3-7ed0c4c94057 req-15f4d1cf-36cd-4ad2-a4a3-2b71418d2f44 service nova] Releasing lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:58:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:12 user nova-compute[75356]: DEBUG nova.compute.manager [req-f77ba15e-0306-48ff-bf98-1012c5ec3738 req-1c71db10-e54e-4050-861d-41212beb6e28 service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Received event network-vif-plugged-6859890f-25ac-4378-a758-58da0db29b49 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:58:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f77ba15e-0306-48ff-bf98-1012c5ec3738 req-1c71db10-e54e-4050-861d-41212beb6e28 service nova] Acquiring lock "eda4aa1e-99e7-4973-832c-6ee42077012d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:58:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f77ba15e-0306-48ff-bf98-1012c5ec3738 req-1c71db10-e54e-4050-861d-41212beb6e28 service nova] Lock "eda4aa1e-99e7-4973-832c-6ee42077012d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:58:12 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f77ba15e-0306-48ff-bf98-1012c5ec3738 req-1c71db10-e54e-4050-861d-41212beb6e28 service nova] Lock "eda4aa1e-99e7-4973-832c-6ee42077012d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:58:12 user nova-compute[75356]: DEBUG nova.compute.manager [req-f77ba15e-0306-48ff-bf98-1012c5ec3738 req-1c71db10-e54e-4050-861d-41212beb6e28 service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] No waiting events found dispatching network-vif-plugged-6859890f-25ac-4378-a758-58da0db29b49 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:58:12 user nova-compute[75356]: WARNING nova.compute.manager [req-f77ba15e-0306-48ff-bf98-1012c5ec3738 req-1c71db10-e54e-4050-861d-41212beb6e28 service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Received unexpected event network-vif-plugged-6859890f-25ac-4378-a758-58da0db29b49 for instance with vm_state building and task_state spawning.
Nov 29 20:58:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:13 user nova-compute[75356]: DEBUG nova.compute.manager [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 20:58:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 20:58:13 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Instance spawned successfully.
Nov 29 20:58:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 20:58:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Found default for hw_cdrom_bus of ide {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:58:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Found default for hw_disk_bus of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:58:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:58:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:58:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Found default for hw_video_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:58:13 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Found default for hw_vif_model of virtio {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 20:58:14 user nova-compute[75356]: INFO nova.compute.manager [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Took 5.51 seconds to spawn the instance on the hypervisor.
Nov 29 20:58:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 20:58:14 user nova-compute[75356]: INFO nova.compute.manager [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Took 6.14 seconds to build instance.
Nov 29 20:58:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-86372cc8-7fb6-4191-ab4a-0acdc983e2bc tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "eda4aa1e-99e7-4973-832c-6ee42077012d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.231s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:58:14 user nova-compute[75356]: DEBUG nova.compute.manager [req-cb9c2880-066d-48fa-91e8-9d37e9c58010 req-757cf9db-8265-425a-b817-f5b052cc2a4a service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Received event network-vif-plugged-6859890f-25ac-4378-a758-58da0db29b49 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:58:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cb9c2880-066d-48fa-91e8-9d37e9c58010 req-757cf9db-8265-425a-b817-f5b052cc2a4a service nova] Acquiring lock "eda4aa1e-99e7-4973-832c-6ee42077012d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:58:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cb9c2880-066d-48fa-91e8-9d37e9c58010 req-757cf9db-8265-425a-b817-f5b052cc2a4a service nova] Lock "eda4aa1e-99e7-4973-832c-6ee42077012d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:58:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-cb9c2880-066d-48fa-91e8-9d37e9c58010 req-757cf9db-8265-425a-b817-f5b052cc2a4a service nova] Lock "eda4aa1e-99e7-4973-832c-6ee42077012d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:58:14 user nova-compute[75356]: DEBUG nova.compute.manager [req-cb9c2880-066d-48fa-91e8-9d37e9c58010 req-757cf9db-8265-425a-b817-f5b052cc2a4a service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] No waiting events found dispatching network-vif-plugged-6859890f-25ac-4378-a758-58da0db29b49 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 20:58:14 user nova-compute[75356]: WARNING nova.compute.manager [req-cb9c2880-066d-48fa-91e8-9d37e9c58010 req-757cf9db-8265-425a-b817-f5b052cc2a4a service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Received unexpected event network-vif-plugged-6859890f-25ac-4378-a758-58da0db29b49 for instance with vm_state active and task_state None.
Nov 29 20:58:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:18 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:58:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:58:26 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:58:26 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:58:26 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 20:58:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:58:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:58:26 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:58:26 user nova-compute[75356]: DEBUG nova.objects.instance [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lazy-loading 'info_cache' on Instance uuid eda4aa1e-99e7-4973-832c-6ee42077012d {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:58:26 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Updating instance_info_cache with network_info: [{"id": "6859890f-25ac-4378-a758-58da0db29b49", "address": "fa:16:3e:04:d5:a0", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6859890f-25", "ovs_interfaceid": "6859890f-25ac-4378-a758-58da0db29b49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:58:26 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:58:26 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:58:28 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:29 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:58:29 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:58:30 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:58:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:31 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:58:31 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:58:32 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:58:33 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:58:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:58:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:58:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:58:33 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:58:33 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:58:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:33 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:58:33 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:58:33 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:58:34 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:58:34 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:58:34 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=9004MB free_disk=25.075244903564453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:58:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:58:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:58:34 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance eda4aa1e-99e7-4973-832c-6ee42077012d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:58:34 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:58:34 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:58:34 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing inventories for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 20:58:34 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Updating ProviderTree inventory for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 20:58:34 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Updating inventory in ProviderTree for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 20:58:34 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing aggregate associations for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a, aggregates: None {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 20:58:34 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing trait associations for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 20:58:34 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:58:34 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:58:34 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:58:34 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:58:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:44 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:58:44 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:58:45 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:58:45 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75356) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 20:58:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:58:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:58:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:58:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:58:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:58:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:58:52 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:58:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Cleaning up deleted instances {{(pid=75356) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 20:58:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] There are 0 instances to clean {{(pid=75356) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 20:58:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:59:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:59:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:59:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:59:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:59:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:59:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:59:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:59:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:59:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:59:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:59:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:59:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:59:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:59:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:59:20 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:59:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:59:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:59:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:59:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:59:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:59:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:59:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:59:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:59:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:59:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:59:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:59:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:59:27 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:59:27 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 20:59:27 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 20:59:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:59:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:59:27 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 20:59:27 user nova-compute[75356]: DEBUG nova.objects.instance [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lazy-loading 'info_cache' on Instance uuid eda4aa1e-99e7-4973-832c-6ee42077012d {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 20:59:27 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Updating instance_info_cache with network_info: [{"id": "6859890f-25ac-4378-a758-58da0db29b49", "address": "fa:16:3e:04:d5:a0", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6859890f-25", "ovs_interfaceid": "6859890f-25ac-4378-a758-58da0db29b49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 20:59:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 20:59:27 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 20:59:30 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:59:30 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 20:59:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:59:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:59:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:59:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:59:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:59:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:59:32 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:59:32 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:59:32 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:59:33 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:59:33 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:59:35 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:59:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:59:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:59:35 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:59:35 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 20:59:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:59:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:59:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 20:59:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:59:35 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 20:59:36 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:59:36 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 20:59:36 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=9073MB free_disk=25.073272705078125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 20:59:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 20:59:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 20:59:36 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance eda4aa1e-99e7-4973-832c-6ee42077012d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 20:59:36 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 20:59:36 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 20:59:36 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 20:59:36 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 20:59:36 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 20:59:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.242s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 20:59:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:59:44 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 20:59:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:59:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 20:59:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:59:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 20:59:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:59:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 20:59:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:59:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:59:58 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 20:59:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-023fe9d1-040c-498d-abcc-e53dbe1ba18e req-f8d5fffb-a806-40ad-b4cc-55f78a60628d service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Received event network-changed-6859890f-25ac-4378-a758-58da0db29b49 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 20:59:59 user nova-compute[75356]: DEBUG nova.compute.manager [req-023fe9d1-040c-498d-abcc-e53dbe1ba18e req-f8d5fffb-a806-40ad-b4cc-55f78a60628d service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Refreshing instance network info cache due to event network-changed-6859890f-25ac-4378-a758-58da0db29b49. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 20:59:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-023fe9d1-040c-498d-abcc-e53dbe1ba18e req-f8d5fffb-a806-40ad-b4cc-55f78a60628d service nova] Acquiring lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 20:59:59 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-023fe9d1-040c-498d-abcc-e53dbe1ba18e req-f8d5fffb-a806-40ad-b4cc-55f78a60628d service nova] Acquired lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 20:59:59 user nova-compute[75356]: DEBUG nova.network.neutron [req-023fe9d1-040c-498d-abcc-e53dbe1ba18e req-f8d5fffb-a806-40ad-b4cc-55f78a60628d service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Refreshing network info cache for port 6859890f-25ac-4378-a758-58da0db29b49 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG nova.network.neutron [req-023fe9d1-040c-498d-abcc-e53dbe1ba18e req-f8d5fffb-a806-40ad-b4cc-55f78a60628d service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Updated VIF entry in instance network info cache for port 6859890f-25ac-4378-a758-58da0db29b49. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG nova.network.neutron [req-023fe9d1-040c-498d-abcc-e53dbe1ba18e req-f8d5fffb-a806-40ad-b4cc-55f78a60628d service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Updating instance_info_cache with network_info: [{"id": "6859890f-25ac-4378-a758-58da0db29b49", "address": "fa:16:3e:04:d5:a0", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6859890f-25", "ovs_interfaceid": "6859890f-25ac-4378-a758-58da0db29b49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "eda4aa1e-99e7-4973-832c-6ee42077012d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "eda4aa1e-99e7-4973-832c-6ee42077012d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-023fe9d1-040c-498d-abcc-e53dbe1ba18e req-f8d5fffb-a806-40ad-b4cc-55f78a60628d service nova] Releasing lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG nova.objects.instance [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lazy-loading 'flavor' on Instance uuid eda4aa1e-99e7-4973-832c-6ee42077012d {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "eda4aa1e-99e7-4973-832c-6ee42077012d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "eda4aa1e-99e7-4973-832c-6ee42077012d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "eda4aa1e-99e7-4973-832c-6ee42077012d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:00:00 user nova-compute[75356]: INFO nova.compute.manager [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Attaching volume 0d63c924-2904-46fc-831d-36d19956f4bc to /dev/vdb
Nov 29 21:00:00 user nova-compute[75356]: DEBUG os_brick.utils [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5a2832-0de2-4d45-9b51-b981ef392577]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b5d079-3c8c-4d83-b830-bf1a0feadb05]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3efb2a4-6b92-47a1-a3e0-45e0ee0014df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49af444-4863-4c07-bd8f-9148f2409928]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:00:00 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:00:00 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[125fc936-9ec3-44ee-b012-f011690ad37e]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG os_brick.utils [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Updating existing volume attachment record: 15ff807b-46cc-45a6-a073-3db1ab4b43bf {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:00:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:00:03 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:00:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xqEMehJr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:00:07 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:00:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:00:07 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:00:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:00:07 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[115a0ac9-a863-4041-9762-09131db47d10]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:00:07 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bd990a-bdaa-42e1-ae23-bf1962eef671]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc] added
Nov 29 21:00:07 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[970be5e0-e792-47c8-82da-ac8cea6464bc]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5864f219-bf32-455d-bd2d-cfe44708c1df]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xqEMehJr {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xqEMehJr" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4c0313-f41e-46fe-a29a-25ddbf0d07ff]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xqEMehJr'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c24c037-279e-4554-a40c-8292b9f70d64]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[869a7c80-b945-49d4-bdd3-c33b35218148]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 21:00:07 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 21:00:07 user nova-compute[75356]:  {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:00:07 user nova-compute[75356]: WARNING os_brick.initiator.connectors.iscsi [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 21:00:07 user nova-compute[75356]: 
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f565b6-f8d2-4354-83d7-4b575d94604a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc, portal: 172.16.0.220,3260]
Nov 29 21:00:07 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc, portal: 172.16.0.220,3260] successful.
Nov 29 21:00:07 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cb5b9d-3036-4aed-a687-32eeae5760ca]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[860ad57a-b8c6-449e-b404-1b1bf80ee5d2]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc (non-flash)
Nov 29 21:00:07 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:00:07 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc (non-flash)
Nov 29 21:00:07 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:00:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:00:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:00:08 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:00:08 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:00:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[332281d6-c3bc-4015-8267-123b4fd6fe8a]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:08 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:00:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xqEMehJr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:00:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:00:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:00:09 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23632343539623130', 'path': '/dev/sdb'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:00:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632343539623130', 'path': '/dev/sdb'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:00:09 user nova-compute[75356]: DEBUG nova.objects.instance [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lazy-loading 'flavor' on Instance uuid eda4aa1e-99e7-4973-832c-6ee42077012d {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:00:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 21:00:09 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:00:09 user nova-compute[75356]:   <source dev="/dev/sdb"/>
Nov 29 21:00:09 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:00:09 user nova-compute[75356]:   <serial>0d63c924-2904-46fc-831d-36d19956f4bc</serial>
Nov 29 21:00:09 user nova-compute[75356]: </disk>
Nov 29 21:00:09 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 21:00:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:00:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:00:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] No VIF found with MAC fa:16:3e:04:d5:a0, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:00:09 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-842d2228-857e-43ce-95a4-bab14b3084e6 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "eda4aa1e-99e7-4973-832c-6ee42077012d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.254s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:00:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:00:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "eda4aa1e-99e7-4973-832c-6ee42077012d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:00:11 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "eda4aa1e-99e7-4973-832c-6ee42077012d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:00:11 user nova-compute[75356]: INFO nova.compute.manager [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Detaching volume 0d63c924-2904-46fc-831d-36d19956f4bc
Nov 29 21:00:11 user nova-compute[75356]: INFO nova.virt.block_device [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Attempting to driver detach volume 0d63c924-2904-46fc-831d-36d19956f4bc from mountpoint /dev/vdb
Nov 29 21:00:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Attempting to detach device vdb from instance eda4aa1e-99e7-4973-832c-6ee42077012d from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 21:00:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:00:11 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:00:11 user nova-compute[75356]:   <source dev="/dev/sdb"/>
Nov 29 21:00:11 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:00:11 user nova-compute[75356]:   <serial>0d63c924-2904-46fc-831d-36d19956f4bc</serial>
Nov 29 21:00:11 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 21:00:11 user nova-compute[75356]: </disk>
Nov 29 21:00:11 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:00:11 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Successfully detached device vdb from instance eda4aa1e-99e7-4973-832c-6ee42077012d from the persistent domain config.
Nov 29 21:00:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eda4aa1e-99e7-4973-832c-6ee42077012d from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 21:00:11 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:00:11 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:00:11 user nova-compute[75356]:   <source dev="/dev/sdb"/>
Nov 29 21:00:11 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:00:11 user nova-compute[75356]:   <serial>0d63c924-2904-46fc-831d-36d19956f4bc</serial>
Nov 29 21:00:11 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 21:00:11 user nova-compute[75356]: </disk>
Nov 29 21:00:11 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:00:12 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eda4aa1e-99e7-4973-832c-6ee42077012d {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 21:00:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:00:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:00:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:00:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:00:22 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:00:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:00:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:00:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:00:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:00:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:00:25 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:00:27 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:00:27 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:00:27 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 21:00:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:00:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:00:27 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 21:00:27 user nova-compute[75356]: DEBUG nova.objects.instance [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lazy-loading 'info_cache' on Instance uuid eda4aa1e-99e7-4973-832c-6ee42077012d {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:00:27 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Updating instance_info_cache with network_info: [{"id": "6859890f-25ac-4378-a758-58da0db29b49", "address": "fa:16:3e:04:d5:a0", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6859890f-25", "ovs_interfaceid": "6859890f-25ac-4378-a758-58da0db29b49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:00:27 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:00:27 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 21:00:30 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:00:30 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:00:30 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:00:32 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance eda4aa1e-99e7-4973-832c-6ee42077012d is timed out.
Nov 29 21:00:32 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Successfully detached device vdb from instance eda4aa1e-99e7-4973-832c-6ee42077012d from the live domain config.
Nov 29 21:00:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xqEMehJr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:00:32 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:00:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[4497c812-78d9-4397-a908-6593218a6a63]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:00:32 user nova-compute[75356]: No targets found.
Nov 29 21:00:32 user nova-compute[75356]: iSNS:
Nov 29 21:00:32 user nova-compute[75356]: No targets found.
Nov 29 21:00:32 user nova-compute[75356]: STATIC:
Nov 29 21:00:32 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc
Nov 29 21:00:32 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:00:32 user nova-compute[75356]:                 Iface Name: default
Nov 29 21:00:32 user nova-compute[75356]: FIRMWARE:
Nov 29 21:00:32 user nova-compute[75356]: No targets found.
Nov 29 21:00:32 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:00:32 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:00:32 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[730b18bf-76a1-4286-a103-5b58253bcb1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bee23b-5fc8-42ba-a66d-7715bb34c9c0]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc (non-flash)
Nov 29 21:00:32 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc (non-flash)
Nov 29 21:00:32 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8308453910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc'): ({'sdb'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Removing single pathed devices sdb {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cc5cd2-ffd6-496d-aae6-48c2dcc584dd]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5196c690-33e7-41db-81c3-edf46249fb8b]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Flushing IO for device /dev/sdb {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa5a52d-b57c-4b69-a526-5c7298ab88d4]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[364a566a-ae97-4ab1-b145-9998872d6872]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] SCSI volumes sdb have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb3682c-b6a3-4e0e-a81e-24d1e8e95864]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[530db15e-9f86-490a-ab49-f9d8385c7ee0]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc, portal: 172.16.0.220,3260]
Nov 29 21:00:32 user nova-compute[75356]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc, portal: 172.16.0.220,3260] successful.
Nov 29 21:00:32 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d63c924-2904-46fc-831d-36d19956f4bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bd95b9-6a51-4dc3-a044-fd1be47242ce]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] <== disconnect_volume: return (262ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:00:32 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:00:33 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:00:33 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:00:33 user nova-compute[75356]: DEBUG nova.objects.instance [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lazy-loading 'flavor' on Instance uuid eda4aa1e-99e7-4973-832c-6ee42077012d {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:00:33 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-654b6a31-a39a-483d-9edc-ee6cfab93862 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "eda4aa1e-99e7-4973-832c-6ee42077012d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.615s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:00:33 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:00:34 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:00:35 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:00:35 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:00:36 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:00:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:00:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:00:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:00:36 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:00:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:00:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:00:37 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:00:37 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:00:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=9065MB free_disk=25.07217025756836GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:00:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:00:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:00:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance eda4aa1e-99e7-4973-832c-6ee42077012d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:00:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:00:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:00:37 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:00:37 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:00:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:00:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:00:40 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:00:44 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:00:45 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:00:50 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:00:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:00:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:00:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:00:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:00:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:00:55 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:00 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:01:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:01:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:01:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:01:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:01:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:05 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:01:07 user nova-compute[75356]: DEBUG nova.compute.manager [None req-88de69b0-1720-4362-a6b3-ff465162134f tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:01:07 user nova-compute[75356]: INFO nova.compute.manager [None req-88de69b0-1720-4362-a6b3-ff465162134f tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] instance snapshotting
Nov 29 21:01:07 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-88de69b0-1720-4362-a6b3-ff465162134f tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Beginning live snapshot process
Nov 29 21:01:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-88de69b0-1720-4362-a6b3-ff465162134f tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json -f qcow2 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:01:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-88de69b0-1720-4362-a6b3-ff465162134f tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:01:07 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-88de69b0-1720-4362-a6b3-ff465162134f tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json -f qcow2 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:01:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-88de69b0-1720-4362-a6b3-ff465162134f tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:01:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-88de69b0-1720-4362-a6b3-ff465162134f tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:01:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-88de69b0-1720-4362-a6b3-ff465162134f tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9 --force-share --output=json" returned: 0 in 0.172s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:01:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-88de69b0-1720-4362-a6b3-ff465162134f tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmper1kgvlz/a8ece64bce074b20902d35af4b99ac4c.delta 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:01:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-88de69b0-1720-4362-a6b3-ff465162134f tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/318a91b9b2a34678512736c56af166c6b26a1dd9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmper1kgvlz/a8ece64bce074b20902d35af4b99ac4c.delta 1073741824" returned: 0 in 0.051s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:01:08 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-88de69b0-1720-4362-a6b3-ff465162134f tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 21:01:08 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-88de69b0-1720-4362-a6b3-ff465162134f tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:01:09 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-88de69b0-1720-4362-a6b3-ff465162134f tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75356) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 21:01:09 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-88de69b0-1720-4362-a6b3-ff465162134f tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 21:01:09 user nova-compute[75356]: DEBUG nova.privsep.utils [None req-88de69b0-1720-4362-a6b3-ff465162134f tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75356) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 21:01:09 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-88de69b0-1720-4362-a6b3-ff465162134f tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmper1kgvlz/a8ece64bce074b20902d35af4b99ac4c.delta /opt/stack/data/nova/instances/snapshots/tmper1kgvlz/a8ece64bce074b20902d35af4b99ac4c {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:01:10 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-88de69b0-1720-4362-a6b3-ff465162134f tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmper1kgvlz/a8ece64bce074b20902d35af4b99ac4c.delta /opt/stack/data/nova/instances/snapshots/tmper1kgvlz/a8ece64bce074b20902d35af4b99ac4c" returned: 0 in 0.671s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:01:10 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-88de69b0-1720-4362-a6b3-ff465162134f tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Snapshot extracted, beginning image upload
Nov 29 21:01:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:01:12 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-88de69b0-1720-4362-a6b3-ff465162134f tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Snapshot image upload complete
Nov 29 21:01:12 user nova-compute[75356]: INFO nova.compute.manager [None req-88de69b0-1720-4362-a6b3-ff465162134f tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Took 5.19 seconds to snapshot the instance on the hypervisor.
Nov 29 21:01:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "657fb92f-75a4-4f51-a096-394487e79e04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:01:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "657fb92f-75a4-4f51-a096-394487e79e04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:01:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Starting instance... {{(pid=75356) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 21:01:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:01:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:01:15 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75356) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 21:01:15 user nova-compute[75356]: INFO nova.compute.claims [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Claim successful on node user
Nov 29 21:01:15 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:15 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:01:15 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:01:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.202s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:01:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Start building networks asynchronously for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 21:01:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Allocating IP information in the background. {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 21:01:15 user nova-compute[75356]: DEBUG nova.network.neutron [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] allocate_for_instance() {{(pid=75356) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 21:01:15 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 21:01:15 user nova-compute[75356]: DEBUG nova.compute.manager [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Start building block device mappings for instance. {{(pid=75356) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 21:01:15 user nova-compute[75356]: DEBUG nova.policy [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac2b35f0b3784f51bbdb977070f922cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e55938263546bcb8e97bff962d6356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75356) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 21:01:16 user nova-compute[75356]: DEBUG nova.compute.manager [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Start spawning the instance on the hypervisor. {{(pid=75356) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 21:01:16 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Creating instance directory {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 21:01:16 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Creating image(s)
Nov 29 21:01:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "/opt/stack/data/nova/instances/657fb92f-75a4-4f51-a096-394487e79e04/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:01:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "/opt/stack/data/nova/instances/657fb92f-75a4-4f51-a096-394487e79e04/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:01:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "/opt/stack/data/nova/instances/657fb92f-75a4-4f51-a096-394487e79e04/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:01:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "9657698c7a8ff83eba7073bafe14b7a7a65d9ffe" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:01:16 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "9657698c7a8ff83eba7073bafe14b7a7a65d9ffe" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:01:16 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9657698c7a8ff83eba7073bafe14b7a7a65d9ffe.part --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:01:16 user nova-compute[75356]: DEBUG nova.network.neutron [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Successfully created port: 43a6ef65-a2c9-41ad-9afe-c3c6e451e280 {{(pid=75356) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 21:01:16 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9657698c7a8ff83eba7073bafe14b7a7a65d9ffe.part --force-share --output=json" returned: 0 in 0.179s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:01:17 user nova-compute[75356]: DEBUG nova.virt.images [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] 39596efe-2e17-4073-8223-b0ecc7d2fb25 was qcow2, converting to raw {{(pid=75356) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 21:01:17 user nova-compute[75356]: DEBUG nova.privsep.utils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75356) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 21:01:17 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9657698c7a8ff83eba7073bafe14b7a7a65d9ffe.part /opt/stack/data/nova/instances/_base/9657698c7a8ff83eba7073bafe14b7a7a65d9ffe.converted {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG nova.network.neutron [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Successfully updated port: 43a6ef65-a2c9-41ad-9afe-c3c6e451e280 {{(pid=75356) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "refresh_cache-657fb92f-75a4-4f51-a096-394487e79e04" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquired lock "refresh_cache-657fb92f-75a4-4f51-a096-394487e79e04" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG nova.network.neutron [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Building network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-658b0cc8-7552-43c2-b0f1-073fe245eb40 req-25319123-4963-445b-b295-059384e8604f service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Received event network-changed-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG nova.compute.manager [req-658b0cc8-7552-43c2-b0f1-073fe245eb40 req-25319123-4963-445b-b295-059384e8604f service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Refreshing instance network info cache due to event network-changed-43a6ef65-a2c9-41ad-9afe-c3c6e451e280. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-658b0cc8-7552-43c2-b0f1-073fe245eb40 req-25319123-4963-445b-b295-059384e8604f service nova] Acquiring lock "refresh_cache-657fb92f-75a4-4f51-a096-394487e79e04" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9657698c7a8ff83eba7073bafe14b7a7a65d9ffe.part /opt/stack/data/nova/instances/_base/9657698c7a8ff83eba7073bafe14b7a7a65d9ffe.converted" returned: 0 in 1.351s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9657698c7a8ff83eba7073bafe14b7a7a65d9ffe.converted --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG nova.network.neutron [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Instance cache missing network info. {{(pid=75356) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9657698c7a8ff83eba7073bafe14b7a7a65d9ffe.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "9657698c7a8ff83eba7073bafe14b7a7a65d9ffe" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.560s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9657698c7a8ff83eba7073bafe14b7a7a65d9ffe --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG nova.network.neutron [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Updating instance_info_cache with network_info: [{"id": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "address": "fa:16:3e:61:d9:cf", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a6ef65-a2", "ovs_interfaceid": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Releasing lock "refresh_cache-657fb92f-75a4-4f51-a096-394487e79e04" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG nova.compute.manager [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Instance network_info: |[{"id": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "address": "fa:16:3e:61:d9:cf", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a6ef65-a2", "ovs_interfaceid": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75356) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-658b0cc8-7552-43c2-b0f1-073fe245eb40 req-25319123-4963-445b-b295-059384e8604f service nova] Acquired lock "refresh_cache-657fb92f-75a4-4f51-a096-394487e79e04" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG nova.network.neutron [req-658b0cc8-7552-43c2-b0f1-073fe245eb40 req-25319123-4963-445b-b295-059384e8604f service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Refreshing network info cache for port 43a6ef65-a2c9-41ad-9afe-c3c6e451e280 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9657698c7a8ff83eba7073bafe14b7a7a65d9ffe --force-share --output=json" returned: 0 in 0.188s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "9657698c7a8ff83eba7073bafe14b7a7a65d9ffe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "9657698c7a8ff83eba7073bafe14b7a7a65d9ffe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9657698c7a8ff83eba7073bafe14b7a7a65d9ffe --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9657698c7a8ff83eba7073bafe14b7a7a65d9ffe --force-share --output=json" returned: 0 in 0.168s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:01:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9657698c7a8ff83eba7073bafe14b7a7a65d9ffe,backing_fmt=raw /opt/stack/data/nova/instances/657fb92f-75a4-4f51-a096-394487e79e04/disk 1073741824 {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9657698c7a8ff83eba7073bafe14b7a7a65d9ffe,backing_fmt=raw /opt/stack/data/nova/instances/657fb92f-75a4-4f51-a096-394487e79e04/disk 1073741824" returned: 0 in 0.046s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "9657698c7a8ff83eba7073bafe14b7a7a65d9ffe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9657698c7a8ff83eba7073bafe14b7a7a65d9ffe --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.network.neutron [req-658b0cc8-7552-43c2-b0f1-073fe245eb40 req-25319123-4963-445b-b295-059384e8604f service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Updated VIF entry in instance network info cache for port 43a6ef65-a2c9-41ad-9afe-c3c6e451e280. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.network.neutron [req-658b0cc8-7552-43c2-b0f1-073fe245eb40 req-25319123-4963-445b-b295-059384e8604f service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Updating instance_info_cache with network_info: [{"id": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "address": "fa:16:3e:61:d9:cf", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a6ef65-a2", "ovs_interfaceid": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-658b0cc8-7552-43c2-b0f1-073fe245eb40 req-25319123-4963-445b-b295-059384e8604f service nova] Releasing lock "refresh_cache-657fb92f-75a4-4f51-a096-394487e79e04" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9657698c7a8ff83eba7073bafe14b7a7a65d9ffe --force-share --output=json" returned: 0 in 0.197s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Created local disks {{(pid=75356) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Ensure instance console log exists: /opt/stack/data/nova/instances/657fb92f-75a4-4f51-a096-394487e79e04/console.log {{(pid=75356) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Start _get_guest_xml network_info=[{"id": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "address": "fa:16:3e:61:d9:cf", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a6ef65-a2", "ovs_interfaceid": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ce9a23b5b84bb7d76595a2a0a54f33f2',container_format='bare',created_at=2023-11-29T21:01:07Z,direct_url=<?>,disk_format='qcow2',id=39596efe-2e17-4073-8223-b0ecc7d2fb25,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1372439929',owner='12e55938263546bcb8e97bff962d6356',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T21:01:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '39596efe-2e17-4073-8223-b0ecc7d2fb25'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 21:01:19 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:01:19 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] CPU controller missing on host. {{(pid=75356) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.host [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] CPU controller found on host. {{(pid=75356) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75356) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T20:13:04Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ce9a23b5b84bb7d76595a2a0a54f33f2',container_format='bare',created_at=2023-11-29T21:01:07Z,direct_url=<?>,disk_format='qcow2',id=39596efe-2e17-4073-8223-b0ecc7d2fb25,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1372439929',owner='12e55938263546bcb8e97bff962d6356',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T21:01:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Flavor limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Image limits 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Flavor pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Image pref 0:0:0 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75356) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Got 1 possible topologies {{(pid=75356) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.hardware [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75356) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-510001192',display_name='tempest-TestStampPattern-server-510001192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-510001192',id=52,image_ref='39596efe-2e17-4073-8223-b0ecc7d2fb25',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGAFam8O0by6XSQDRfy1NdNe3iK/s41EVX/2vOG4f/avx+fZuldYPIcYw0ykNVKGY31g+OK6PLVJ/9BToxsJc6YzTuxdkUJ/LiSyuAXTM1wLeUdcFQ1eXOyB4opMKLyMA==',key_name='tempest-TestStampPattern-2006686699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12e55938263546bcb8e97bff962d6356',ramdisk_id='',reservation_id='r-af62luvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='eda4aa1e-99e7-4973-832c-6ee42077012d',image_min_disk='1',image_min_ram='0',image_owner_id='12e55938263546bcb8e97bff962d6356',image_owner_project_name='tempest-TestStampPattern-46479786',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-46479786-project-member',image_user_id='ac2b35f0b3784f51bbdb977070f922cc',network_allocated='True',owner_project_name='tempest-TestStampPattern-46479786',owner_user_name='tempest-TestStampPattern-46479786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:01:16Z,user_data=None,user_id='ac2b35f0b3784f51bbdb977070f922cc',uuid=657fb92f-75a4-4f51-a096-394487e79e04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "address": "fa:16:3e:61:d9:cf", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a6ef65-a2", "ovs_interfaceid": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75356) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Converting VIF {"id": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "address": "fa:16:3e:61:d9:cf", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a6ef65-a2", "ovs_interfaceid": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:d9:cf,bridge_name='br-int',has_traffic_filtering=True,id=43a6ef65-a2c9-41ad-9afe-c3c6e451e280,network=Network(152ef722-f2bf-4a14-84ef-0a650a2ff94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a6ef65-a2') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.objects.instance [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lazy-loading 'pci_devices' on Instance uuid 657fb92f-75a4-4f51-a096-394487e79e04 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] End _get_guest_xml xml=<domain type="kvm">
Nov 29 21:01:19 user nova-compute[75356]:   <uuid>657fb92f-75a4-4f51-a096-394487e79e04</uuid>
Nov 29 21:01:19 user nova-compute[75356]:   <name>instance-00000034</name>
Nov 29 21:01:19 user nova-compute[75356]:   <memory>524288</memory>
Nov 29 21:01:19 user nova-compute[75356]:   <vcpu>1</vcpu>
Nov 29 21:01:19 user nova-compute[75356]:   <metadata>
Nov 29 21:01:19 user nova-compute[75356]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 21:01:19 user nova-compute[75356]:       <nova:package version="0.0.0"/>
Nov 29 21:01:19 user nova-compute[75356]:       <nova:name>tempest-TestStampPattern-server-510001192</nova:name>
Nov 29 21:01:19 user nova-compute[75356]:       <nova:creationTime>2023-11-29 21:01:19</nova:creationTime>
Nov 29 21:01:19 user nova-compute[75356]:       <nova:flavor name="m1.tiny">
Nov 29 21:01:19 user nova-compute[75356]:         <nova:memory>512</nova:memory>
Nov 29 21:01:19 user nova-compute[75356]:         <nova:disk>1</nova:disk>
Nov 29 21:01:19 user nova-compute[75356]:         <nova:swap>0</nova:swap>
Nov 29 21:01:19 user nova-compute[75356]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 21:01:19 user nova-compute[75356]:         <nova:vcpus>1</nova:vcpus>
Nov 29 21:01:19 user nova-compute[75356]:       </nova:flavor>
Nov 29 21:01:19 user nova-compute[75356]:       <nova:owner>
Nov 29 21:01:19 user nova-compute[75356]:         <nova:user uuid="ac2b35f0b3784f51bbdb977070f922cc">tempest-TestStampPattern-46479786-project-member</nova:user>
Nov 29 21:01:19 user nova-compute[75356]:         <nova:project uuid="12e55938263546bcb8e97bff962d6356">tempest-TestStampPattern-46479786</nova:project>
Nov 29 21:01:19 user nova-compute[75356]:       </nova:owner>
Nov 29 21:01:19 user nova-compute[75356]:       <nova:root type="image" uuid="39596efe-2e17-4073-8223-b0ecc7d2fb25"/>
Nov 29 21:01:19 user nova-compute[75356]:       <nova:ports>
Nov 29 21:01:19 user nova-compute[75356]:         <nova:port uuid="43a6ef65-a2c9-41ad-9afe-c3c6e451e280">
Nov 29 21:01:19 user nova-compute[75356]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 21:01:19 user nova-compute[75356]:         </nova:port>
Nov 29 21:01:19 user nova-compute[75356]:       </nova:ports>
Nov 29 21:01:19 user nova-compute[75356]:     </nova:instance>
Nov 29 21:01:19 user nova-compute[75356]:   </metadata>
Nov 29 21:01:19 user nova-compute[75356]:   <sysinfo type="smbios">
Nov 29 21:01:19 user nova-compute[75356]:     <system>
Nov 29 21:01:19 user nova-compute[75356]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 21:01:19 user nova-compute[75356]:       <entry name="product">OpenStack Nova</entry>
Nov 29 21:01:19 user nova-compute[75356]:       <entry name="version">0.0.0</entry>
Nov 29 21:01:19 user nova-compute[75356]:       <entry name="serial">657fb92f-75a4-4f51-a096-394487e79e04</entry>
Nov 29 21:01:19 user nova-compute[75356]:       <entry name="uuid">657fb92f-75a4-4f51-a096-394487e79e04</entry>
Nov 29 21:01:19 user nova-compute[75356]:       <entry name="family">Virtual Machine</entry>
Nov 29 21:01:19 user nova-compute[75356]:     </system>
Nov 29 21:01:19 user nova-compute[75356]:   </sysinfo>
Nov 29 21:01:19 user nova-compute[75356]:   <os>
Nov 29 21:01:19 user nova-compute[75356]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 21:01:19 user nova-compute[75356]:     <boot dev="hd"/>
Nov 29 21:01:19 user nova-compute[75356]:     <smbios mode="sysinfo"/>
Nov 29 21:01:19 user nova-compute[75356]:   </os>
Nov 29 21:01:19 user nova-compute[75356]:   <features>
Nov 29 21:01:19 user nova-compute[75356]:     <acpi/>
Nov 29 21:01:19 user nova-compute[75356]:     <apic/>
Nov 29 21:01:19 user nova-compute[75356]:     <vmcoreinfo/>
Nov 29 21:01:19 user nova-compute[75356]:   </features>
Nov 29 21:01:19 user nova-compute[75356]:   <clock offset="utc">
Nov 29 21:01:19 user nova-compute[75356]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 21:01:19 user nova-compute[75356]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 21:01:19 user nova-compute[75356]:     <timer name="hpet" present="no"/>
Nov 29 21:01:19 user nova-compute[75356]:   </clock>
Nov 29 21:01:19 user nova-compute[75356]:   <cpu mode="custom" match="exact">
Nov 29 21:01:19 user nova-compute[75356]:     <model>Nehalem</model>
Nov 29 21:01:19 user nova-compute[75356]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 21:01:19 user nova-compute[75356]:   </cpu>
Nov 29 21:01:19 user nova-compute[75356]:   <devices>
Nov 29 21:01:19 user nova-compute[75356]:     <disk type="file" device="disk">
Nov 29 21:01:19 user nova-compute[75356]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 21:01:19 user nova-compute[75356]:       <source file="/opt/stack/data/nova/instances/657fb92f-75a4-4f51-a096-394487e79e04/disk"/>
Nov 29 21:01:19 user nova-compute[75356]:       <target dev="vda" bus="virtio"/>
Nov 29 21:01:19 user nova-compute[75356]:     </disk>
Nov 29 21:01:19 user nova-compute[75356]:     <interface type="ethernet">
Nov 29 21:01:19 user nova-compute[75356]:       <mac address="fa:16:3e:61:d9:cf"/>
Nov 29 21:01:19 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 21:01:19 user nova-compute[75356]:       <mtu size="1442"/>
Nov 29 21:01:19 user nova-compute[75356]:       <target dev="tap43a6ef65-a2"/>
Nov 29 21:01:19 user nova-compute[75356]:     </interface>
Nov 29 21:01:19 user nova-compute[75356]:     <serial type="pty">
Nov 29 21:01:19 user nova-compute[75356]:       <log file="/opt/stack/data/nova/instances/657fb92f-75a4-4f51-a096-394487e79e04/console.log" append="off"/>
Nov 29 21:01:19 user nova-compute[75356]:     </serial>
Nov 29 21:01:19 user nova-compute[75356]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 21:01:19 user nova-compute[75356]:     <video>
Nov 29 21:01:19 user nova-compute[75356]:       <model type="virtio"/>
Nov 29 21:01:19 user nova-compute[75356]:     </video>
Nov 29 21:01:19 user nova-compute[75356]:     <rng model="virtio">
Nov 29 21:01:19 user nova-compute[75356]:       <backend model="random">/dev/urandom</backend>
Nov 29 21:01:19 user nova-compute[75356]:     </rng>
Nov 29 21:01:19 user nova-compute[75356]:     <controller type="usb" index="0" model="none"/>
Nov 29 21:01:19 user nova-compute[75356]:     <memballoon model="virtio">
Nov 29 21:01:19 user nova-compute[75356]:       <stats period="10"/>
Nov 29 21:01:19 user nova-compute[75356]:     </memballoon>
Nov 29 21:01:19 user nova-compute[75356]:   </devices>
Nov 29 21:01:19 user nova-compute[75356]: </domain>
Nov 29 21:01:19 user nova-compute[75356]:  {{(pid=75356) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-510001192',display_name='tempest-TestStampPattern-server-510001192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-510001192',id=52,image_ref='39596efe-2e17-4073-8223-b0ecc7d2fb25',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGAFam8O0by6XSQDRfy1NdNe3iK/s41EVX/2vOG4f/avx+fZuldYPIcYw0ykNVKGY31g+OK6PLVJ/9BToxsJc6YzTuxdkUJ/LiSyuAXTM1wLeUdcFQ1eXOyB4opMKLyMA==',key_name='tempest-TestStampPattern-2006686699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12e55938263546bcb8e97bff962d6356',ramdisk_id='',reservation_id='r-af62luvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='eda4aa1e-99e7-4973-832c-6ee42077012d',image_min_disk='1',image_min_ram='0',image_owner_id='12e55938263546bcb8e97bff962d6356',image_owner_project_name='tempest-TestStampPattern-46479786',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-46479786-project-member',image_user_id='ac2b35f0b3784f51bbdb977070f922cc',network_allocated='True',owner_project_name='tempest-TestStampPattern-46479786',owner_user_name='tempest-TestStampPattern-46479786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T21:01:16Z,user_data=None,user_id='ac2b35f0b3784f51bbdb977070f922cc',uuid=657fb92f-75a4-4f51-a096-394487e79e04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "address": "fa:16:3e:61:d9:cf", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a6ef65-a2", "ovs_interfaceid": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Converting VIF {"id": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "address": "fa:16:3e:61:d9:cf", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a6ef65-a2", "ovs_interfaceid": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:d9:cf,bridge_name='br-int',has_traffic_filtering=True,id=43a6ef65-a2c9-41ad-9afe-c3c6e451e280,network=Network(152ef722-f2bf-4a14-84ef-0a650a2ff94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a6ef65-a2') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG os_vif [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:d9:cf,bridge_name='br-int',has_traffic_filtering=True,id=43a6ef65-a2c9-41ad-9afe-c3c6e451e280,network=Network(152ef722-f2bf-4a14-84ef-0a650a2ff94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a6ef65-a2') {{(pid=75356) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11dfe1a1-7c6f-5b3e-b379-3c70df1c35eb', '_type': 'linux-noop'}}, row=False) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43a6ef65-a2, may_exist=True, interface_attrs={}) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43a6ef65-a2, col_values=(('qos', UUID('2b9c4820-fcd3-4b05-9671-cfb358beba32')),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43a6ef65-a2, col_values=(('external_ids', {'iface-id': '43a6ef65-a2c9-41ad-9afe-c3c6e451e280', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:d9:cf', 'vm-uuid': '657fb92f-75a4-4f51-a096-394487e79e04'}),), if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:19 user nova-compute[75356]: INFO os_vif [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:d9:cf,bridge_name='br-int',has_traffic_filtering=True,id=43a6ef65-a2c9-41ad-9afe-c3c6e451e280,network=Network(152ef722-f2bf-4a14-84ef-0a650a2ff94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a6ef65-a2')
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:01:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] No VIF found with MAC fa:16:3e:61:d9:cf, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:01:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:20 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-41c004d2-4506-42ab-a0b9-6c01c1d57a05 req-cad6e950-7851-44e8-a218-71c81bde77ed service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Received event network-vif-plugged-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:01:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-41c004d2-4506-42ab-a0b9-6c01c1d57a05 req-cad6e950-7851-44e8-a218-71c81bde77ed service nova] Acquiring lock "657fb92f-75a4-4f51-a096-394487e79e04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:01:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-41c004d2-4506-42ab-a0b9-6c01c1d57a05 req-cad6e950-7851-44e8-a218-71c81bde77ed service nova] Lock "657fb92f-75a4-4f51-a096-394487e79e04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:01:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-41c004d2-4506-42ab-a0b9-6c01c1d57a05 req-cad6e950-7851-44e8-a218-71c81bde77ed service nova] Lock "657fb92f-75a4-4f51-a096-394487e79e04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:01:20 user nova-compute[75356]: DEBUG nova.compute.manager [req-41c004d2-4506-42ab-a0b9-6c01c1d57a05 req-cad6e950-7851-44e8-a218-71c81bde77ed service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] No waiting events found dispatching network-vif-plugged-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:01:20 user nova-compute[75356]: WARNING nova.compute.manager [req-41c004d2-4506-42ab-a0b9-6c01c1d57a05 req-cad6e950-7851-44e8-a218-71c81bde77ed service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Received unexpected event network-vif-plugged-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 for instance with vm_state building and task_state spawning.
Nov 29 21:01:22 user nova-compute[75356]: DEBUG nova.compute.manager [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Instance event wait completed in 0 seconds for  {{(pid=75356) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 21:01:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Guest created on hypervisor {{(pid=75356) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 21:01:22 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Instance spawned successfully.
Nov 29 21:01:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 21:01:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Found default for hw_input_bus of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:01:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Found default for hw_pointer_model of None {{(pid=75356) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 21:01:22 user nova-compute[75356]: INFO nova.compute.manager [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Took 6.68 seconds to spawn the instance on the hypervisor.
Nov 29 21:01:22 user nova-compute[75356]: DEBUG nova.compute.manager [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Checking state {{(pid=75356) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 21:01:22 user nova-compute[75356]: INFO nova.compute.manager [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Took 7.19 seconds to build instance.
Nov 29 21:01:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-04cd6d3b-8ae6-4409-9cc6-1d1ffb422b6d tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "657fb92f-75a4-4f51-a096-394487e79e04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.290s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:01:22 user nova-compute[75356]: DEBUG nova.compute.manager [req-9e29c054-56de-41e7-a6a4-8c941f2265ef req-115cec25-2914-45c0-99e6-3b2196e951c0 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Received event network-vif-plugged-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:01:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9e29c054-56de-41e7-a6a4-8c941f2265ef req-115cec25-2914-45c0-99e6-3b2196e951c0 service nova] Acquiring lock "657fb92f-75a4-4f51-a096-394487e79e04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:01:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9e29c054-56de-41e7-a6a4-8c941f2265ef req-115cec25-2914-45c0-99e6-3b2196e951c0 service nova] Lock "657fb92f-75a4-4f51-a096-394487e79e04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:01:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-9e29c054-56de-41e7-a6a4-8c941f2265ef req-115cec25-2914-45c0-99e6-3b2196e951c0 service nova] Lock "657fb92f-75a4-4f51-a096-394487e79e04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:01:22 user nova-compute[75356]: DEBUG nova.compute.manager [req-9e29c054-56de-41e7-a6a4-8c941f2265ef req-115cec25-2914-45c0-99e6-3b2196e951c0 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] No waiting events found dispatching network-vif-plugged-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:01:22 user nova-compute[75356]: WARNING nova.compute.manager [req-9e29c054-56de-41e7-a6a4-8c941f2265ef req-115cec25-2914-45c0-99e6-3b2196e951c0 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Received unexpected event network-vif-plugged-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 for instance with vm_state active and task_state None.
Nov 29 21:01:23 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:01:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:28 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:01:28 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:01:28 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 21:01:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:01:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:01:28 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 21:01:28 user nova-compute[75356]: DEBUG nova.objects.instance [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lazy-loading 'info_cache' on Instance uuid eda4aa1e-99e7-4973-832c-6ee42077012d {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:01:28 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Updating instance_info_cache with network_info: [{"id": "6859890f-25ac-4378-a758-58da0db29b49", "address": "fa:16:3e:04:d5:a0", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6859890f-25", "ovs_interfaceid": "6859890f-25ac-4378-a758-58da0db29b49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:01:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:01:28 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 21:01:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:01:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:01:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:01:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:01:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:01:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:31 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:01:31 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:01:33 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:01:34 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:01:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:01:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:01:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:01:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:01:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:36 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:01:36 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:01:36 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:01:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:01:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:01:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:01:36 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:01:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/657fb92f-75a4-4f51-a096-394487e79e04/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:01:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/657fb92f-75a4-4f51-a096-394487e79e04/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:01:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/657fb92f-75a4-4f51-a096-394487e79e04/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:01:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/657fb92f-75a4-4f51-a096-394487e79e04/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:01:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:01:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:01:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:01:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:01:37 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:01:37 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:01:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=8892MB free_disk=24.92641830444336GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:01:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:01:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:01:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance eda4aa1e-99e7-4973-832c-6ee42077012d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:01:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 657fb92f-75a4-4f51-a096-394487e79e04 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:01:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:01:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:01:37 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:01:37 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:01:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:01:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:01:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:38 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:01:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:43 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:44 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:01:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:48 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:53 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:01:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:02:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:02:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:02:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:02:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:02:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:02:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:02:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:02:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:02:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:02:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:02:25 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:02:28 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:02:28 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:02:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-657fb92f-75a4-4f51-a096-394487e79e04" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:02:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-657fb92f-75a4-4f51-a096-394487e79e04" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:02:28 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 21:02:28 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Updating instance_info_cache with network_info: [{"id": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "address": "fa:16:3e:61:d9:cf", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a6ef65-a2", "ovs_interfaceid": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:02:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-657fb92f-75a4-4f51-a096-394487e79e04" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:02:28 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 21:02:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:02:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:02:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:02:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:02:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:02:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:02:31 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:02:31 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:02:33 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:02:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:02:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:02:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:02:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:02:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:02:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:02:36 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:02:36 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:02:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:02:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:02:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:02:36 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:02:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/657fb92f-75a4-4f51-a096-394487e79e04/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:02:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/657fb92f-75a4-4f51-a096-394487e79e04/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:02:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/657fb92f-75a4-4f51-a096-394487e79e04/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:02:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/657fb92f-75a4-4f51-a096-394487e79e04/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:02:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:02:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:02:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:02:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:02:37 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:02:37 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:02:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=8993MB free_disk=24.917598724365234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:02:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:02:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:02:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance eda4aa1e-99e7-4973-832c-6ee42077012d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:02:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 657fb92f-75a4-4f51-a096-394487e79e04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:02:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:02:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:02:37 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:02:37 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:02:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:02:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:02:38 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:02:38 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:02:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:02:44 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:02:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:02:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:02:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:02:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:02:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:02:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:02:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:02:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:02:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:02:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:02:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:02:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:02:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:02:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:03:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:03:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:03:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:03:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:03:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:03:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:03:06 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:03:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-da1bd15b-4273-4093-b0d1-c1abb39ef36a req-4d30e2b6-4752-4153-944a-ae90a4d9cd13 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Received event network-changed-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:03:07 user nova-compute[75356]: DEBUG nova.compute.manager [req-da1bd15b-4273-4093-b0d1-c1abb39ef36a req-4d30e2b6-4752-4153-944a-ae90a4d9cd13 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Refreshing instance network info cache due to event network-changed-43a6ef65-a2c9-41ad-9afe-c3c6e451e280. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:03:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-da1bd15b-4273-4093-b0d1-c1abb39ef36a req-4d30e2b6-4752-4153-944a-ae90a4d9cd13 service nova] Acquiring lock "refresh_cache-657fb92f-75a4-4f51-a096-394487e79e04" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:03:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-da1bd15b-4273-4093-b0d1-c1abb39ef36a req-4d30e2b6-4752-4153-944a-ae90a4d9cd13 service nova] Acquired lock "refresh_cache-657fb92f-75a4-4f51-a096-394487e79e04" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:03:07 user nova-compute[75356]: DEBUG nova.network.neutron [req-da1bd15b-4273-4093-b0d1-c1abb39ef36a req-4d30e2b6-4752-4153-944a-ae90a4d9cd13 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Refreshing network info cache for port 43a6ef65-a2c9-41ad-9afe-c3c6e451e280 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:03:07 user nova-compute[75356]: DEBUG nova.network.neutron [req-da1bd15b-4273-4093-b0d1-c1abb39ef36a req-4d30e2b6-4752-4153-944a-ae90a4d9cd13 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Updated VIF entry in instance network info cache for port 43a6ef65-a2c9-41ad-9afe-c3c6e451e280. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:03:07 user nova-compute[75356]: DEBUG nova.network.neutron [req-da1bd15b-4273-4093-b0d1-c1abb39ef36a req-4d30e2b6-4752-4153-944a-ae90a4d9cd13 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Updating instance_info_cache with network_info: [{"id": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "address": "fa:16:3e:61:d9:cf", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a6ef65-a2", "ovs_interfaceid": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:03:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-da1bd15b-4273-4093-b0d1-c1abb39ef36a req-4d30e2b6-4752-4153-944a-ae90a4d9cd13 service nova] Releasing lock "refresh_cache-657fb92f-75a4-4f51-a096-394487e79e04" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:03:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "657fb92f-75a4-4f51-a096-394487e79e04" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:03:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "657fb92f-75a4-4f51-a096-394487e79e04" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:03:07 user nova-compute[75356]: DEBUG nova.objects.instance [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lazy-loading 'flavor' on Instance uuid 657fb92f-75a4-4f51-a096-394487e79e04 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:03:07 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "657fb92f-75a4-4f51-a096-394487e79e04" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:03:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "657fb92f-75a4-4f51-a096-394487e79e04" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:03:08 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "657fb92f-75a4-4f51-a096-394487e79e04" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:03:08 user nova-compute[75356]: INFO nova.compute.manager [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Attaching volume d20a2fd8-0554-4727-9e51-e07a33fb3f31 to /dev/vdb
Nov 29 21:03:08 user nova-compute[75356]: DEBUG os_brick.utils [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:03:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fbbf53-e4b3-4d0e-ba38-69ed1331d9a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f27ec815b78\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98c9c2e-9f7c-4d95-acf1-9e4efba843ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d218e4-395c-42db-b993-1c904a9e8f32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[8976ef87-2299-4550-948b-e0beaa8b6376]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Running cmd (subprocess): nvme version {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] 'nvme version' failed. Not Retrying. {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:03:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] nvme not present on system {{(pid=75356) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 21:03:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:08 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 21:03:08 user nova-compute[75356]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 21:03:08 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[187120b1-a048-4ec0-b3c5-59fd4250b87a]: (4, '') {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75356) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 21:03:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 21:03:08 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.lightos [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] LIGHTOS: no hostnqn found. {{(pid=75356) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 21:03:08 user nova-compute[75356]: DEBUG os_brick.utils [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f27ec815b78', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:03:08 user nova-compute[75356]: DEBUG nova.virt.block_device [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Updating existing volume attachment record: e8af993c-cf78-4324-aa88-9d97824ff5ae {{(pid=75356) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 21:03:08 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:03:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:03:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:03:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Calling os-brick to attach iSCSI Volume {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrAiVmNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:03:18 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:03:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:03:18 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:03:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:03:18 user nova-compute[75356]: INFO os_brick.initiator.connectors.iscsi [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 -p 172.16.0.220:3260 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ef90c6-efb2-4238-9578-9074e01dacbc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 21:03:18 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 -p 172.16.0.220:3260 --interface default --op new {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[42025abd-6720-4eb9-bf59-be261591b0d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31] added\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31] added
Nov 29 21:03:18 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a705a723-7a08-4f95-ab2c-a91a8a71c7bc]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11ebe2e-7aa7-4ed3-8eab-c01898e5c7ab]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrAiVmNW {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FrAiVmNW" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[19524069-2f48-4b22-b087-5c67e6c48fa8]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FrAiVmNW'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ea2e54-58a8-4403-801c-4540c15da0c5]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a70ebac-f966-4d8e-9c6c-e59bb3ab6925]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 21:03:18 user nova-compute[75356]:  {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 21:03:18 user nova-compute[75356]:  {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:03:18 user nova-compute[75356]: WARNING os_brick.initiator.connectors.iscsi [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 21:03:18 user nova-compute[75356]: 
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 -p 172.16.0.220:3260 --login {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce60d144-68a4-431c-84b0-089f65bb296b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31, portal: 172.16.0.220,3260]
Nov 29 21:03:18 user nova-compute[75356]: Login to [iface: default, target: iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31, portal: 172.16.0.220,3260] successful.
Nov 29 21:03:18 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a37c39d-1870-4e93-83e8-d702b78245cf]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d063007-7796-44d9-9b76-1720c499c727]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 (non-flash)
Nov 29 21:03:18 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 (non-flash)
Nov 29 21:03:18 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Connected to 172.16.0.220:3260 {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75356) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75356) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[d489fa15-8c85-40a8-a1fd-931c2483a030]: (4, ('- - 0', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75356) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 21:03:18 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrAiVmNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75356) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 21:03:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:03:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:03:19 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '26639383730326530', 'path': '/dev/sdb'} {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:03:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639383730326530', 'path': '/dev/sdb'} {{(pid=75356) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 21:03:19 user nova-compute[75356]: DEBUG nova.objects.instance [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lazy-loading 'flavor' on Instance uuid 657fb92f-75a4-4f51-a096-394487e79e04 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:03:19 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 21:03:19 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:03:19 user nova-compute[75356]:   <source dev="/dev/sdb"/>
Nov 29 21:03:19 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:03:19 user nova-compute[75356]:   <serial>d20a2fd8-0554-4727-9e51-e07a33fb3f31</serial>
Nov 29 21:03:19 user nova-compute[75356]: </disk>
Nov 29 21:03:19 user nova-compute[75356]:  {{(pid=75356) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 21:03:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] No BDM found with device name vda, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:03:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75356) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 21:03:20 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] No VIF found with MAC fa:16:3e:61:d9:cf, not building metadata {{(pid=75356) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 21:03:20 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-70d1df31-ad7c-495b-a9a7-a490b8ddefd5 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "657fb92f-75a4-4f51-a096-394487e79e04" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.038s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:03:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "657fb92f-75a4-4f51-a096-394487e79e04" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:03:22 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "657fb92f-75a4-4f51-a096-394487e79e04" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:03:22 user nova-compute[75356]: INFO nova.compute.manager [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Detaching volume d20a2fd8-0554-4727-9e51-e07a33fb3f31
Nov 29 21:03:22 user nova-compute[75356]: INFO nova.virt.block_device [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Attempting to driver detach volume d20a2fd8-0554-4727-9e51-e07a33fb3f31 from mountpoint /dev/vdb
Nov 29 21:03:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Attempting to detach device vdb from instance 657fb92f-75a4-4f51-a096-394487e79e04 from the persistent domain config. {{(pid=75356) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 21:03:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:03:22 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:03:22 user nova-compute[75356]:   <source dev="/dev/sdb"/>
Nov 29 21:03:22 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:03:22 user nova-compute[75356]:   <serial>d20a2fd8-0554-4727-9e51-e07a33fb3f31</serial>
Nov 29 21:03:22 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 21:03:22 user nova-compute[75356]: </disk>
Nov 29 21:03:22 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:03:22 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Successfully detached device vdb from instance 657fb92f-75a4-4f51-a096-394487e79e04 from the persistent domain config.
Nov 29 21:03:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 657fb92f-75a4-4f51-a096-394487e79e04 from the live domain config. {{(pid=75356) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 21:03:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.guest [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 21:03:22 user nova-compute[75356]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 21:03:22 user nova-compute[75356]:   <source dev="/dev/sdb"/>
Nov 29 21:03:22 user nova-compute[75356]:   <target dev="vdb" bus="virtio"/>
Nov 29 21:03:22 user nova-compute[75356]:   <serial>d20a2fd8-0554-4727-9e51-e07a33fb3f31</serial>
Nov 29 21:03:22 user nova-compute[75356]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 21:03:22 user nova-compute[75356]: </disk>
Nov 29 21:03:22 user nova-compute[75356]:  {{(pid=75356) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 21:03:22 user nova-compute[75356]: DEBUG nova.virt.libvirt.driver [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 657fb92f-75a4-4f51-a096-394487e79e04 {{(pid=75356) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 21:03:23 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:03:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:03:27 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:03:28 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:03:28 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:03:28 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 21:03:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:03:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquired lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:03:28 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Forcefully refreshing network info cache for instance {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 21:03:28 user nova-compute[75356]: DEBUG nova.objects.instance [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lazy-loading 'info_cache' on Instance uuid eda4aa1e-99e7-4973-832c-6ee42077012d {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:03:28 user nova-compute[75356]: DEBUG nova.network.neutron [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Updating instance_info_cache with network_info: [{"id": "6859890f-25ac-4378-a758-58da0db29b49", "address": "fa:16:3e:04:d5:a0", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6859890f-25", "ovs_interfaceid": "6859890f-25ac-4378-a758-58da0db29b49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:03:28 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Releasing lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:03:28 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Updated the network info_cache for instance {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 21:03:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:03:31 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:03:31 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:03:33 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:03:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:03:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:03:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:03:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:03:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:03:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:03:36 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:03:36 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:03:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:03:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:03:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:03:36 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:03:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/657fb92f-75a4-4f51-a096-394487e79e04/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/657fb92f-75a4-4f51-a096-394487e79e04/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/657fb92f-75a4-4f51-a096-394487e79e04/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/657fb92f-75a4-4f51-a096-394487e79e04/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:37 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:37 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:03:37 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:03:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=8996MB free_disk=24.916522979736328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:03:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:03:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:03:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance eda4aa1e-99e7-4973-832c-6ee42077012d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:03:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance 657fb92f-75a4-4f51-a096-394487e79e04 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:03:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:03:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:03:37 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing inventories for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 21:03:37 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Updating ProviderTree inventory for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 21:03:37 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Updating inventory in ProviderTree for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 21:03:37 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing aggregate associations for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a, aggregates: None {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 21:03:37 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Refreshing trait associations for resource provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a, traits: COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=75356) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 21:03:37 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:03:37 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:03:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:03:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:03:38 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:03:38 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:03:38 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:03:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:03:40 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:03:42 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 657fb92f-75a4-4f51-a096-394487e79e04 is timed out.
Nov 29 21:03:42 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Successfully detached device vdb from instance 657fb92f-75a4-4f51-a096-394487e79e04 from the live domain config.
Nov 29 21:03:42 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] calling os-brick to detach iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 21:03:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f83084be290>, {'target_iqn': 'iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FrAiVmNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 21:03:42 user nova-compute[75356]: WARNING os_brick.initiator.connectors.base [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 21:03:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 21:03:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 21:03:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a223264-2f6a-4fa6-8baf-472c5ce5be54]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 21:03:42 user nova-compute[75356]: No targets found.
Nov 29 21:03:42 user nova-compute[75356]: iSNS:
Nov 29 21:03:42 user nova-compute[75356]: No targets found.
Nov 29 21:03:42 user nova-compute[75356]: STATIC:
Nov 29 21:03:42 user nova-compute[75356]: Target: iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31
Nov 29 21:03:42 user nova-compute[75356]:         Portal: 172.16.0.220:3260,-1
Nov 29 21:03:42 user nova-compute[75356]:                 Iface Name: default
Nov 29 21:03:42 user nova-compute[75356]: FIRMWARE:
Nov 29 21:03:42 user nova-compute[75356]: No targets found.
Nov 29 21:03:42 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:03:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 21:03:42 user nova-compute[75356]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 21:03:42 user nova-compute[75356]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75356) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 21:03:42 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31', 0)] {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 21:03:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:42 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:42 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ce9e02-991c-486e-8764-1a69ed07f771]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c61bc5-518b-4618-b927-def1994889e7]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 (non-flash)\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 (non-flash)
Nov 29 21:03:43 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 (non-flash)
Nov 29 21:03:43 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82e44c39a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31'): ({'sdb'}, set())}) {{(pid=75356) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Removing single pathed devices sdb {{(pid=75356) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d2ff11-a8e4-4f30-8b66-c10670848135]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb76d49e-aed0-400a-b27d-dd34b243e395]: (4, ('ok\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Flushing IO for device /dev/sdb {{(pid=75356) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c81bef-dfe4-4be9-879e-dcb3d5576f4a]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75356) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a52e6e-a42c-4de0-8e07-b21db186c44a]: (4, ('1', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG os_brick.initiator.linuxscsi [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] SCSI volumes sdb have been removed. {{(pid=75356) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31')] {{(pid=75356) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdabf7f5-a4a6-4cd1-b226-860db39535f5]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 -p 172.16.0.220:3260 --logout {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[03193e71-9f83-477e-bf89-61442e64c08a]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31, portal: 172.16.0.220,3260]
Nov 29 21:03:43 user nova-compute[75356]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31, portal: 172.16.0.220,3260] successful.
Nov 29 21:03:43 user nova-compute[75356]:  stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 -p 172.16.0.220:3260 --op delete {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d20a2fd8-0554-4727-9e51-e07a33fb3f31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG oslo.privsep.daemon [-] privsep: reply[f926864f-9b81-4695-b7ef-e436555a9f03]: (4, ('', '')) {{(pid=86863) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75356) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.base [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG os_brick.initiator.connectors.iscsi [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] <== disconnect_volume: return (286ms) None {{(pid=75356) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 21:03:43 user nova-compute[75356]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Disconnected iSCSI Volume {{(pid=75356) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 21:03:44 user nova-compute[75356]: DEBUG nova.objects.instance [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lazy-loading 'flavor' on Instance uuid 657fb92f-75a4-4f51-a096-394487e79e04 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:03:44 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-7efd645f-a77e-4e91-9e7a-20d8aad5176e tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "657fb92f-75a4-4f51-a096-394487e79e04" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.624s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:03:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:03:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:03:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:03:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:03:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:03:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:03:45 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:03:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:03:52 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:03:52 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75356) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 21:03:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:03:55 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:03:55 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Cleaning up deleted instances {{(pid=75356) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 21:03:55 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] There are 0 instances to clean {{(pid=75356) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 21:03:57 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:03:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:03:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:03:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:03:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:03:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:03:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:04:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:04:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:04:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:04:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:04:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:04:12 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-d0c4dc5f-0300-49f5-9d35-b9d31b50ffa4 req-a8cecb6d-7fd9-4252-a43b-1692514bf943 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Received event network-changed-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:04:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-d0c4dc5f-0300-49f5-9d35-b9d31b50ffa4 req-a8cecb6d-7fd9-4252-a43b-1692514bf943 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Refreshing instance network info cache due to event network-changed-43a6ef65-a2c9-41ad-9afe-c3c6e451e280. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:04:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d0c4dc5f-0300-49f5-9d35-b9d31b50ffa4 req-a8cecb6d-7fd9-4252-a43b-1692514bf943 service nova] Acquiring lock "refresh_cache-657fb92f-75a4-4f51-a096-394487e79e04" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:04:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d0c4dc5f-0300-49f5-9d35-b9d31b50ffa4 req-a8cecb6d-7fd9-4252-a43b-1692514bf943 service nova] Acquired lock "refresh_cache-657fb92f-75a4-4f51-a096-394487e79e04" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:04:13 user nova-compute[75356]: DEBUG nova.network.neutron [req-d0c4dc5f-0300-49f5-9d35-b9d31b50ffa4 req-a8cecb6d-7fd9-4252-a43b-1692514bf943 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Refreshing network info cache for port 43a6ef65-a2c9-41ad-9afe-c3c6e451e280 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:04:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "657fb92f-75a4-4f51-a096-394487e79e04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:04:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "657fb92f-75a4-4f51-a096-394487e79e04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:04:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "657fb92f-75a4-4f51-a096-394487e79e04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:04:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "657fb92f-75a4-4f51-a096-394487e79e04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:04:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "657fb92f-75a4-4f51-a096-394487e79e04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:04:13 user nova-compute[75356]: INFO nova.compute.manager [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Terminating instance
Nov 29 21:04:13 user nova-compute[75356]: DEBUG nova.compute.manager [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:04:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:13 user nova-compute[75356]: DEBUG nova.network.neutron [req-d0c4dc5f-0300-49f5-9d35-b9d31b50ffa4 req-a8cecb6d-7fd9-4252-a43b-1692514bf943 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Updated VIF entry in instance network info cache for port 43a6ef65-a2c9-41ad-9afe-c3c6e451e280. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:04:13 user nova-compute[75356]: DEBUG nova.network.neutron [req-d0c4dc5f-0300-49f5-9d35-b9d31b50ffa4 req-a8cecb6d-7fd9-4252-a43b-1692514bf943 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Updating instance_info_cache with network_info: [{"id": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "address": "fa:16:3e:61:d9:cf", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a6ef65-a2", "ovs_interfaceid": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:04:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-d0c4dc5f-0300-49f5-9d35-b9d31b50ffa4 req-a8cecb6d-7fd9-4252-a43b-1692514bf943 service nova] Releasing lock "refresh_cache-657fb92f-75a4-4f51-a096-394487e79e04" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:04:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:14 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Instance destroyed successfully.
Nov 29 21:04:14 user nova-compute[75356]: DEBUG nova.objects.instance [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lazy-loading 'resources' on Instance uuid 657fb92f-75a4-4f51-a096-394487e79e04 {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:04:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T21:01:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-510001192',display_name='tempest-TestStampPattern-server-510001192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-510001192',id=52,image_ref='39596efe-2e17-4073-8223-b0ecc7d2fb25',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGAFam8O0by6XSQDRfy1NdNe3iK/s41EVX/2vOG4f/avx+fZuldYPIcYw0ykNVKGY31g+OK6PLVJ/9BToxsJc6YzTuxdkUJ/LiSyuAXTM1wLeUdcFQ1eXOyB4opMKLyMA==',key_name='tempest-TestStampPattern-2006686699',keypairs=<?>,launch_index=0,launched_at=2023-11-29T21:01:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12e55938263546bcb8e97bff962d6356',ramdisk_id='',reservation_id='r-af62luvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='eda4aa1e-99e7-4973-832c-6ee42077012d',image_min_disk='1',image_min_ram='0',image_owner_id='12e55938263546bcb8e97bff962d6356',image_owner_project_name='tempest-TestStampPattern-46479786',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-46479786-project-member',image_user_id='ac2b35f0b3784f51bbdb977070f922cc',owner_project_name='tempest-TestStampPattern-46479786',owner_user_name='tempest-TestStampPattern-46479786-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:01:23Z,user_data=None,user_id='ac2b35f0b3784f51bbdb977070f922cc',uuid=657fb92f-75a4-4f51-a096-394487e79e04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "address": "fa:16:3e:61:d9:cf", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a6ef65-a2", "ovs_interfaceid": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:04:14 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Converting VIF {"id": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "address": "fa:16:3e:61:d9:cf", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43a6ef65-a2", "ovs_interfaceid": "43a6ef65-a2c9-41ad-9afe-c3c6e451e280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:04:14 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:d9:cf,bridge_name='br-int',has_traffic_filtering=True,id=43a6ef65-a2c9-41ad-9afe-c3c6e451e280,network=Network(152ef722-f2bf-4a14-84ef-0a650a2ff94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a6ef65-a2') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:04:14 user nova-compute[75356]: DEBUG os_vif [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:d9:cf,bridge_name='br-int',has_traffic_filtering=True,id=43a6ef65-a2c9-41ad-9afe-c3c6e451e280,network=Network(152ef722-f2bf-4a14-84ef-0a650a2ff94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a6ef65-a2') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:04:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43a6ef65-a2, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:04:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:04:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b9c4820-fcd3-4b05-9671-cfb358beba32) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:04:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:04:14 user nova-compute[75356]: INFO os_vif [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:d9:cf,bridge_name='br-int',has_traffic_filtering=True,id=43a6ef65-a2c9-41ad-9afe-c3c6e451e280,network=Network(152ef722-f2bf-4a14-84ef-0a650a2ff94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43a6ef65-a2')
Nov 29 21:04:14 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Deleting instance files /opt/stack/data/nova/instances/657fb92f-75a4-4f51-a096-394487e79e04_del
Nov 29 21:04:14 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Deletion of /opt/stack/data/nova/instances/657fb92f-75a4-4f51-a096-394487e79e04_del complete
Nov 29 21:04:14 user nova-compute[75356]: INFO nova.compute.manager [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 21:04:14 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:04:14 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:04:14 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:04:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:14 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:04:14 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Took 0.65 seconds to deallocate network for instance.
Nov 29 21:04:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:04:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:04:14 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:04:14 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:04:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:04:15 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Deleted allocations for instance 657fb92f-75a4-4f51-a096-394487e79e04
Nov 29 21:04:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-aed1a891-1ece-4669-92de-3802017593b2 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "657fb92f-75a4-4f51-a096-394487e79e04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.866s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:04:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Received event network-vif-unplugged-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:04:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] Acquiring lock "657fb92f-75a4-4f51-a096-394487e79e04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:04:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] Lock "657fb92f-75a4-4f51-a096-394487e79e04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:04:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] Lock "657fb92f-75a4-4f51-a096-394487e79e04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:04:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] No waiting events found dispatching network-vif-unplugged-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:04:15 user nova-compute[75356]: WARNING nova.compute.manager [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Received unexpected event network-vif-unplugged-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 for instance with vm_state deleted and task_state None.
Nov 29 21:04:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Received event network-vif-plugged-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:04:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] Acquiring lock "657fb92f-75a4-4f51-a096-394487e79e04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:04:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] Lock "657fb92f-75a4-4f51-a096-394487e79e04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:04:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] Lock "657fb92f-75a4-4f51-a096-394487e79e04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:04:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] No waiting events found dispatching network-vif-plugged-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:04:15 user nova-compute[75356]: WARNING nova.compute.manager [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Received unexpected event network-vif-plugged-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 for instance with vm_state deleted and task_state None.
Nov 29 21:04:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Received event network-vif-plugged-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:04:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] Acquiring lock "657fb92f-75a4-4f51-a096-394487e79e04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:04:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] Lock "657fb92f-75a4-4f51-a096-394487e79e04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:04:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] Lock "657fb92f-75a4-4f51-a096-394487e79e04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:04:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] No waiting events found dispatching network-vif-plugged-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:04:15 user nova-compute[75356]: WARNING nova.compute.manager [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Received unexpected event network-vif-plugged-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 for instance with vm_state deleted and task_state None.
Nov 29 21:04:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Received event network-vif-plugged-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:04:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] Acquiring lock "657fb92f-75a4-4f51-a096-394487e79e04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:04:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] Lock "657fb92f-75a4-4f51-a096-394487e79e04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:04:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] Lock "657fb92f-75a4-4f51-a096-394487e79e04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:04:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] No waiting events found dispatching network-vif-plugged-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:04:15 user nova-compute[75356]: WARNING nova.compute.manager [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Received unexpected event network-vif-plugged-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 for instance with vm_state deleted and task_state None.
Nov 29 21:04:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Received event network-vif-plugged-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:04:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] Acquiring lock "657fb92f-75a4-4f51-a096-394487e79e04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:04:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] Lock "657fb92f-75a4-4f51-a096-394487e79e04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:04:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] Lock "657fb92f-75a4-4f51-a096-394487e79e04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:04:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] No waiting events found dispatching network-vif-plugged-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:04:15 user nova-compute[75356]: WARNING nova.compute.manager [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Received unexpected event network-vif-plugged-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 for instance with vm_state deleted and task_state None.
Nov 29 21:04:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-1cdd17be-59ca-44c2-baa4-77f092277394 req-a47a80ec-5379-4be1-ba03-5dac58762ed8 service nova] [instance: 657fb92f-75a4-4f51-a096-394487e79e04] Received event network-vif-deleted-43a6ef65-a2c9-41ad-9afe-c3c6e451e280 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:04:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:04:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:04:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:04:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:04:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:28 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:04:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:04:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:04:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:04:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:04:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:29 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:04:29 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:04:29 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Didn't find any instances for network info cache update. {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 21:04:33 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:04:33 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:04:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:04:35 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:04:36 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:04:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:04:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:04:36 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:04:36 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:04:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:04:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:04:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 21:04:36 user nova-compute[75356]: DEBUG oslo_concurrency.processutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75356) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 21:04:37 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:04:37 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:04:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=9063MB free_disk=24.917030334472656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:04:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:04:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:04:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Instance eda4aa1e-99e7-4973-832c-6ee42077012d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75356) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 21:04:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:04:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:04:37 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:04:37 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:04:37 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:04:37 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:04:38 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:04:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:04:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:04:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:04:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:04:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:40 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:04:42 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:04:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:04:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:04:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:04:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:04:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:04:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:45 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:04:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:04:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:04:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:04:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:04:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:04:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:04:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:04:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:04:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:04:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:04:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:05:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:05:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:05:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:05:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-7b218d79-5f2b-4ab1-8ea4-9c4b9dcdcc7a req-bfcb5bab-5a26-4c92-bb56-97e67463d08f service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Received event network-changed-6859890f-25ac-4378-a758-58da0db29b49 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:05:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-7b218d79-5f2b-4ab1-8ea4-9c4b9dcdcc7a req-bfcb5bab-5a26-4c92-bb56-97e67463d08f service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Refreshing instance network info cache due to event network-changed-6859890f-25ac-4378-a758-58da0db29b49. {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 21:05:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7b218d79-5f2b-4ab1-8ea4-9c4b9dcdcc7a req-bfcb5bab-5a26-4c92-bb56-97e67463d08f service nova] Acquiring lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 21:05:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7b218d79-5f2b-4ab1-8ea4-9c4b9dcdcc7a req-bfcb5bab-5a26-4c92-bb56-97e67463d08f service nova] Acquired lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 21:05:13 user nova-compute[75356]: DEBUG nova.network.neutron [req-7b218d79-5f2b-4ab1-8ea4-9c4b9dcdcc7a req-bfcb5bab-5a26-4c92-bb56-97e67463d08f service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Refreshing network info cache for port 6859890f-25ac-4378-a758-58da0db29b49 {{(pid=75356) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 21:05:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "eda4aa1e-99e7-4973-832c-6ee42077012d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:05:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "eda4aa1e-99e7-4973-832c-6ee42077012d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:05:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "eda4aa1e-99e7-4973-832c-6ee42077012d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:05:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "eda4aa1e-99e7-4973-832c-6ee42077012d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:05:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "eda4aa1e-99e7-4973-832c-6ee42077012d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:05:13 user nova-compute[75356]: INFO nova.compute.manager [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Terminating instance
Nov 29 21:05:13 user nova-compute[75356]: DEBUG nova.compute.manager [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Start destroying the instance on the hypervisor. {{(pid=75356) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 21:05:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:05:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:05:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:05:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:05:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-ec766312-94b0-4f99-b777-96674cd85eba req-47464cc1-2d5e-4004-8425-fbf91a1707e0 service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Received event network-vif-unplugged-6859890f-25ac-4378-a758-58da0db29b49 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:05:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ec766312-94b0-4f99-b777-96674cd85eba req-47464cc1-2d5e-4004-8425-fbf91a1707e0 service nova] Acquiring lock "eda4aa1e-99e7-4973-832c-6ee42077012d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:05:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ec766312-94b0-4f99-b777-96674cd85eba req-47464cc1-2d5e-4004-8425-fbf91a1707e0 service nova] Lock "eda4aa1e-99e7-4973-832c-6ee42077012d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:05:13 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-ec766312-94b0-4f99-b777-96674cd85eba req-47464cc1-2d5e-4004-8425-fbf91a1707e0 service nova] Lock "eda4aa1e-99e7-4973-832c-6ee42077012d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:05:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-ec766312-94b0-4f99-b777-96674cd85eba req-47464cc1-2d5e-4004-8425-fbf91a1707e0 service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] No waiting events found dispatching network-vif-unplugged-6859890f-25ac-4378-a758-58da0db29b49 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:05:13 user nova-compute[75356]: DEBUG nova.compute.manager [req-ec766312-94b0-4f99-b777-96674cd85eba req-47464cc1-2d5e-4004-8425-fbf91a1707e0 service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Received event network-vif-unplugged-6859890f-25ac-4378-a758-58da0db29b49 for instance with task_state deleting. {{(pid=75356) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 21:05:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:05:14 user nova-compute[75356]: INFO nova.virt.libvirt.driver [-] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Instance destroyed successfully.
Nov 29 21:05:14 user nova-compute[75356]: DEBUG nova.objects.instance [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lazy-loading 'resources' on Instance uuid eda4aa1e-99e7-4973-832c-6ee42077012d {{(pid=75356) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 21:05:14 user nova-compute[75356]: DEBUG nova.virt.libvirt.vif [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T20:58:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-927342429',display_name='tempest-TestStampPattern-server-927342429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-927342429',id=51,image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGAFam8O0by6XSQDRfy1NdNe3iK/s41EVX/2vOG4f/avx+fZuldYPIcYw0ykNVKGY31g+OK6PLVJ/9BToxsJc6YzTuxdkUJ/LiSyuAXTM1wLeUdcFQ1eXOyB4opMKLyMA==',key_name='tempest-TestStampPattern-2006686699',keypairs=<?>,launch_index=0,launched_at=2023-11-29T20:58:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12e55938263546bcb8e97bff962d6356',ramdisk_id='',reservation_id='r-5rdmmdub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6ec9e8df-1fe5-47a2-a649-880c9c3e5f36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-46479786',owner_user_name='tempest-TestStampPattern-46479786-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T21:01:13Z,user_data=None,user_id='ac2b35f0b3784f51bbdb977070f922cc',uuid=eda4aa1e-99e7-4973-832c-6ee42077012d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6859890f-25ac-4378-a758-58da0db29b49", "address": "fa:16:3e:04:d5:a0", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6859890f-25", "ovs_interfaceid": "6859890f-25ac-4378-a758-58da0db29b49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 21:05:14 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Converting VIF {"id": "6859890f-25ac-4378-a758-58da0db29b49", "address": "fa:16:3e:04:d5:a0", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6859890f-25", "ovs_interfaceid": "6859890f-25ac-4378-a758-58da0db29b49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 21:05:14 user nova-compute[75356]: DEBUG nova.network.os_vif_util [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:d5:a0,bridge_name='br-int',has_traffic_filtering=True,id=6859890f-25ac-4378-a758-58da0db29b49,network=Network(152ef722-f2bf-4a14-84ef-0a650a2ff94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6859890f-25') {{(pid=75356) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 21:05:14 user nova-compute[75356]: DEBUG os_vif [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:d5:a0,bridge_name='br-int',has_traffic_filtering=True,id=6859890f-25ac-4378-a758-58da0db29b49,network=Network(152ef722-f2bf-4a14-84ef-0a650a2ff94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6859890f-25') {{(pid=75356) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 21:05:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:05:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6859890f-25, bridge=br-int, if_exists=True) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:05:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:05:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:05:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03acbe17-9fed-45df-96c4-5594ec028c9f) {{(pid=75356) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 21:05:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:05:14 user nova-compute[75356]: DEBUG nova.network.neutron [req-7b218d79-5f2b-4ab1-8ea4-9c4b9dcdcc7a req-bfcb5bab-5a26-4c92-bb56-97e67463d08f service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Updated VIF entry in instance network info cache for port 6859890f-25ac-4378-a758-58da0db29b49. {{(pid=75356) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 21:05:14 user nova-compute[75356]: DEBUG nova.network.neutron [req-7b218d79-5f2b-4ab1-8ea4-9c4b9dcdcc7a req-bfcb5bab-5a26-4c92-bb56-97e67463d08f service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Updating instance_info_cache with network_info: [{"id": "6859890f-25ac-4378-a758-58da0db29b49", "address": "fa:16:3e:04:d5:a0", "network": {"id": "152ef722-f2bf-4a14-84ef-0a650a2ff94b", "bridge": "br-int", "label": "tempest-TestStampPattern-1383609842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12e55938263546bcb8e97bff962d6356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6859890f-25", "ovs_interfaceid": "6859890f-25ac-4378-a758-58da0db29b49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:05:14 user nova-compute[75356]: INFO os_vif [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:d5:a0,bridge_name='br-int',has_traffic_filtering=True,id=6859890f-25ac-4378-a758-58da0db29b49,network=Network(152ef722-f2bf-4a14-84ef-0a650a2ff94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6859890f-25')
Nov 29 21:05:14 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Deleting instance files /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d_del
Nov 29 21:05:14 user nova-compute[75356]: INFO nova.virt.libvirt.driver [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Deletion of /opt/stack/data/nova/instances/eda4aa1e-99e7-4973-832c-6ee42077012d_del complete
Nov 29 21:05:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-7b218d79-5f2b-4ab1-8ea4-9c4b9dcdcc7a req-bfcb5bab-5a26-4c92-bb56-97e67463d08f service nova] Releasing lock "refresh_cache-eda4aa1e-99e7-4973-832c-6ee42077012d" {{(pid=75356) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 21:05:14 user nova-compute[75356]: INFO nova.compute.manager [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 29 21:05:14 user nova-compute[75356]: DEBUG oslo.service.loopingcall [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75356) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 21:05:14 user nova-compute[75356]: DEBUG nova.compute.manager [-] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Deallocating network for instance {{(pid=75356) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 21:05:14 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] deallocate_for_instance() {{(pid=75356) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 21:05:14 user nova-compute[75356]: DEBUG nova.network.neutron [-] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Updating instance_info_cache with network_info: [] {{(pid=75356) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 21:05:14 user nova-compute[75356]: INFO nova.compute.manager [-] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Took 0.41 seconds to deallocate network for instance.
Nov 29 21:05:14 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:05:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:05:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:05:14 user nova-compute[75356]: WARNING nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] While synchronizing instance power states, found 1 instances in the database and 0 instances on the hypervisor.
Nov 29 21:05:14 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Triggering sync for uuid eda4aa1e-99e7-4973-832c-6ee42077012d {{(pid=75356) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 21:05:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "eda4aa1e-99e7-4973-832c-6ee42077012d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:05:14 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:05:14 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:05:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.112s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:05:14 user nova-compute[75356]: INFO nova.scheduler.client.report [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Deleted allocations for instance eda4aa1e-99e7-4973-832c-6ee42077012d
Nov 29 21:05:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-8dde18ed-766c-49f0-ab03-ca111c246961 tempest-TestStampPattern-46479786 tempest-TestStampPattern-46479786-project-member] Lock "eda4aa1e-99e7-4973-832c-6ee42077012d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.602s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:05:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "eda4aa1e-99e7-4973-832c-6ee42077012d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.231s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:05:14 user nova-compute[75356]: INFO nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 29 21:05:14 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "eda4aa1e-99e7-4973-832c-6ee42077012d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:05:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-9886e2ec-8c15-4a3d-b821-7fe9ddb4d7c1 req-0ef298fd-2159-4806-aa46-584639a777b6 service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Received event network-vif-deleted-6859890f-25ac-4378-a758-58da0db29b49 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:05:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-f84ba02d-d3ec-404f-9ea4-d691f90dc562 req-4c5430fa-eb31-4b98-a685-60ea5858b15d service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Received event network-vif-plugged-6859890f-25ac-4378-a758-58da0db29b49 {{(pid=75356) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 21:05:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f84ba02d-d3ec-404f-9ea4-d691f90dc562 req-4c5430fa-eb31-4b98-a685-60ea5858b15d service nova] Acquiring lock "eda4aa1e-99e7-4973-832c-6ee42077012d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:05:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f84ba02d-d3ec-404f-9ea4-d691f90dc562 req-4c5430fa-eb31-4b98-a685-60ea5858b15d service nova] Lock "eda4aa1e-99e7-4973-832c-6ee42077012d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:05:15 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [req-f84ba02d-d3ec-404f-9ea4-d691f90dc562 req-4c5430fa-eb31-4b98-a685-60ea5858b15d service nova] Lock "eda4aa1e-99e7-4973-832c-6ee42077012d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:05:15 user nova-compute[75356]: DEBUG nova.compute.manager [req-f84ba02d-d3ec-404f-9ea4-d691f90dc562 req-4c5430fa-eb31-4b98-a685-60ea5858b15d service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] No waiting events found dispatching network-vif-plugged-6859890f-25ac-4378-a758-58da0db29b49 {{(pid=75356) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 21:05:15 user nova-compute[75356]: WARNING nova.compute.manager [req-f84ba02d-d3ec-404f-9ea4-d691f90dc562 req-4c5430fa-eb31-4b98-a685-60ea5858b15d service nova] [instance: eda4aa1e-99e7-4973-832c-6ee42077012d] Received unexpected event network-vif-plugged-6859890f-25ac-4378-a758-58da0db29b49 for instance with vm_state deleted and task_state None.
Nov 29 21:05:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:05:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:05:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:05:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:05:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:05:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:05:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:05:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:05:29 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:05:30 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:05:30 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:05:30 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 21:05:30 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Didn't find any instances for network info cache update. {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 21:05:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:05:34 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:05:34 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 21:05:37 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:05:37 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:05:37 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:05:38 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:05:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:05:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:05:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:05:38 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Auditing locally available compute resources for user (node: user) {{(pid=75356) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 21:05:38 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:05:38 user nova-compute[75356]: WARNING nova.virt.libvirt.driver [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 21:05:38 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Hypervisor/Node resource view: name=user free_ram=9207MB free_disk=25.04167938232422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75356) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 21:05:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 21:05:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 21:05:38 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 21:05:38 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75356) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 21:05:38 user nova-compute[75356]: DEBUG nova.compute.provider_tree [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed in ProviderTree for provider: 5a24b660-3bbe-4ca7-ac25-69a2aeed184a {{(pid=75356) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 21:05:38 user nova-compute[75356]: DEBUG nova.scheduler.client.report [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Inventory has not changed for provider 5a24b660-3bbe-4ca7-ac25-69a2aeed184a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75356) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 21:05:38 user nova-compute[75356]: DEBUG nova.compute.resource_tracker [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Compute_service record updated for user:user {{(pid=75356) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 21:05:38 user nova-compute[75356]: DEBUG oslo_concurrency.lockutils [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=75356) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 21:05:39 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:05:40 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:05:43 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:05:44 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:05:45 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:05:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:05:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:05:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75356) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 21:05:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:05:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75356) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 21:05:49 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:05:54 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:05:59 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:06:04 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:06:09 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:06:10 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:06:11 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:06:13 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:06:14 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:06:19 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:06:24 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 21:06:29 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:06:30 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:06:30 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:06:30 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Starting heal instance info cache {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 21:06:30 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Rebuilding the list of instances to heal {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 21:06:30 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Didn't find any instances for network info cache update. {{(pid=75356) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 21:06:34 user nova-compute[75356]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75356) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 21:06:34 user nova-compute[75356]: DEBUG oslo_service.periodic_task [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75356) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 21:06:34 user nova-compute[75356]: DEBUG nova.compute.manager [None req-c1bc243a-7510-4295-b545-33e5a568ac63 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75356) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}